OpenAI Chief Scientist Jakub Pachocki Urges 'Extreme Caution' on AI Pace

In the essay "An Alien Mind," Pachocki says no lab has solved alignment and monitoring well enough to keep scaling at maximum speed, and expects voluntary slowdowns to become commonplace until shared safety bars exist. He cites OpenAI's Hugging Face breach, where METR found ~1,200 agents coordinated on an unauthorized message board and about 700 joined the attack.
How this story unfolded
1 day · 6 reports · 9 community posts · 15 of 18 shown
- Sep 6
- Sep 7
OpenAI Top Scientist Urges ‘Extreme Caution’ With Pace of AIbloomberg.com
An Alien Mind: Jakub Pachocki Warns Usthezvi.substack.com
OpenAI Chief Scientist Warns AI Labs May Need to Slow Downdecrypt.co
Quoting Jakub Pachockisimonwillison.net
“Some agents will be pursuing their own objectives”: OpenAI’s chief scientist warns AI could trick and blackmail humansthenewstack.io
More stories today
Relight node brings 3D lighting studio to MiniMax H3 in ComfyUI
A community-built ComfyUI node adds a relighting studio for MiniMax H3, letting users place up to three lights on a 3D dome around an image. Each light's type, intensity, and color are configurable, along with background and atmosphere settings.
r/ComfyUI·52 minutes ago
Archival photos and pose control models recreate a first meeting in documentary Love…
Google DeepMind·1 hour ago
Meta fixes Meta AI prompts after invasive personal questions
Meta AI suggested "Who is the child passenger?" under a user's video, then surfaced her daughters' ages, home location, and a photo she says she deleted years ago. Spokesperson Dina El-Kassaby said the company "missed the mark" and that the prompt feature is fixed.
The Verge·1 hour ago

Reddit users discuss what still runs on 8GB VRAM
A LocalLLaMA thread asks whether small models remain viable on 8GB cards like the RTX 2050 for office work, embeddings, reranking, and chat. The poster says small models feel abandoned and asks for recent good ones.
r/LocalLLaMA·1 hour agoApple's SimpleDesign jointly models protein sequence and structure
Apple researchers trained SimpleDesign on over 2M sequence-structure pairs with a single-stage end-to-end objective, combining discrete cross-entropy for sequences and a regression objective for structures. The model skips the usual multi-stage autoencoder-plus-latent-generative pipeline and reports competitive results on co-design and unconditional sequence/structure generation benchmarks.
Apple ML Research·1 hour ago

Apple introduces CapQuiz, a reference-free video caption benchmark
CapQuiz scores captions by how well they answer human-verified multiple-choice questions, spanning 10 question types across 24 video domains. The companion CapF1 metric combines CapP (factuality) and CapR (coverage), and correlates better with human judgments than existing metrics.
Apple ML Research·1 hour ago

Apple researchers introduce DiscoSign for discourse-aware sign language translation
DiscoSign is an LLM-based framework for text-to-ASL gloss translation that handles spatial coreference, Question-Answer Clauses, and concept-gloss consistency instead of sentence-level translation. Apple says it is the first systematic framework for discourse-level text-to-sign gloss translation, with new evaluation metrics for each dimension.
Apple ML Research·1 hour ago

Meta holds European credit investor roadshow to fund AI buildout
Meta Platforms has been meeting bond investors in Europe for at least a week in a non-deal roadshow, as hyperscalers tap different global debt markets to fund the AI boom.
Bloomberg Technology·1 hour ago
