Import AI· Jack Clark·· 2026-10-12AI score48
Import AI 476: Creativity and RSI; worse-than-China open weight models; AI goes to space
Import AI 476: Creativity and RSI; worse-than-China open weight models; AI goes to space
AI summary
This Import AI issue covers the Humanity's Sixth Sense benchmark from Elorian and Scale AI, where humans score 93.1 pass@1 versus 53.6 for the best model, GPT 6 Astra, with Chinese open weight models scoring far lower. It also discusses P-Zero Research's TasteVal benchmark, which reports that frontier models' experimental research taste has doubled every 3.0 months since December 2025, with Opus 5.5 exceeding the human baseline, and covers Reflection's 501B-parameter Beam and Mistral Large 4, both trailing Chinese open weight models on several benchmarks.
Source: Import AI · importai.substack.com