Sakana AI's CTO says he's 'absolutely sick' of transformers, the tech that powers every major AI model
In a striking act of self-critique, one of the architects of the transformer technology that powers ChatGPT, Claude, and virtually every major AI system told an audience of industry leaders this week that artificial intelligence research has become dangerously narrow — and that he's moving on from his own creation.Llion Jones, who co-authored the seminal 2017 paper "Attention Is All You Need" and even coined the name "transformer," delivered an unusually candid assessment at the TED AI conference in San Francisco on Tuesday: Despite unprecedented investment and talent flooding into AI, the field has calcified around a single architectural approach, potentially blinding researchers to the next major breakthrough."Despite the fact that there's never been [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
'Western Qwen': IBM wows with Granite 4 LLM launch and hybrid Mamba/Transformer architecture
IBM today announced the release of Granite 4.0, the newest generation of its homemade family of open source large language models (LLMs) designed to balance high performance with lower memory and cost [...]
AWS launches Kiro powers with Stripe, Figma, and Datadog integrations for AI-assisted coding
Amazon Web Services on Wednesday introduced Kiro powers, a system that allows software developers to give their AI coding assistants instant, specialized expertise in specific tools and workflows — [...]
Why Sakana AI’s big win is a big deal for the future of enterprise agents
In an impressive feat, Japanese startup Sakana AI’s coding agent ALE-Agent recently secured first place in the AtCoder Heuristic Contest (AHC058), a complex coding competition that involves complica [...]
Sakana AI launches "Ultra Deep Research" to automate weeks of strategy work
Sakana AI has unveiled "Sakana Marlin," an AI assistant for business customers that researches autonomously for up to eight hours and delivers finished analyses. The tool is designed to comp [...]
Baidu just dropped an open-source multimodal AI that it claims beats GPT-5 and Gemini
Baidu Inc., China's largest search engine company, released a new artificial intelligence model on Monday that its developers claim outperforms competitors from Google and OpenAI on several visio [...]
Sakana AI's new algorithm lets large language models work together to solve complex problems
The Japanese AI startup Sakana AI has developed a new method that lets multiple large language models, such as ChatGPT and Gemini, work together on the same problem. Early tests suggest this collabora [...]
TII’s Falcon H1R 7B can out-reason models up to 7x its size — and it’s (mostly) open
For the last two years, the prevailing logic in generative AI has been one of brute force: if you want better reasoning, you need a bigger model. While "small" models (under 10 billion param [...]
Japanese startup Sakana AI explores time-based thinking with brain-inspired AI model
Sakana AI, a Tokyo-based startup, has introduced a new kind of AI system designed to mimic how the brain processes time.<br /> The article Japanese startup Sakana AI explores time-based thinking [...]