2025-07-20
New ARC-AGI-3 benchmark shows that humans still outperform LLMs at pretty basic thinking
ARC-AGI-3 aims to test how well AI systems can handle brand new problems. While people breeze through the challenges, the latest AI models still come up short.
The article New ARC-AGI-3 benchmark shows that humans still outperform LLMs at pretty basic thinking appeared first on THE DECODER.
[...]Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
2025-08-07
Grok 4 edges out GPT-5 in complex reasoning benchmark ARC-AGI
In the ARC-AGI-2 benchmark, which is designed to measure a language model's general reasoning skills, GPT-5 (High) scored 9.9 percent at a cost of $0.73 per task, according to ARC Prize.<br /& [...]
2025-03-26
OpenAI's top models crash from 75% to just 4% on challenging new ARC-AGI-2 test
The new AI benchmark ARC-AGI-2 significantly raises the bar for AI tests. While humans can easily solve the tasks, even highly developed AI systems such as OpenAI o3 clearly fail.<br /> The arti [...]
2025-05-13
OpenAI says its latest models outperform doctors in medical benchmark
OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it's designed to evaluate how well language models handle realistic medical conversations. According [...]
2025-05-27
The Browser Company stops active development of Arc in favor of new AI-focused product
The Browser Company has stopped active development of the popular Arc web browser, according to a blog post from CEO Josh Miller. There will still be updates to fix security issues and the like, but t [...]
2025-10-01
Thinking Machines' first official product is here: meet Tinker, an API for distributed LLM fine-tuning
Thinking Machines, the AI startup founded earlier this year by former OpenAI CTO Mira Murati, has launched its first product: Tinker, a Python-based API designed to make large language model (LLM) fin [...]
2025-10-02
'Western Qwen': IBM wows with Granite 4 LLM launch and hybrid Mamba/Transformer architecture
IBM today announced the release of Granite 4.0, the newest generation of its homemade family of open source large language models (LLMs) designed to balance high performance with lower memory and cost [...]