2025-05-26
Google releases open-source LMEval to benchmark language and multimodal models
LMEval aims to standardize benchmarks and streamline safety analysis for large language and multimodal models.
The article Google releases open-source LMEval to benchmark language and multimodal models appeared first on THE DECODER.
[...]Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
2025-10-02
'Western Qwen': IBM wows with Granite 4 LLM launch and hybrid Mamba/Transformer architecture
IBM today announced the release of Granite 4.0, the newest generation of its homemade family of open source large language models (LLMs) designed to balance high performance with lower memory and cost [...]
2025-10-08
Samsung AI researcher's new, open reasoning model TRM outperforms models 10,000X larger — on specific problems
The trend of AI researchers developing new, small open source generative models that outperform far larger, proprietary peers continued this week with yet another staggering advancement.Alexia Jolicoe [...]
2025-09-29
DeepSeek's new V3.2-Exp model cuts API pricing in half to less than 3 cents per 1M input tokens
DeepSeek continues to push the frontier of generative AI...in this case, in terms of affordability.The company has unveiled its latest experimental large language model (LLM), DeepSeek-V3.2-Exp, that [...]
2025-05-20
Google I/O 2025 recap: AI updates, Android XR, Google Beam and everything else announced at the annual keynote
Today is one of the most important days on the tech calendar as Google kicked off its I/O developer event with its annual keynote. As ever, the company had many updates for a wide range of products to [...]
2025-08-19
10 Pixels in, the purpose of a Google-made smartphone remains the same
Google didn't need to make its own smartphone. Even though the company spent several years having other manufacturers build phones it could slap its "Nexus" branding on, selling hardwar [...]
2025-10-01
Thinking Machines' first official product is here: meet Tinker, an API for distributed LLM fine-tuning
Thinking Machines, the AI startup founded earlier this year by former OpenAI CTO Mira Murati, has launched its first product: Tinker, a Python-based API designed to make large language model (LLM) fin [...]