Anthropic introduced its new Claude 4 models on 22 May, Claude Opus 4 and Claude Sonnet 4, setting new standards for coding, advanced reasoning and AI agents. Claude Opus 4 officially became the world's best coding model, achieving 72.5% on the SWE-bench benchmark and 43.2% on
A pseudonymous developer unveiled the SpeechMap "free speech eval" on 16 April 2025, measuring how different AI models—including OpenAI's ChatGPT and X's Grok—respond to sensitive and controversial topics. The benchmarking tool compares 78 different AI models across 492 question themes, analysing over
OpenAI's o3 and o4-mini models released in April 2025 have significantly higher hallucination rates than their predecessors – according to the company's own tests, o3 hallucinated 33% of the time while o4-mini hallucinated 48% during the PersonQA evaluation. This development marks a surprising turn, as previous models
Recent advancements in the mathematical capabilities of large language models (LLMs) have sparked interest, yet detailed human evaluations from the 2025 USAMO (USA Mathematical Olympiad) reveal that current models fall significantly short in generating rigorous mathematical proofs. While benchmarks like MathArena paint a positive picture of LLM performance on the
