Gemini API 2026 — Flash-Lite to Pro Speed & Cost Benchmarks
Real measurement data from May 2026. Compared Gemini 2.5 Flash-Lite (65 TPS), 2.5 Flash, 2.5 Pro, and 3.5 Flash under identical conditions.
Tags
Benchmark
4 posts
AI Self-Generated Skills Are Useless
SkillsBench proves AI agents cannot author useful skills for themselves. Across 7,308 trajectories, self-generated skills showed zero benefit while human-curated skills improved performance by 16.2pp.
Qwen 3.5 Goes Bankrupt on Vending-Bench 2
Qwen 3.5, a top performer on standard benchmarks, goes bankrupt on Vending-Bench 2's vending machine simulation. Exploring the blind spots of benchmark-driven AI evaluation.
MiniMax M2.5: Open-Weight Closes In on Proprietary Models
MiniMax M2.5 achieves 80.2% on SWE-Bench Verified, surpassing Claude Opus 4.6. We analyze how the performance gap between open-weight and proprietary models is rapidly closing, with comprehensive benchmark data.