Content Type
Which model is actually stronger: ongoing coverage of benchmark scores, evaluation-methodology disputes, and leaderboard shifts.
3 selectedLast 30 days: 2Total indexed: 8
GitHub released ReviewBench, an open offline benchmark for AI code review agents.
Why it matters: GitHub's own numbers show how an offline code-review benchmark tracked a production A/B test, useful for teams weighing offline signals.
Microsoft and Hugging Face released ThinkingBox, an agent benchmark that grades terminal backend state and side effects rather than final responses or tool-call validity.
Why it matters: The paper's 20-run repeat metric and failure breakdown show why a clean tool-call trace can still leave the wrong database state.
Mistral released Agentic Search, a multi-step retrieval layer that lets models search.
Why it matters: The post gives benchmark deltas and the five retrieval tools, so readers can judge whether their one-shot RAG pipeline should be replaced.