DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
WAV vs MP3 vs FLAC vs AAC: I Round-Tripped 60 Seconds of Audio and Measured the Damage

WAV vs MP3 vs FLAC vs AAC: I Round-Tripped 60 Seconds of Audio and Measured the Damage

Comments
4 min read
SWE-bench Multilingual on Hugging Face: 15 of 34 Scores Are Not a Count Out of 300 Tasks

SWE-bench Multilingual on Hugging Face: 15 of 34 Scores Are Not a Count Out of 300 Tasks

Comments
15 min read
โมเดลเดียวกัน แต่ผลต่างเกือบ 40 จุด: Harness Leaderboard บอกว่าควรเลือกตัวครอบ AI อย่างไร

โมเดลเดียวกัน แต่ผลต่างเกือบ 40 จุด: Harness Leaderboard บอกว่าควรเลือกตัวครอบ AI อย่างไร

Comments
2 min read
A 6 GB GPU Runs a 26B LLM at 45 Tokens per Second. How to Test the Claim

A 6 GB GPU Runs a 26B LLM at 45 Tokens per Second. How to Test the Claim

Comments
7 min read
olmOCR-bench on Hugging Face: Three Rows Use a Different Average, and One Moves From 13th to 7th or 19th

olmOCR-bench on Hugging Face: Three Rows Use a Different Average, and One Moves From 13th to 7th or 19th

Comments
14 min read
The Benchmark That Writes a New Exam Every Month: SuperCLUE's November 2026 Board, 19 Models, One Table

The Benchmark That Writes a New Exam Every Month: SuperCLUE's November 2026 Board, 19 Models, One Table

Comments
4 min read
La evaluación que reescribe su examen cada mes: el tablero de SuperCLUE de noviembre de 2026, 19 modelos en una tabla

La evaluación que reescribe su examen cada mes: el tablero de SuperCLUE de noviembre de 2026, 19 modelos en una tabla

Comments
4 min read
One Week, Three Public Numbers: 73.68 Open-Weight #1 in Math Reasoning, 290 of 290 Actions Denied, 3.15M On-Device Downloads

One Week, Three Public Numbers: 73.68 Open-Weight #1 in Math Reasoning, 290 of 290 Actions Denied, 3.15M On-Device Downloads

Comments
3 min read
Оценка, которая каждый месяц пишет новый экзамен: ноябрьская таблица SuperCLUE 2026, 19 моделей в одной таблице

Оценка, которая каждый месяц пишет новый экзамен: ноябрьская таблица SuperCLUE 2026, 19 моделей в одной таблице

Comments
2 min read
Write the Provenance Ledger Before the Benchmark Number

Write the Provenance Ledger Before the Benchmark Number

Comments
5 min read
毎月、問題を作り直す評価機関: SuperCLUE 2026年11月ボード、世界最前線19モデルを一枚の表に

毎月、問題を作り直す評価機関: SuperCLUE 2026年11月ボード、世界最前線19モデルを一枚の表に

Comments
2 min read
Tokens per Accepted Patch: The Only AI Metric I Keep

Tokens per Accepted Patch: The Only AI Metric I Keep

Comments
5 min read
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary

How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary

Comments
4 min read
Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM

Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM

Comments 1
16 min read
Calibrate the Task Set Before You Scale the Run

Calibrate the Task Set Before You Scale the Run

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.