DEV Community

#benchmarks

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Hugging Face Official Benchmarks: Daily Update 2026-11-10

Hugging Face Official Benchmarks: Daily Update 2026-11-10

Comments
4 min read
Metrics for Your AI Workers: Build a Personal Agent Benchmark

Metrics for Your AI Workers: Build a Personal Agent Benchmark

Comments 3
4 min read
Why an 88.64 leaderboard score needed the catch in the same sentence

Why an 88.64 leaderboard score needed the catch in the same sentence

Comments
1 min read
Inkling 2 Small is cheap per token but writes a lot: what 150,000 output tokens per task does to the price

Inkling 2 Small is cheap per token but writes a lot: what 150,000 output tokens per task does to the price

Comments
12 min read
Filming the Ripple-65B walkthrough taught me that 80.52 needs a table, not a take

Filming the Ripple-65B walkthrough taught me that 80.52 needs a table, not a take

Comments
1 min read
23-point split: 6 models tied at 74% fell apart on 17 lines

23-point split: 6 models tied at 74% fell apart on 17 lines

Comments
5 min read
The 80.52 Short: why a 65B beating a 501B needed a video to be believed

The 80.52 Short: why a 65B beating a 501B needed a video to be believed

Comments
1 min read
When strong models agree on a different GSM8K answer, the answer key is usually wrong

When strong models agree on a different GSM8K answer, the answer key is usually wrong

Comments
3 min read
How many wrong answer keys are left in MMLU?

How many wrong answer keys are left in MMLU?

Comments
3 min read
La misma molécula, otra GPU, otro puesto: cómo una tarjeta barata cambió un ranking sin dar ningún error

La misma molécula, otra GPU, otro puesto: cómo una tarjeta barata cambió un ranking sin dar ningún error

Comments
9 min read
Our best shortcut for finding wrong MMLU answer keys failed its replication

Our best shortcut for finding wrong MMLU answer keys failed its replication

Comments 1
4 min read
The 89% Short: why a hallucination rate needed a video to be honest

The 89% Short: why a hallucination rate needed a video to be honest

1
Comments
1 min read
Hugging Face Official Benchmarks: Daily Update 2026-11-07

Hugging Face Official Benchmarks: Daily Update 2026-11-07

Comments
4 min read
How strong does a model panel need to be to find wrong MMLU answer keys?

How strong does a model panel need to be to find wrong MMLU answer keys?

Comments
4 min read
When two independent model panels both say an MMLU answer key is wrong, experts found an error 1 time in 3

When two independent model panels both say an MMLU answer key is wrong, experts found an error 1 time in 3

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.