Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmarks
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Hugging Face Official Benchmarks: Daily Update 2026-11-10
QuantID
QuantID
QuantID
Follow
Nov 9
Hugging Face Official Benchmarks: Daily Update 2026-11-10
#
ai
#
benchmarks
#
huggingface
#
llm
Comments
Add Comment
4 min read
Moderation
Metrics for Your AI Workers: Build a Personal Agent Benchmark
Josep Oriol Carné
Josep Oriol Carné
Josep Oriol Carné
Follow
Nov 8
Metrics for Your AI Workers: Build a Personal Agent Benchmark
#
ai
#
llm
#
agents
#
benchmarks
Comments
3
comments
4 min read
Moderation
Why an 88.64 leaderboard score needed the catch in the same sentence
InApp
InApp
InApp
Follow
Nov 8
Why an 88.64 leaderboard score needed the catch in the same sentence
#
benchmarks
#
evals
#
video
#
ai
Comments
Add Comment
1 min read
Moderation
Inkling 2 Small is cheap per token but writes a lot: what 150,000 output tokens per task does to the price
ai maya
ai maya
ai maya
Follow
Nov 8
Inkling 2 Small is cheap per token but writes a lot: what 150,000 output tokens per task does to the price
#
ai
#
machinelearning
#
llm
#
benchmarks
Comments
Add Comment
12 min read
Moderation
Filming the Ripple-65B walkthrough taught me that 80.52 needs a table, not a take
InApp
InApp
InApp
Follow
Nov 8
Filming the Ripple-65B walkthrough taught me that 80.52 needs a table, not a take
#
ai
#
benchmarks
#
video
#
selfhosted
Comments
Add Comment
1 min read
Moderation
23-point split: 6 models tied at 74% fell apart on 17 lines
frank chu
frank chu
frank chu
Follow
Nov 8
23-point split: 6 models tied at 74% fell apart on 17 lines
#
discuss
#
ai
#
machinelearning
#
benchmarks
Comments
Add Comment
5 min read
Moderation
The 80.52 Short: why a 65B beating a 501B needed a video to be believed
InApp
InApp
InApp
Follow
Nov 7
The 80.52 Short: why a 65B beating a 501B needed a video to be believed
#
llm
#
benchmarks
#
video
#
ai
Comments
Add Comment
1 min read
Moderation
When strong models agree on a different GSM8K answer, the answer key is usually wrong
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
Follow
Nov 7
When strong models agree on a different GSM8K answer, the answer key is usually wrong
#
machinelearning
#
datascience
#
nlp
#
benchmarks
Comments
Add Comment
3 min read
Moderation
How many wrong answer keys are left in MMLU?
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
Follow
Nov 7
How many wrong answer keys are left in MMLU?
#
machinelearning
#
datascience
#
nlp
#
benchmarks
Comments
Add Comment
3 min read
Moderation
La misma molécula, otra GPU, otro puesto: cómo una tarjeta barata cambió un ranking sin dar ningún error
김민식/학생
김민식/학생
김민식/학생
Follow
Nov 6
La misma molécula, otra GPU, otro puesto: cómo una tarjeta barata cambió un ranking sin dar ningún error
#
ai
#
python
#
mlops
#
benchmarks
Comments
Add Comment
9 min read
Moderation
Our best shortcut for finding wrong MMLU answer keys failed its replication
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
Follow
Nov 6
Our best shortcut for finding wrong MMLU answer keys failed its replication
#
machinelearning
#
datascience
#
nlp
#
benchmarks
Comments
1
comment
4 min read
Moderation
The 89% Short: why a hallucination rate needed a video to be honest
InApp
InApp
InApp
Follow
Nov 6
The 89% Short: why a hallucination rate needed a video to be honest
#
llmevals
#
benchmarks
#
hallucination
#
ai
1
reaction
Comments
Add Comment
1 min read
Moderation
Hugging Face Official Benchmarks: Daily Update 2026-11-07
QuantID
QuantID
QuantID
Follow
Nov 6
Hugging Face Official Benchmarks: Daily Update 2026-11-07
#
ai
#
benchmarks
#
huggingface
#
llm
Comments
Add Comment
4 min read
Moderation
How strong does a model panel need to be to find wrong MMLU answer keys?
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
Follow
Nov 6
How strong does a model panel need to be to find wrong MMLU answer keys?
#
machinelearning
#
datascience
#
nlp
#
benchmarks
Comments
Add Comment
4 min read
Moderation
When two independent model panels both say an MMLU answer key is wrong, experts found an error 1 time in 3
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
MV2 (Munim, Inc.)
Follow
Nov 6
When two independent model panels both say an MMLU answer key is wrong, experts found an error 1 time in 3
#
machinelearning
#
datascience
#
nlp
#
benchmarks
Comments
Add Comment
3 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account