Evals - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Royal Simpson Pinto

Nov 10

The Eval Scorers You Actually Need for LLM Apps (and When to Use Each)

#ai #testing #llm #evals

5 min read

InApp

Nov 8

Why an 88.64 leaderboard score needed the catch in the same sentence

#benchmarks #evals #video #ai

1 min read

Konstantin Gredeskoul

Nov 5

Home-made Evals Just Taste Better

#evals #ai #ruby #opensource

8 min read

Shipwright

Nov 9

Catch prompt regressions in CI before your users do

#evals #prompts #ci #claude

3 min read

deavgprime

Nov 7

Can an AI model hide how capable it really is?

#ai #evals #agents #testing

10 min read

Nov 1

LLM Evals Start as Thirty Test Cases, Not a Platform

#ai #llm #evals #typescript

4 min read

Oct 29

"🚫 Your Agent Demo Is Not a Release Gate"

#agents #evals #devops #ci

2 min read

Oct 29

"⛔ Stop Merging Agents Without a Required Check"

#agents #evals #github #devops

2 min read

Oct 29

"🧪 RAG Without CI Metrics Is Just a Chatbot"

#rag #evals #llm #python

2 min read

Oct 30

Testing multi-agent crews: forcing split-brain, goal drift, and context drift to happen in CI

#multiagent #testing #evals #coordination

9 min read

Oct 25

Evals before prompts: a small eval harness for an LLM feature

#ai #llm #evals #testing

9 min read

Oct 25

Pick Your LLM With Your Own Prompt: A Side-by-Side Model Comparison Tool

#ai #evals #chatgpt #claude

7 min read

Oct 17

Jev is not as cheap as you think. Unless it is.

#ai #jev #evals #webdev

6 min read

deavgprime

Nov 4

Did the model fail, or did the environment?

#ai #evals #testing #devops

9 min read

Oct 7

The Safety Check That Runs on the Conversation, Not the Turn

#llm #ai #evals #trustandsafety

2 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.