#llmevaluation

Six stages, real C# code, and the one number that convinced me this wasn’t busywork Here’s...

Your .NET Agent Is in Production, Your Engineering Discipline Isn’t. So I Went and Built the...

Evaluating LLM applications is the rigorous engineering discipline of quantitatively measuring,...

Originally published on andrew.ooo — visit the original for any updates, code snippets that aged...

A free AI model is stable enough to use when the same prompt, repeated ten times, produces a clear...

GPT-6 Astra scored 62.7% and 99.9% on ARC-AGI-3 with the same weights. The harness made the difference, and that should change how you evaluate your o

A 20-episode lab test: giving an AI agent a live view of its own token budget raised cost 29-72% and cut accuracy on one of two models.

VIDRAFT가 117개 항목의 AI 안전성 진단 프레임워크 AX-RAY를 Hugging Face에 공개했습니다. LLM의 숨겨진 인과 단서에 의한 'Causal Leakage' 탐지 및 오픈 리더보드를 확인하세요.

Evaluating an AI agent involves looking beyond individual outputs and understanding how effectively...

A five-agent SDLC pipeline sounds out of reach on a Sri Lankan budget. The two ideas underneath it — spec enrichment and Cohen's kappa — cost almost nothing.

A team I compared notes with recently runs continuous evals on production traffic: an LLM judge...

비드래프트(VIDRAFT)가 117개 항목의 AI 안전 진단 프레임워크 AX-RAY를 허깅페이스에 오픈소스 공개. 인과적 누출 탐지와 글로벌 법규 연계 평가를 지원하는 LLM 안전성 평가 도구.