Ashraful’s Blog

Back to articles

Tag archive

#deepeval

3 bugs I hit wiring DeepEval into my RAG pipeline (and what each one taught me about RAG evaluation)

#rag #llm #genai #deepeval

3 bugs I hit wiring DeepEval into my RAG pipeline (and what each one taught me about RAG evaluation)

Everyone shows you the happy path of RAG evaluation: import a metric, pass a test case, get a green...

Jul 15, 20266 min read0 reactions1 comments

#deepeval #faithfulness #ragevaluation #evaluationmetrics

Known Pitfall in DeepEval Faithfulness Metric: "idk" Verdicts Don't Penalize the Score

Background While using DeepEval to evaluate a GraphRAG system in a no-reference setting,...

May 22, 20264 min read0 reactions0 comments

Unit Testing LLMs with DeepEval

#llm #ai #unittest #deepeval

Unit Testing LLMs with DeepEval

For the last year I have been working with different LLMs (OpenAI, Claude, Palm, Gemini, etc) and I...

Apr 11, 20245 min read46 reactions4 comments