Back to articles

Tag archive

#onnx

T
Jun 11, 2026

The architecture of an in-product RAG chatbot: from your prompt to the answer

A closed-source codebase chatbot that cites real source files: hybrid BM25 + bge-m3 retrieval, a LoRA-fine-tuned cross-encoder, Claude for synthesis — and a serving stack that moved off Python onto native .NET/ONNX. This post follows a single prompt end-to-end, from the moment you hit send to the cited answer, and explains the architectural choices behind each step.

Jun 11, 20269 min read0 reactions0 comments