W
May 4, 2026Why We Switched from OpenVINO 2024.3 to LangChain 0.2 for quantization
In Q3 2024, our inference pipeline’s p99 latency hit 2.1 seconds for 7B parameter LLMs quantized to...
May 4, 202613 min read0 reactions0 comments
Back to articles
Tag archive
#20243
T
May 3, 2026The setup Guide to RAG with OpenVINO 2024.3 and ONNX Runtime 1.18
RAG pipelines built with OpenVINO 2024.3 and ONNX Runtime 1.18 deliver 42% lower p99 latency and 37%...
May 3, 202614 min read0 reactions0 comments