O
Apr 11, 2026ONNX INT8 vs FP16: 3x Latency Drop on Jetson Orin Nano
Switching from FP16 to INT8 cut our object detection pipeline from 47ms to 15ms per frame on...
Apr 11, 20261 min read0 reactions0 comments
Back to articles
Tag archive
#int8
I
Apr 3, 2026INT8 vs FP16 Inference: TCO Cut 54% for 7B Models on AWS
The $8,400/month Cloud Bill That Started This A client was running a 7B parameter LLM on...
Apr 3, 20261 min read0 reactions0 comments