W
Jul 19, 2026What Fixed Our Model Latency During a High-Traffic Deploy (Production Case Study)
On 2026-03-14, during a high-traffic deploy of our consumer chat product, the moderation and reply...
Jul 19, 20265 min read0 reactions0 comments
Tag archive
On 2026-03-14, during a high-traffic deploy of our consumer chat product, the moderation and reply...
Many teams ship a capable model into production and watch it degrade under real traffic, unexpected...
The problem is simple: sophisticated AI models promise consistent intelligence, but in real systems...
During a January 2025 refactor of an analytics pipeline that served real-time recommendations, the...
Then vs. Now: a short observation The conversation used to be simple: bigger models meant...
On March 12, 2024, during a migration of a customer-facing search agent for a mid-size fintech, a...