LLM Application Requirements: A Production Checklist
Most LLM apps fail in production because nobody defined what "working" meant, not because the model is bad. I lay out the checklist I use, covering
Tag archive
Most LLM apps fail in production because nobody defined what "working" meant, not because the model is bad. I lay out the checklist I use, covering
Most "AI consultants" ship demos, not systems that survive a 3 a.m. incident with retries, evals, cost caps, and observability. I help founders and teams
I killed an autonomous agent after six weeks and replaced it with a state machine calling an LLM at four steps, quality rose, cost dropped 70%, and the 3
Proximity is usually the wrong first filter for AI automation work, most of it lives in APIs, cloud consoles, and dashboards that don't get faster because
Hiring an AI implementation consultant means finding someone who owns the full stack, evals, numbers, and handover, not a prototyper who ships demos
Most of my AI integration work is data plumbing, not prompting: I map where data actually lives, find the ugliest system (usually the real source of
I've refined a five-phase AI implementation process, scoping, POC, integration, evaluation, operations, where each phase has a hard exit criterion that
I design multi-agent workflows daily and the pattern that survives production is: write the workflow as a deterministic pipeline first, then let an LLM
I build unattended systems that replace recurring manual work—mapping the real process, automating deterministic parts with code and judgment calls with
I build unattended systems on four properties in order—scheduling, idempotency, observability, and graceful failure—starting with boring scaffolding