Back to articles

Tag archive

#data

Y
Nov 14, 2026

Your scraper will not throw an error: designing page extraction that fails loudly, one field at a time

A scraper's dangerous failure is not the exception; it is the plausible wrong number. Anchor ladders per field (typed data, identity by meaning, label adjacency, normalised text), a recorded tier per field, nulls that carry a reason instead of a default zero, per-field hashes for change detection, key cursors for lists that are being written while you read them, 403/429 handled as state rather than as a reason to retry harder, and a fixture per incident.

Nov 14, 202613 min read0 reactions0 comments