One TLS handshake predicts the whole anti-bot stack
When I size up a new website I used to start with headers. Copy them out of DevTools, match the...
Sep 7, 20264 min read0 reactions0 comments
Back to articles Sep 7, 2026 
May 27, 2026
Tag archive
#zyte
G
Sep 11, 2026Give an AI Agent a Browser: From Instructions to Actions
Most browser automation examples start with selectors. Find the button, identify the input, write the...
Sep 11, 20266 min read0 reactions1 comments
T
May 31, 2026The compiler caught a lot. It didn't catch enough.
I built a small web scraping framework in Rust, mostly with an AI doing the typing. It's called...
May 31, 20268 min read0 reactions0 comments
H
May 31, 2026How to Store What You Scrape (Without Making a Mess)
The default for a first scraper is usually printing to stdout or dumping everything into a JSON...
May 31, 20265 min read0 reactions0 comments
W
May 31, 2026Why Your Scraper Works in the Browser But Fails in Python
When a requests.get() call returns a 403, or a 200 with an "Access Denied" body, the first instinct...
May 31, 20267 min read0 reactions0 comments
H
May 31, 2026How to Handle JavaScript-Rendered Pages Without a Full Browser
The HTML that requests downloads is what the server sends before any JavaScript runs. For a large and...
May 31, 20265 min read0 reactions0 comments
S
May 31, 2026Scraping Paginated Sites Without Getting It Wrong
Pagination is where a lot of scrapers quietly go wrong — not with errors, but with missing data. A...
May 31, 20266 min read0 reactions0 comments
Building a self-hosted browser scraping service (is it more hassle than its worth?)
There is a version of this project that is not worth doing. If you need browser rendering for a...
May 27, 20268 min read0 reactions0 comments
W
May 11, 2026What to do when websites change and your spider doesn't know
Empty-field-rate monitoring catches selectors that return nothing. It does not catch selectors that...
May 11, 20266 min read1 reactions0 comments
W
May 31, 2026Why Your Scraper Breaks Without Warning (And How to Fix It)
Most scraper failures don't raise exceptions. The spider finishes, the pipeline writes a file, the...
May 31, 20266 min read0 reactions0 comments
H
May 11, 2026How to tell if a page uses JavaScript rendering (and what to do about it)
You write a scraper, test your selectors in the browser, and everything looks right. Then you run...
May 11, 202611 min read0 reactions0 comments
H
Mar 11, 2026How I get Claude to build HTML parsing code the way I want it
Getting HTML off a page is only the first step. Once you have it, the real work begins: pulling out...
Mar 11, 20264 min read4 reactions0 comments