Zyte MCP: Powerful web data gathering for your agent
AI agents are increasingly where engineers plan, write and debug. But their work can often be...
Oct 1, 20265 min read1 reactions0 comments
Back to articles Oct 1, 2026 
Sep 7, 2026
May 27, 2026
Tag archive
#zyte
One TLS handshake predicts the whole anti-bot stack
When I size up a new website I used to start with headers. Copy them out of DevTools, match the...
Sep 7, 20264 min read0 reactions0 comments
G
Sep 11, 2026Give an AI Agent a Browser: From Instructions to Actions
Most browser automation examples start with selectors. Find the button, identify the input, write the...
Sep 11, 20266 min read0 reactions1 comments
T
May 31, 2026The compiler caught a lot. It didn't catch enough.
I built a small web scraping framework in Rust, mostly with an AI doing the typing. It's called...
May 31, 20268 min read0 reactions0 comments
W
May 31, 2026Why Your Scraper Works in the Browser But Fails in Python
When a requests.get() call returns a 403, or a 200 with an "Access Denied" body, the first instinct...
May 31, 20267 min read0 reactions0 comments
H
May 31, 2026How to Handle JavaScript-Rendered Pages Without a Full Browser
The HTML that requests downloads is what the server sends before any JavaScript runs. For a large and...
May 31, 20265 min read0 reactions0 comments
H
May 31, 2026How to Store What You Scrape (Without Making a Mess)
The default for a first scraper is usually printing to stdout or dumping everything into a JSON...
May 31, 20265 min read0 reactions0 comments
S
May 31, 2026Scraping Paginated Sites Without Getting It Wrong
Pagination is where a lot of scrapers quietly go wrong — not with errors, but with missing data. A...
May 31, 20266 min read0 reactions0 comments
Building a self-hosted browser scraping service (is it more hassle than its worth?)
There is a version of this project that is not worth doing. If you need browser rendering for a...
May 27, 20268 min read0 reactions0 comments
W
May 11, 2026What to do when websites change and your spider doesn't know
Empty-field-rate monitoring catches selectors that return nothing. It does not catch selectors that...
May 11, 20266 min read1 reactions0 comments
W
May 31, 2026Why Your Scraper Breaks Without Warning (And How to Fix It)
Most scraper failures don't raise exceptions. The spider finishes, the pipeline writes a file, the...
May 31, 20266 min read0 reactions0 comments
H
May 11, 2026How to tell if a page uses JavaScript rendering (and what to do about it)
You write a scraper, test your selectors in the browser, and everything looks right. Then you run...
May 11, 202611 min read0 reactions0 comments