
I Built a Tested Data Pipeline for Dublin Bikes, for €0
How I collect every Dublinbikes station every 15 minutes, model it with dbt and DuckDB, test it daily and feed a live dashboard, using only free tiers.
Tag archive

How I collect every Dublinbikes station every 15 minutes, model it with dbt and DuckDB, test it daily and feed a live dashboard, using only free tiers.
A dashboard feature routed expressions through a DuckDB binary, and DuckDB reads files. How CVE-2024-9264 turns a Viewer account into server-side file access, and what the Grafana process leaves within reach.

Data arrives as files. A vendor drops a CSV in a container, an upstream system exports...
In this series, I encountered a pg_duckdb gotcha with unconstrained numeric column. With...

DuckDB 2.0.0, a long-term support release out October 21, adds a server mode, triggers and VARIANT. Versions before 2.0 cannot read its files.
PostHog moved its managed warehouse to per-organization DuckDB. What the post proves, what it skips, and how a Data Engineer should reason about it.
duckdb DuckDB is a fast, in-process SQL OLAP database system designed for analytical...

Las bases de datos de nuestras aplicaciones son excelentes guardando ventas una por una. Pero cuando...

Azure WAF false positives are painful to tune and expensive to analyse in Log Analytics. lawless-waf queries the archived logs on your laptop with DuckDB and hands you the Terraform exclusion.
The Hidden Goldmine (and Nightmare) of Japan's Open Data Japan’s government ministries...

Serverless DuckDB on Google Cloud, in your own project. Files on GCS, tables in BigQuery (read and write), what I measured, and what I learned.
Building Indonesia's Industrial Data Layer From Power BI Dashboards to Out‑of‑Core Engines and...