A
Aug 2, 2026Adam vs AdamW: When Weight Decay Actually Matters
The 0.2% Accuracy Drop That Cost Us 3 Days Swapping Adam for AdamW in a ResNet-50 training...
Aug 2, 20261 min read0 reactions0 comments
Back to articles 
Jul 24, 2023
Tag archive
#optimizer
M
Jul 20, 2026Muon Optimizer Boosts Agentic Reinforcement Learning Performance
What Changed The landscape of reinforcement learning (RL) post-training is undergoing a...
Jul 20, 20263 min read0 reactions0 comments
M
Apr 7, 2026MongoDB Query Planner
SQL databases use query planners (often cost-based optimizers) so developers don’t worry about...
Apr 7, 20261 min read0 reactions0 comments
U
Dec 23, 2025Unnesting Scalar Subqueries into Left Outer Joins in SQL in Aurora and PostgreSQL
Relational databases treat your query as a declarative description of the desired result and select...
Dec 23, 20256 min read1 reactions5 comments
M
Mar 13, 2025MongoDB Multi-Planner Optimizer and Plan Cache
Database systems utilize query planners to optimize data retrieval, primarily through two methods:...
Mar 13, 202513 min read12 reactions0 comments
P
Oct 6, 2024PostgreSQL Semi Join, Unique-ify RHS, Materialized CTEs, and Rows Estimation
As a developer, I prefer using a WITH clause and declaring Common Table Expressions (CTE) instead of...
Oct 6, 20249 min read3 reactions0 comments
PostgreSQL Optimizer Hints Discussion
I've explained how to use pg_hint_plan in this blog, and at PostgreSQL conferences. I focused on how...
Jul 24, 20235 min read27 reactions0 comments
T
Nov 30, 2022The best indexes for an execution plan that never gets (too) wrong
With the perfect query planner (aka optimizer) you can provide as many indexes as possible, all join...
Nov 30, 202215 min read2 reactions0 comments
Y
Jul 20, 2022YugabyteDB cardinality estimation in the absence of ANALYZE statistics
TL;DR: there's a summary with keywords in bold at the end YugabyteDB uses PostgreSQL query planner,...
Jul 20, 20229 min read5 reactions0 comments