
Analyzing Dynamic Model Routing and Its Impact on…
Originally published at norvik.tech Introduction Explore dynamic model routing and its...
Sep 21, 20264 min read0 reactions0 comments
Tag archive

Originally published at norvik.tech Introduction Explore dynamic model routing and its...
I run this homelab on two small boxes. One never turns off and just serves DNS and background services; the other has a GPU with a memory pool that can hold exactly one loaded model at a time, nothing more. This post covers the queue and gateway that constraint forced me to build, and the network shape wrapped around both boxes.
For years, the benchmark of a strong network engineer was simple: CLI mastery. If you could move...