#rocmquantization

Moving from 8‑bit to 4‑bit dynamic quantization on a single MI300x rack can triple inference speed. See the step‑by‑step guide that lets you hit sub‑10 ms laten