R
Nov 27, 2025Run Big LLMs on Small GPUs: A Hands-On Guide to 4-bit Quantization and QLoRA
Save the planet and adapt the LLM to your use-case! Introduction The process of...
Nov 27, 202513 min read1 reactions0 comments
Back to articles
Tag archive
#fp4
S
Nov 21, 2025Shrinking Giants: A Word on Floating-Point Precision in LLM Domain for Faster, Cheaper Models
Ever wondered how floating-point decision can have an impact on LLM’s output? 🔢 What is...
Nov 21, 20258 min read1 reactions2 comments