C
Aug 19, 2026Compared Quantization Levels: Q4 vs Q8 vs FP16 on llama3.2:1b
Context: A model's weights — the numbers it uses to reason — are normally stored at high precision,...
Aug 19, 20263 min read0 reactions0 comments
Tag archive
Context: A model's weights — the numbers it uses to reason — are normally stored at high precision,...
Context: A system prompt is a set of instructions given to a model before any real conversation...
Context: The number in a model name like 1b or 3b refers to parameters — roughly, the tunable values...
Context: Ollama is a tool for running large language models directly on your own machine, instead of...