Model record
Llama 3.2 3B
Meta · Llama 3.2 Community License · verified
What this model is
The architecture is dense. Every parameter is part of the active path, so memory and speed scale with the full model rather than a smaller expert subset.
Memory and quantization
Decimal GB, rounded from the Ollama tag page. Runtime memory still needs KV cache and overhead.
| Quantization | Published files | 8K estimate | Smallest comfortable GPU | Smallest comfortable Mac | Context at smallest GPU / Mac | Speed estimate | Run commands |
|---|---|---|---|---|---|---|---|
| Q4_K_M | 2.00 GB | 4.44 GB | NVIDIA GeForce RTX 3060 12GB · 12 GB VRAM | Apple Mac mini M4 16GB · 16 GB unified memory | 74,116 / 108,994 tokens | Estimate · Fast relative class | ollama run llama3.2:3b-instruct-q4_K_M lms get "Llama 3.2 3B"@q4_k_m |
| Q8_0 | 3.40 GB | 5.84 GB | NVIDIA GeForce RTX 3060 12GB · 12 GB VRAM | Apple Mac mini M4 16GB · 16 GB unified memory | 61,908 / 96,786 tokens | Estimate · Fast relative class | ollama run llama3.2:3b-instruct-q8_0 lms get "Llama 3.2 3B"@q8_0 |
Estimate formula: published weight files + 0.9395 GB per 8K tokens × context / 8K + 1.5 GB runtime overhead. Sizes are decimal GB, not GiB. At 8K context, the smallest listed build is about 4.4 GB before OS and application reserve.
Conservative FP16 estimate from the standard Llama 3.2 GQA configuration; not a runtime measurement.
Ollama tags were checked against the linked Ollama library pages on 2026-11-02. LM Studio's lms get suffix selects a file when the search results expose that exact quantization; confirm the local key with lms ls.
KV method source: https://ollama.com/library/llama3.2
Speed heuristic
Speed varies substantially between CPU and GPU; no single measured value is reported
Active path: 3.2B parameters. This is a relative speed signal only; it is not a tokens/sec benchmark.
Runtimes
- Ollama
- llama.cpp
ollama run llama3.2:3blms get "Llama 3.2 3B"@q4_k_m
lms load <model-key-from-lms-ls> --gpu max --context-length 8192License restrictions
Llama 3.2 Community License and acceptable-use policy apply. Commercial deployments above the license's monthly-active-user threshold need a separate license.
This is a plain-language summary, not legal advice. Read the linked license before commercial deployment or redistribution.
Known issues
- Limited capability on complex reasoning tasks
FAQ
Model-specific questions
What is the smallest local file for Llama 3.2 3B?
The smallest published weight package in this record is Q4_K_M at 2.00 GB. The 8K runtime estimate adds 0.94 GB of KV cache and 1.5 GB overhead, for about 4.4 GB before operating-system reserve.
How much memory do the published quantizations need at 8K?
Q4_K_M about 4.4 GB at 8K; Q8_0 about 5.8 GB at 8K. These are calculated estimates using the published weight sizes and the model's KV-cache assumption, not live memory measurements.
Which GPU and Mac configurations are comfortable for Llama 3.2 3B?
Against the current catalog, the smallest configurations that clear the 20% headroom target are: Q4_K_M: NVIDIA GeForce RTX 3060 12GB; Q8_0: NVIDIA GeForce RTX 3060 12GB. A larger configuration may still be preferable for longer context or faster memory bandwidth.
What is the right Ollama or LM Studio command for Llama 3.2 3B?
Use the command attached to the specific quantization in the table. Ollama tags are taken from the checked Ollama library pages. For LM Studio, use lms get with the displayed quantization suffix, then load the resulting local key from lms ls with --gpu max and the desired context length.
What should I run instead if Llama 3.2 3B does not fit?
This is already one of the smaller records in the catalog. Reduce context, choose the lowest published quantization, or compare the entry in the VRAM tier guides before moving to a larger machine.
Sources
This page is an independent compatibility guide, not official documentation. Verify the primary source before downloading or deploying a model.