A file format that helps load and run large AI models on your own computer.
GGUF is like giving a giant AI a carry-on bag. It is easier to move and fit on your laptop.
You see it when people share local models. It is common for quantized models you run offline.
Local-LLM
GGUF is one common file format for running large models locally.
Quantization
GGUF often stores quantized models for lighter offline use.
Open weights
Open weight models are often converted to GGUF before sharing.
VRAM
GGUF often works with quantization to help models run with less VRAM.