glossary

The Local LLM Glossary: Every Term, Flag, and Number in Plain English

Plain-English definitions for every term you hit in local LLM posts: prefill and decode, tokens per second, FP8 and NVFP4, Q4_K_M, KV cache, YaRN, Gated DeltaNet, speculative decoding, and every vLLM, llama.cpp, and Ollama flag worth knowing.

Saiyam Pathak · 19 min

Read →