Tech News
← Home  ·  All topics

Model Quantization

1 GoKawiil brief on this topic

Tom's Hardware publishes glossary explaining LLM terms like weights, KV cache and quantization

Tom's Hardware has released an explainer breaking down core terminology behind large language models, covering concepts such as models, tokens, weights, KV cache, quantization and inference. The guide is aimed at readers following the growth of local AI hardware, such as Nvidia's RTX Spark, and is intended to support the publication's ongoing AI coverage.