AI Rookies

Local-LLM — Local Large Language Model

Fact

A large language model running on your own device or private server.

In Plain Words

A Local LLM is AI living in your spare room. It keeps secrets well, but it may hog the power bill.

It helps with offline work and private files. It can answer fast, but hardware sets the limit.

Related Concepts

Open-source-model
Open-source models give Local LLMs something to download and run.

LLM
A Local LLM is an LLM running on a device or private server.

GPU
The GPU affects how large and fast a Local LLM can be.

Data-privacy
Data privacy is a key reason people choose a Local LLM.