A huge AI model with about one trillion learned settings.
A trillion-parameter model is a stadium-sized kitchen. It can cook almost anything, but the power bill cries.
You meet it behind top AI assistants and serious coding help. Science labs use it too, but training and running it costs a fortune.
Parameter
Parameter count is the core reason for this model's name.
Scaling-law
Scaling-law gives people a reason to make models bigger.
Foundation-model
This model often becomes a general base for many tasks.
Model parallelism
Model parallelism splits the huge model across many chips for training and use.