An open-weight MoE model with 501 billion parameters and 23 billion active per token.
Beam is like an orchestra with 501 billion players. For each song, only 23 billion pick up their instruments.
This uses less computer power for each word. It is built for coding and Agent jobs.
MoE
Beam uses MoE, so only some parameters work at once.
Open weights
Beam plans to release its weights for developers to download and run.
Agent
Beam is built for Agent jobs with planning and action.