Transformer — Transformer architecture

Fact

A deep learning design that uses attention to understand sequences.

In Plain Words

A Transformer is the kid at a loud lunch table. It hears “pass the ketchup” and knows the fries are involved.

It helps AI connect words in context and write text. Many LLMs and foundation models use it as their main engine.

Related Concepts

• Attention Mechanism
• Large Language Model
• Neural Network
• Foundation Model

Attention
Attention helps Transformer catch links across the context.

LLM
Transformer helped modern LLMs make a big jump in skill.

Neural-network
Transformer is a Neural-network design built for sequence tasks.

Foundation-model
Many Foundation-models use Transformer as their general design.