In-Context Learning — In-context Learning

Fact

A way for a model to learn a task from examples in the prompt.

In Plain Words

In-context learning is like seeing two perfect group-chat replies first. You copy the pattern and do not panic-type “lol help.”

You meet it in few-shot prompts and format copying. The model learns on the spot, so you skip retraining.

Related Concepts

• Prompt
• Context Window
• Instruction Tuning

Prompt
In-context learning is usually triggered by instructions and examples in the prompt.

Context-window
In-context learning can only use examples that fit in the context-window.

Instruction Tuning
In-context learning picks up the pattern on the spot. Instruction Tuning practices it ahead of time.