In-Context Learning — Technology Wiki

Overview

Direct Answer

In-context learning is the ability of large language models to adapt behaviour and perform new tasks by conditioning on examples or instructions embedded directly in the input prompt, without modifying the model's underlying parameters. This represents a fundamental departure from traditional machine learning approaches that require retraining or fine-tuning.

How It Works

When relevant examples, instructions, or few-shot demonstrations are provided at the beginning of a prompt, transformer-based models leverage their attention mechanisms to recognise patterns and apply implicit learning directly during inference. The model's internal representations shift to accommodate the new task context, with later token predictions influenced by earlier contextual information through learned attention weights.

Why It Matters

This capability dramatically reduces deployment friction and cost by eliminating the need for task-specific fine-tuning cycles, which require labelled data, computational resources, and model versioning overhead. Organisations can iterate rapidly on use cases, adapt to domain shifts, and deploy generalised models across diverse applications without retraining.

Common Applications

Practical applications include zero-shot and few-shot classification in customer support (routing queries by providing category examples), legal document analysis where domain-specific terminology is demonstrated in-prompt, and cross-lingual translation tasks where bilingual examples guide behaviour. Content moderation systems and domain-specific question-answering similarly rely on contextual demonstration.

Key Considerations

Performance remains sensitive to example selection, ordering, and prompt formulation; there is no guarantee of task mastery regardless of in-prompt guidance. Context window length constraints and potential brittleness with complex reasoning tasks necessitate careful validation before production deployment.

Referenced By2 terms mention In-Context Learning

Other entries in the wiki whose definition references In-Context Learning — useful for understanding how this concept connects across Artificial Intelligence and adjacent domains.

Emergent Capabilities·Artificial Intelligence Few-Shot Learning·Artificial Intelligence

Related in Prompting & Interaction

Prompt Engineering

The practice of designing and optimising input prompts to elicit desired outputs from large language models.

Few-Shot Prompting

A technique where a language model is given a small number of examples within the prompt to guide its response pattern.

Zero-Shot Prompting

Querying a language model to perform a task it was not explicitly trained on, without providing any examples in the prompt.

Chain-of-Thought Prompting

A prompting technique that encourages language models to break down reasoning into intermediate steps before providing an answer.

Few-Shot Learning

A machine learning approach where models learn to perform tasks from only a small number of labelled examples, often achieved through in-context learning in large language models.

Zero-Shot Learning

The ability of AI models to perform tasks they were not explicitly trained on, using generalised knowledge and instruction-following capabilities.

Emergent Capabilities

Abilities that appear in large language models at certain scale thresholds that were not present in smaller versions, such as in-context learning and complex reasoning.

Tool Use in AI

The capability of AI agents to invoke external tools, APIs, databases, and software applications to accomplish tasks beyond the model's intrinsic knowledge and abilities.

System Prompt

An initial instruction set provided to a language model that defines its persona, constraints, output format, and behavioural guidelines for a given session or application.

More in Artificial Intelligence

Artificial Intelligence

Foundations & Theory

The simulation of human intelligence processes by computer systems, including learning, reasoning, and self-correction.

AI Governance

Safety & Governance

The frameworks, policies, and regulations that guide the responsible development and deployment of AI technologies.

Direct Preference Optimisation

Training & Inference

A simplified alternative to RLHF that directly optimises language model policies using preference data without requiring a separate reward model.

TinyML

Evaluation & Metrics

Machine learning techniques optimised to run on microcontrollers and extremely resource-constrained embedded devices.

Forward Chaining

Reasoning & Planning

An inference strategy that starts with known facts and applies rules to derive new conclusions until a goal is reached.

Synthetic Data Generation

Infrastructure & Operations

The creation of artificially produced datasets that mimic the statistical properties of real-world data, used for training AI models while preserving privacy.

Knowledge Graph

Infrastructure & Operations

A structured representation of real-world entities and the relationships between them, used by AI for reasoning and inference.

AI Bias

Training & Inference

Systematic errors in AI outputs that arise from biased training data, flawed assumptions, or prejudicial algorithm design.