Dependency Parsing

Byte-Pair Encoding

A subword tokenisation algorithm that iteratively merges the most frequent character pairs to build a vocabulary.

Named Entity Recognition

An NLP task that identifies and classifies named entities in text into categories like person, organisation, and location.

Part-of-Speech Tagging

The process of assigning grammatical categories (noun, verb, adjective) to each word in a text.

Coreference Resolution

The task of identifying all expressions in text that refer to the same real-world entity.

Information Extraction

The process of automatically extracting structured information from unstructured or semi-structured text sources.

Relation Extraction

Identifying semantic relationships between entities mentioned in text.

Connecting language model outputs to real-world knowledge, facts, or data sources to improve factual accuracy.

The subfield of NLP concerned with producing natural language text from structured data or representations.

The process of creating a concise and coherent summary of a longer text document while preserving key information.

The capability of language models to accurately interpret and execute natural language instructions, a core skill developed through instruction tuning and alignment training.

Techniques for identifying when AI language models generate plausible but factually incorrect or unsupported content.

AI systems that extract structured information from unstructured documents by combining optical character recognition, layout analysis, and natural language comprehension.

The task of extracting specific parameter values from user utterances to fulfil a detected intent, such as identifying dates, locations, and names in booking requests.

AI systems designed to engage in natural, context-aware dialogue with humans across multiple turns.