Byte-Pair Encoding

Named Entity Recognition

An NLP task that identifies and classifies named entities in text into categories like person, organisation, and location.

Dependency Parsing

The syntactic analysis of a sentence to establish relationships between head words and words that modify them.

Part-of-Speech Tagging

The process of assigning grammatical categories (noun, verb, adjective) to each word in a text.

Coreference Resolution

The task of identifying all expressions in text that refer to the same real-world entity.

Information Extraction

The process of automatically extracting structured information from unstructured or semi-structured text sources.

Relation Extraction

Identifying semantic relationships between entities mentioned in text.

Global Vectors for Word Representation — an unsupervised learning algorithm for obtaining word vector representations from aggregated word co-occurrence statistics.

The subfield of NLP focused on machine reading comprehension and extracting meaning from text.

A text generation strategy that restricts the model to sampling from the K most probable next tokens.

The artificial production of human speech from text, also known as text-to-speech.

A neural network trained on massive text corpora that can generate, understand, and reason about natural language.

The process of producing coherent and contextually relevant text using AI language models.

A database optimised for storing and querying high-dimensional vector embeddings for similarity search.

The maximum amount of text a language model can consider at once when generating a response.