AI Fundamentals

Core concepts and principles of artificial intelligence

A neural network component that allows models to focus on different parts of the input when generating each part of the output.

The maximum amount of text (measured in tokens) that an AI model can process at once.

Numerical representations of text, images, or other data that capture semantic meaning in a high-dimensional space.

The basic unit of text processing in language models, representing parts of words, whole words, or punctuation.