---
title: "Transformer Models"
description: "The neural architecture underlying every modern LLM."
topic: "AI Concepts"
canonical: "https://geordy.ai/glossary/ai-concepts/transformer-models"
---
# Transformer Models

The neural architecture underlying every modern LLM.

The reason attention and context windows matter. Transformers process all tokens in parallel using attention; that architectural choice is what makes context windows finite and structure rewarding.
---

Source: https://geordy.ai/glossary/ai-concepts/transformer-models
This is a machine-readable markdown version of that page, generated by Geordy.