---
title: "Attention Mechanism"
description: "The transformer architecture's way of weighting which input tokens matter most."
topic: "AI Concepts"
canonical: "https://geordy.ai/glossary/ai-concepts/attention-mechanism"
---
# Attention Mechanism

The transformer architecture's way of weighting which input tokens matter most.

Why clearly-structured content gets cited more reliably. The attention mechanism amplifies tokens that look definitional, factual, or referential. Headings, lists, and entity-style markup all get higher attention weights than prose buried inside long paragraphs.
---

Source: https://geordy.ai/glossary/ai-concepts/attention-mechanism
This is a machine-readable markdown version of that page, generated by Geordy.