Lost in the Middle refers to a phenomenon where relevant information located in the middle of a long context is less likely to be used by a model than information located near the beginning or the end.
- Role: Explains how the placement of important information in long text can affect AI response quality
- Positioning in GEO strategy: Foundational knowledge for avoiding burying important definitions, strengths, and evidence in the middle of a page
- Important note: Whether and how strongly it occurs depends on the model, task, and context length
- Basic countermeasure: Place important information at the beginning and, when appropriate, repeat it near the end
In GEO strategy, avoiding placing important information only in the middle of the body text is part of optimizing information transmission to AI.
What You Will Learn From This Page
- The meaning and definition of Lost in the Middle
- Background and mechanism of the phenomenon
- Why it matters in GEO strategy
- Specific countermeasures
- Common misconceptions
What Is Lost in the Middle?
Lost in the Middle refers to a phenomenon where, when an LLM processes long text, relevant information placed in the middle of the text is less likely to be used than information placed at the beginning or end.
This phenomenon became widely known through the paper “Lost in the Middle: How Language Models Use Long Contexts,” published on arXiv in 2023 and later in TACL in 2024.
Even for models that support long context windows, performance has been reported to vary depending on the position of relevant information. However, it does not occur in the same way for every model or every task; the impact varies depending on context length, question type, and information type.
Background and Mechanism
Lost in the Middle is related to how LLMs use information within long contexts. In general, information near the beginning or end of a long input may be easier to use, while information near the middle may be less likely to be used.
Position in long text and tendency of information use
| Position |
Tendency |
| Beginning |
Definitions, conclusions, and premises are easier to capture |
| Middle |
Relevant information may be buried and become less likely to be used |
| End |
Summaries and conclusions are easier to capture |
For this reason, placing important definitions, company strengths, performance figures, and differentiators only in the middle of the body text may make it harder for AI to pick them up sufficiently.
Positioning in GEO Strategy
In GEO strategy, it is important to make it easy for AI to correctly understand and reference company or service information in the right context. Understanding Lost in the Middle helps design where important information should be placed.
Situations Where Important Information Is Easily Buried
- Company features or strengths are placed only in the middle of the body text.
- Brand definitions or identity statements are placed in the middle of an article.
- Specific figures or achievements appear only halfway through the page.
- Comparison tables or FAQ contain important information but are buried within the page structure.
What Lost in the Middle May Cause
- AI may fail to pick up company features sufficiently.
- Strengths or differentiators may be less likely to appear in AI responses.
- AI may not mention the company sufficiently in its answers.
- Even when information exists, responses may lean toward general statements.
Specific Countermeasures
To prevent Lost in the Middle, important information needs to be placed appropriately. In particular, placing definitions and conclusions at the beginning is effective.
Countermeasures for Lost in the Middle
| Countermeasure |
Description |
| BLUF (Bottom Line Up Front) |
Place the conclusion, definition, or key message at the beginning |
| State the conclusion first |
Make important information explicit in the first few sentences |
| Include key information in FAQ |
Include definitions and differentiators in important questions and answers |
| Repeat key information near the end |
Restate key definitions or strengths in the summary or conclusion |
| Use the middle for supporting information |
Place background, details, and supplementary explanations in the middle |
Concrete Example
Weak Placement
(Introduction)
(Background explanation)
(Company strengths: GEO visibility, AI answer citation analysis, competitor comparison) ← Only in the middle
(Detailed explanation)
(Summary)
In this placement, the company's strengths appear only in the middle, so AI may not pick up the information sufficiently.
Better Placement Using BLUF
(Conclusion: [company name] provides GEO visibility, AI answer citation analysis, and competitor comparison) ← Beginning
(Company strengths: GEO visibility, AI answer citation analysis, competitor comparison) ← Restated
(Background explanation)
(Detailed explanation)
(Summary: [company name] supports GEO visibility and improvement) ← End
In this placement, important information appears at the beginning and end, making it easier for AI and users to understand the page's key points.
Parent Concepts, Subconcepts, and Related Terms
Lost in the Middle is a concept related to LLM long-context processing and information placement. In GEO strategy, it becomes foundational knowledge for content design.
Parent Concepts
Related Terms
- BLUF (Bottom Line Up Front): A writing method that places the conclusion at the beginning and is useful for addressing Lost in the Middle.
- Prompt engineering: Placement of important information also matters when designing instructions for AI.
- Chunk: A unit of divided long text. Which chunk contains important information can affect retrieval and use.
- RAG: In retrieved context, where important information appears may affect answer quality.
Common Misconceptions
The following three misconceptions about Lost in the Middle are frequently observed.
Misconception 1: “In long text, it does not matter where information is written.”
In long text, information placed only in the middle may be less likely to be used. Important information should be made explicit at the beginning and, when appropriate, restated near the end.
Misconception 2: “LLMs can process long text accurately, so there is no issue.”
Even LLMs that support long context windows have been reported to show performance differences depending on the position of relevant information. Being able to handle long text is not the same as using every part of that text with equal accuracy.
Misconception 3: “Writing important information once is enough.”
Important information becomes easier for both AI and users to grasp when it is stated at the beginning and restated near the end when appropriate. For long pages, restating key points is useful.
FAQ
- Q: How long does text need to be for Lost in the Middle to occur?
- A: It is considered more likely to occur in longer contexts, but whether and how strongly it occurs depends on the model, task, and context length. It does not occur at a fixed token count for every case.
- Q: How can Lost in the Middle be prevented in GEO strategy?
- A: Use the BLUF principle and place important definitions, strengths, and achievements at the beginning. Restating key information near the end also helps both AI and users grasp the main points.
- Q: Should FAQ always be placed at the beginning?
- A: Not necessarily. However, including important definitions, strengths, and comparative differences in FAQ may make key points easier for AI to understand.
- Q: How often should important information be repeated?
- A: Avoid unnatural repetition. A natural structure is to state key information at the beginning, supplement it in the body, and restate it in the summary or conclusion.
References
-
Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., & Liang, P. (2024). Lost in the Middle: How Language Models Use Long Contexts. Transactions of the Association for Computational Linguistics, 12, 157–173.
-
Google Search Central: Creating helpful, reliable, people-first content
-
OpenAI: Prompt engineering guide