Context Window LLM

• Tokens: Byte Pair Encoding (BPE) — ~0.75 слова per token в English, 0.5 в русском
• Context budget: input + output ≤ window. При output = 4k, input max = (window - 4k)
• Pricing: per-token. 1M context × $3 per 1M = $3 за вызов
• Lost in the middle: LLMs хуже помнят middle of long context (2023 Stanford research)
• Caching: Anthropic prompt cache, OpenAI automatic cache — reduce cost для repeat context

# Claude 1M context in Claude Agent SDK
from anthropic import Anthropic
client = Anthropic()

# Full codebase в context
with open('codebase.txt') as f:
  codebase = f.read()  # 500k tokens

response = client.messages.create(
  model='claude-opus-4-7[1m]',  # 1M context variant
  max_tokens=4096,
  system='You review code.',
  messages=[{'role':'user','content':f'Review:
{codebase}'}]
)

• LLM
• Transformer
• RAG