大模型基础
What is Grouped-Query Attention (GQA), and how does it differ from Multi-Head Attention (MHA)?
原题How does Sliding Window Attention work?
原题How do Attention Sinks work?
原题How does Rotary Position Embedding (RoPE) work, and why is it preferred over learned positional embeddings?
原题Explain Layer Normalization
原题Explain RMSNorm (Root Mean Square Layer Normalization)
原题Why do modern Transformers use Pre-LayerNorm (Pre-Norm) instead of Post-LayerNorm?
原题What are scaling laws (Chinchilla), and how do they guide model size vs training data decisions?
原题Your LLM keeps ignoring your instructions. How do you make it follow structured output formats?
原题Your LLM-powered tool hits the context window limit on long documents. How do you handle it?
原题
暂无题目