大模型基础
What are embeddings?
原题Explain the Query(Q), Key(K), and Value(V) in attention.
原题What is self-attention, and how does it work in Transformers?
原题What is Cross Attention in Transformers?
原题Why do we scale the dot product attention by √dₖ in the Transformer architecture?
原题What is causal masking?
原题What are multi-head attention mechanisms? Why use multiple attention heads?
原题What are Feed-Forward Networks in LLMs?
原题What is Generative AI?
原题What is the context window in LLMs, and why does it matter?
原题
暂无题目