大模型基础
What is the difference between encoder-only, decoder-only, and encoder-decoder Transformer architectures?
原题What is KV cache, and how does it speed up inference?
原题Estimate the KV cache memory needed to serve a large model. How does it constrain batch size and context length?
原题KV Cache Compression
原题What is model distillation, and how is it used with LLMs?
原题What is Mixture of Experts (MoE), and how does it work in models like Mixtral?
原题What is the difference between dense and sparse models?
原题How does DeepSeek-V4 work?
原题What is Flash Attention?
原题What is Cross-Entropy Loss?
原题
暂无题目