大模型基础

题集来源:AMIT SHEKHAR(amitshekhariitbhu)收录项目:ai-engineering-interview-questions查看原题集

题目目录

80 道原题
  1. Why is the context window limited in LLMs?

    原题
  2. What is temperature in the context of LLMs, and how does it affect output?

    原题
  3. Why is the first token slower than the rest in an LLM?

    原题
  4. Explain Top-p (nucleus) sampling and Top-k sampling. How do they differ?

    原题
  5. Compare greedy decoding, beam search, top-k, top-p, and temperature sampling. When does each fail?

    原题
  6. What are logits, and how are they used in text generation?

    原题
  7. What are stop tokens in LLMs, and how does an LLM know when to stop generating?

    原题
  8. What is the difference between a stop token and a stop sequence?

    原题
  9. What are skip connections (residual connections) in Transformers?

    原题
  10. What is the difference between open-source and closed-source LLMs? When would you choose one over the other?

    原题