大模型基础

题集来源:AMIT SHEKHAR(amitshekhariitbhu)收录项目:ai-engineering-interview-questions查看原题集

题目目录

80 道原题
  1. Your LLM does not admit when it does not know the answer. How do you make it say "I don't know"?

    原题
  2. Your LLM generates responses that are too verbose. How do you control response length?

    原题
  3. Your LLM memorized proprietary training data and leaks it in responses. How do you prevent this?

    原题
  4. Your LLM coding assistant generates outdated code using deprecated libraries. How do you fix it?

    原题
  5. Your tokenizer splits important domain terms into meaningless subword pieces. How do you fix it?

    原题
  6. Your Transformer's KV cache grows too large during long sequence generation. How do you manage memory?

    原题
  7. Your Transformer runs out of memory on long documents due to quadratic self-attention. How do you scale it?

    原题
  8. Your distilled student model fails on the complex reasoning that the teacher model handled. How do you close the gap?

    原题
  9. After RLHF alignment, your LLM became safer but lost capability on hard tasks. How do you manage the alignment tax?

    原题
  10. Your RLHF-trained LLM is gaming the reward model instead of being genuinely helpful. How do you fix reward hacking?

    原题