模型与应用评测

题集来源:AMIT SHEKHAR(amitshekhariitbhu)收录项目:ai-engineering-interview-questions查看原题集

题目目录

36 道原题
  1. What is the difference between offline and online evaluation for AI systems?

    原题
  2. How do you measure factual consistency in LLM outputs?

    原题
  3. How do you evaluate multi-turn conversation quality?

    原题
  4. What is the role of golden datasets in AI evaluation?

    原题
  5. How do you build an eval set when there is no labelled ground truth and domain experts are expensive?

    原题
  6. How do you implement continuous evaluation for production AI systems?

    原题
  7. How do you evaluate bias in AI model outputs?

    原题
  8. How do you compare two models or prompts in a statistically rigorous way?

    原题
  9. How do you evaluate the robustness of an LLM application across input variations?

    原题
  10. What are the key differences between evaluating traditional ML vs LLM applications?

    原题