模型与应用评测

题集来源:AMIT SHEKHAR(amitshekhariitbhu)收录项目:ai-engineering-interview-questions查看原题集

题目目录

36 道原题
  1. What is red teaming, and how do you red team an LLM application?

    原题
  2. How do you detect and measure hallucinations in LLM outputs?

    原题
  3. What is adversarial testing for AI systems?

    原题
  4. How do you build a regression test suite for AI applications?

    原题
  5. What are benchmark suites (MMLU, HumanEval, GSM8K), and how do you interpret them?

    原题
  6. What is benchmark contamination, and how do you guard against it?

    原题
  7. Your new model version scores higher on every benchmark, but users say it got worse. Why does this happen, and how do you find the problem?

    原题
  8. How do you evaluate a RAG system end-to-end?

    原题
  9. How do you evaluate the quality of AI agents?

    原题
  10. How would you evaluate an autonomous coding agent? Why can SWE-bench pass rates be misleading?

    原题