模型微调与适配
What is fine-tuning, and when should you fine-tune an LLM?
原题Explain the difference between full fine-tuning and parameter-efficient fine-tuning (PEFT).
原题What is LoRA (Low-Rank Adaptation), and how does it work?
原题What is QLoRA, and how does it enable fine-tuning on consumer hardware?
原题How does fine-tuning work?
原题Explain Prefix Tuning and Prompt Tuning. How are they different from LoRA?
原题What is adapter-based fine-tuning?
原题Explain the difference between pre-training, supervised fine-tuning (SFT), and preference optimization (RLHF/DPO).
原题What is RLHF (Reinforcement Learning from Human Feedback), and how is it used to align LLMs?
原题What is Deep RL from Human Preferences, the paper that started RLHF?
原题
暂无题目