模型微调与适配
Why did DPO displace PPO-based RLHF at many labs? When is online RL still better?
原题What is instruction tuning, and why is it important for chat models?
原题How do you prepare a dataset for fine-tuning an LLM?
原题What is catastrophic forgetting, and how do you prevent it during fine-tuning?
原题When should you choose fine-tuning over RAG over prompt engineering?
原题How do you evaluate a fine-tuned model's performance?
原题What is synthetic data generation, and how do you use it for fine-tuning?
原题What are the key hyperparameters for fine-tuning (learning rate, epochs, batch size, LoRA rank)?
原题Do the GPU memory math for full fine-tuning a 7B model in bf16 with Adam. Now with LoRA and QLoRA.
原题How do you fine-tune a model for a specific domain (legal, medical, finance)?
原题
暂无题目