AI 基础设施
How do you optimize inference for edge and mobile deployment?
原题What is model quantization (INT8, INT4, FP16, BF16), and how does it affect quality?
原题How do you implement auto-scaling for AI workloads?
原题What is the role of load balancing in AI serving infrastructure?
原题How do you manage GPU memory for serving multiple models?
原题What is model sharding, and when would you use it?
原题How do you implement request queuing and priority scheduling for AI services?
原题What are the cost trade-offs between self-hosted and API-based AI inference?
原题How do you handle cold start latency for serverless AI deployments?
原题How do you implement model caching to reduce redundant computations?
原题
暂无题目