AI 基础设施
How do you improve inference speed in production LLM deployments?
原题LLM optimization techniques
原题How do you select GPUs for LLM inference?
原题How does a GPU work for Deep Learning?
原题How do CUDA Kernels work?
原题How does a Google TPU work?
原题How does an LPU work?
原题Estimate the GPU memory needed to serve a 70B model (weights, KV cache, activations). Does it fit on a single 80 GB GPU?
原题Do the roofline math: how many tokens/sec can one H100 produce for a 70B model at batch size 1?
原题What is model parallelism vs data parallelism in distributed training?
原题
暂无题目