New course: Efficient Inference with SGLang: Text and Image Generation, built in partnership with LMSys @lmsysorg and RadixArk @radixark, and taught by Richard Chen @richardczl, a Member of Technical Staff at RadixArk.
Running LLMs in production is expensive, and much of that… https://twitter.com/AndrewYNg/status/2042289428702642588/video/1
中文: 新课程:使用SGLang高效推理:文本与图像生成,由LMSys @lmsysorg和RadixArk @radixark合作建立,由RadixArk技术人员理查德·陈@richardczl教授。
生产中运行LLM很昂贵,其中大部分......