High Performance Serving Framework for Offline and Real-time Diffusion Models – SGLang-Diffusion
Video by PyTorch via YouTube SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference. As diffusion workloads expand from image and video generation to diffusion-based world models, serving systems must handle very different constraints: maximizing GPU throughput for batch/offline jobs, while maintaining tight end-to-end latency … Read more