Shopify’s Continual Learning Loop with PyTorch and vLLM – Cody Mazza-Anthony – PyTorchCon NA Keynote

Video by PyTorch Foundation via YouTube
Shopify's Continual Learning Loop with PyTorch and vLLM - Cody Mazza-Anthony - PyTorchCon NA Keynote

PyTorch Conference North America Keynote: Shopify’s Continual Learning Loop with PyTorch and vLLM – Cody Mazza-Anthony

The flywheel turns Shopify’s product expertise into robust evaluations, then mines, critiques, and repairs low-scoring conversations to train better models. Using Buyer Profile as a case study, we show how small models can outperform frontier models on well-scoped tasks at a fraction of the cost, with lower latency and higher throughput.

Source