vLLM Office Hours - Advanced Techniques for Maximizing vLLM Performance - September 19, 2024

vLLM Office Hours - Using NVIDIA CUTLASS for High-Performance Inference - September 05, 2024

vLLM Office Hours - vLLM on AMD GPUs and Google TPUs - August 21, 2024

vLLM Office Hours - Multimodal Models in vLLM with Roblox - August 8, 2024

vLLM Office Hours - Model Quantization for Efficient vLLM Inference - July 25, 2024

Deploy LLMs More Efficiently with vLLM and Neural Magic

vLLM Office Hours - FP8 Quantization Deep Dive - July 9, 2024

vLLM Office Hours - June 20, 2024

vLLM and Neural Magic Office Hours - June 5, 2024

Are MLOps disappearing?

5x Faster YOLOv8 on CPUs

Deploy Fast and Accurate YOLOv8 Object Detection Models on CPUs You Already Have

Unlock Faster and More Efficient LLMs with SparseGPT

Pruning and Quantizing ML Models With One Shot Without Retraining

Sparse Transferring Hugging Face Models With SparseML

Apply Second-Order Pruning Algorithms for SOTA Model Compression

Use Sparse Transfer Learning to Create Sparse Models Fine-Tuned to Your Datasets

Intro to SparseML

Accelerate Image Segmentation Tasks With Sparsity and the DeepSparse Runtime

Accelerate Image Classification Tasks With Sparsity and the DeepSparse Runtime

Accelerate Object Detection Tasks With Sparsity and the DeepSparse Runtime

Intro to DeepSparse Runtime

Intro to Deep Learning Model Sparsification

Intro to SparseZoo

Intro to Neural Magic & Software-Delivered AI

Accelerate NLP Tasks With Sparsity and the DeepSparse Runtime

Sparse Training of Neural Networks Using AC/DC

How Well Do Sparse Models Transfer?

How to Achieve the Fastest CPU Inference Performance for Object Detection YOLO Models

Workshop: How to Optimize Deep Learning Models for Production