Quantization Formats For Faster Local AI Video Inference: FP8, MXFP8 & NVFP4 Explained | LTX Blog
Quantization Formats For Faster Local AI Video Inference: FP8, MXFP8 & NVFP4 Explained | LTX Blog
2 weeks ago
ltx.io
What is Quantization? | IBM
What is Quantization? | IBM
Jul 31, 2024
ibm.com
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
19:55
Faster and Lighter Model Inference with ONNX Runtime from Cloud to Client
Aug 3, 2022
Microsoftmarkdefalco
Quantization: What Everyone Gets Wrong (Accuracy Myths)
0:44
Quantization: What Everyone Gets Wrong (Accuracy Myths)
65 views3 weeks ago
YouTubeCode & Capital
Quantization Series | Part 1. Foundations: What is Quantization?
35:50
Quantization Series | Part 1. Foundations: What is Quantization?
5 views2 weeks ago
YouTubeOnchain AI Garage
How to Quantize Your Own Models using Unsloth
1:00
How to Quantize Your Own Models using Unsloth
1 views3 weeks ago
YouTubeBreaking Divide
Bonsai 8B and the 1-bit LLM Moment
13:04
Bonsai 8B and the 1-bit LLM Moment
1 views2 weeks ago
YouTubeFraher AI
0:41
Google magic bullet - TurboQuant #ai #gpu #google #chips #cuda #quantization
1.3K views1 month ago
YouTubeNeural AI Flair
0:56
What is the FP8 Quantization Standard?
2 weeks ago
YouTubeBreaking Divide
2:10
Quantization and Fast Inference for Modern AI
6 days ago
YouTubeManning Publications
1:21
Day 65: Precision Engineering: Quantization (FP16, INT8) and its Impact on Scale #mlops #precision
1 week ago
YouTubeSystemDesign Demo 1
0:16
What is Quantization LLM QUANTIZATION #ai #llm #llms #learning #model #fashion #tech #technology
64 views1 month ago
YouTubeAmit_Chopra_assruc
1:08:05
Tikhomirov M.M. - Training of large language models - 8. Inference, quantization
218 views3 weeks ago
YouTubeteach-in
15:14
Why Inference is hard..
232 views4 weeks ago
YouTubeCaleb Writes Code
7:29
Model Quantization Explained 8 bit, 4 bit & Inference Optimization #genai #aigenerated
32 views2 months ago
YouTubeSmartSkale
34:21
Deephonk Stemcast -- Modern AI 17 INFERENCE OPTIMIZATION: KV CACHE & QUANTIZATION
1 week ago
YouTubeDeephonk Stem
1:08
How to Mix Quantization Formats for Maximum VRAM Savings
1 week ago
YouTubeBreaking Divide
7:47
LLM Quantization
26 views1 week ago
YouTubeJeff Heidelberger
2:36
I added KV caching and INT8 KV quantization to our transformer inference, improving throughput by 35x.All of this was done from scratch in Rust + CUDA, on top of a homemade ML framework.On a 4-token prompt with 252 generated tokens:- Original: 0.76 tok/s- KV cache fp32: 27.21 tok/s- KV cache int8 (quantized): 27.29 tok/sTry it out yourself here: https://t.co/kFS9Z0fs4hIn practice:- KV caching gave us about a 35x end-to-end speedup- INT8 KV cache kept roughly the same speed as fp32 but cut KV cac
48.8K views4 weeks ago
x.comReese Chong
1:22:45
Lecture 24: Entanglement: QComputing, EPR, and Bell's Theorem
212.5K viewsJun 18, 2014
YouTubeMIT OpenCourseWare
41:59
Sampling Theorem Quantization and Binary Coding
7.1K viewsApr 11, 2021
YouTubeEngineering with Bingabr
9:58
SmoothQuant
4.4K viewsOct 25, 2023
YouTubeMIT HAN Lab
14:54
TensorRT Overview
45.2K viewsNov 22, 2021
YouTubeAhmad Bazzi
31:23
LLM Quantization Explained
412 viewsApr 21, 2025
YouTubeJoydeep Bhattacharjee
9:57
What is LLM Quantization ?
3.2K viewsMar 19, 2025
YouTubeNew Machina
12:10
Optimize Your AI - Quantization Explained
465.1K viewsDec 28, 2024
YouTubeMatt Williams
21:21
GTC 2021: Systematic Neural Network Quantization
3.3K viewsApr 26, 2021
YouTubeAmir Gholaminejad
1:36
What Is Quantization? | Decoding LLM File Names
1.2K views4 months ago
YouTubeAnaconda, Inc.
1:01
Towards Unified INT8 Training for Convolutional Neural Network
803 viewsJul 17, 2020
YouTubeComputerVisionFoundation Videos
7:14
What Are Weights in AI Models
407 views3 months ago
YouTubeCloudProInc
See more