Nature

Speed up integer-arithmetic-only inference via bit-shifting

Quantization is a widely adopted technique in model deployment as it offers a favorable trade-off between computational overhead and performance loss. Integer-arithmetic-only quantization is an ...

Nota AI Has Two MoE Quantization Papers Accepted at ICML 2026 Workshop, Demonstrating Global Competitiveness in Large-Scale AI Optimization

Nota AI, a company specializing in AI model compression and optimization, announced that two of its papers on MoE-specific ...
Semiconductor Engineering

Neural Network Model Quantization On Mobile

The general definition of quantization states that it is the process of mapping continuous infinite values to a smaller set of discrete finite values. In this blog, we will talk about quantization in ...
Nature

Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors

With edge computing, real-time inference of deep neural networks (DNNs) on custom hardware has become increasingly relevant. Smartphone companies are incorporating artificial intelligence (AI) chips ...

The latest Gemma 4 models use a training trick to slash their on-device memory footprint

You can now download Gemma 4 models with quantization-aware training to reduce the amount of mobile memory required to 1GB.