Glossary

Quantization

Quantization in AI compresses neural network models by converting high-precision weights and activations (e.g., 32-bit floats) to lower-precision formats (e.g., 8-bit or 4-bit integers), drastically reducing memory footprint, inference latency, and energy consumption while preserving accuracy.

Quantization in AI compresses neural network models by converting high-precision weights and activations (e.g., 32-bit floats) to lower-precision formats (e.g., 8-bit or 4-bit integers), drastically reducing memory footprint, inference latency, and energy consumption while preserving accuracy.