Definition
A model compression technique that reduces the memory footprint and speeds up inference by converting a model's floating-point weights to lower-precision integer formats (e.g., 8-bit or 4-bit).
In short: A model compression technique that reduces the memory footprint and speeds up inference by converting a model's floating-point weights to lower-precision integer formats (e.