Definition
Techniques like quantization, pruning, and model compilation designed to reduce the computational cost and latency of deployed AI models, making them run faster.
In short: Techniques like quantization, pruning, and model compilation designed to reduce the computational cost and latency of deployed AI models, making them run faster.