A high-throughput and memory-efficient inference and serving engine for LLMs

Libraries and state-of-the-art automatic sparsification algorithms to simplify and accelerate performance

CPU inference engine that delivers unprecedented performance for sparse models

Neural network model repository for highly sparse models and optimization recipes

Easy-to-use autoML interface to optimize deep neural networks for better inference performance and a smaller footprint.

Compiler for Neural Network hardware accelerators