Stars
2
stars
written in Python
Clear filter
A natural language interface for computers
A high-throughput and memory-efficient inference and serving engine for LLMs