Skip to content

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructures, like LLM inference, distributed cache system, multi-agent framework etc.. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PR, Issue, Idea, Documentation and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Link us via Slack, Twitter as well.

Pinned Loading

  1. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 107 23

  2. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 177 29

  3. scheduler-plugins scheduler-plugins Public

    Scheduler plugins designed for smart scheduling with llmaz.

    Go 5 1

  4. community community Public

    The InftyAI community.

    1

Repositories

Showing 10 of 11 repositories

Top languages

Loading…

Most used topics

Loading…