Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 340 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 242 17

  3. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 196 14

  4. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 111 9

  5. UMbreLLa UMbreLLa Public

    LLM Inference on consumer devices

    Python 95 15

  6. gsm_infinite gsm_infinite Public

    Python 39 2

Repositories

Showing 10 of 18 repositories
  • UMbreLLa Public

    LLM Inference on consumer devices

    Python 95 Apache-2.0 15 11 (6 issues need help) 9 Updated Mar 17, 2025
  • gsm_infinite Public
    Python 39 2 1 0 Updated Feb 26, 2025
  • APE-Page Public
    JavaScript 0 0 0 0 Updated Feb 12, 2025
  • APE Public
    Python 15 0 1 0 Updated Feb 12, 2025
  • RULER Public Forked from NVIDIA/RULER

    This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

    Python 0 Apache-2.0 74 0 0 Updated Jan 30, 2025
  • Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 340 37 7 3 Updated Jan 28, 2025
  • lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    Python 0 MIT 2,271 0 0 Updated Jan 11, 2025
  • S2FT Public
    Python 16 3 1 0 Updated Jan 3, 2025
  • S2FT-Page Public
    JavaScript 0 0 0 0 Updated Dec 30, 2024
  • MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 196 Apache-2.0 14 10 1 Updated Dec 16, 2024
View all repositories