mohitreddy1996
Follow
Lists (2)
Stars
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
A high performance concurrent caching library for Rust
A composable and fully extensible C++ execution engine library for data management systems.
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Minimalistic large language model 3D-parallelism training
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Venice, Derived Data Platform for Planet-Scale Workloads.
Portable interface to epoll, kqueue, event ports, and wepoll
Embeddable stream processing engine based on Apache DataFusion
Apache Paimon Rust The rust implementation of Apache Paimon.
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance …
Limbo is a project to build the modern evolution of SQLite.
Magical Deterministic Simulator for distributed systems in Rust.
Virtual whiteboard for sketching hand-drawn like diagrams
An open source serverless computing platform
The open-source reactive database for app developers
Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data
Apache Polaris, the interoperable, open source catalog for Apache Iceberg
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
Thread-safe container for sharing data between threads