denmoroz
Follow
Stars
A PyTorch native library for large model training
Profiling and Improving the PyTorch Dataloader for high-latency Storage
A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
User friendly Rasterio plugin to read raster datasets.
Framework for building and solving ODE-based models, an extension of xarray-simlab
Download numerical weather prediction datasets (HRRR, RAP, GFS, IFS, etc.) from NOMADS, NODD partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.
A dataset for loading zarr files to be used in machine learning training pipelines
Library for reading and writing large multi-dimensional arrays.
🌍 A Collection of Awesome Large Weather Models (LWMs) | AI for Earth (AI4Earth) | AI for Science (AI4Science)
A Python package to manage extremely large amounts of data
Delta reader for the Ray open-source toolkit for building ML applications
A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
Map handling framework for automated driving
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
A playbook for systematically maximizing the performance of deep learning models.
Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.
ONNXMLTools enables conversion of models to ONNX
Hackable and optimized Transformers building blocks, supporting a composable construction.
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…
Dataframes powered by a multithreaded, vectorized query engine, written in Rust