Skip to content

bd-iaas-us/InfiniStore

Repository files navigation

Run pre-commit checks Slack Docs

pre-required

install

pip install infinistore

run

For RDMA RoCE

infinistore --service-port 12345 --dev-name mlx5_0 --link-type Ethernet

For RDMA Infiniband

infinistore --service-port 12345 --dev-name mlx5_0 --link-type IB

build on ubuntu

apt install libuv1-dev
apt install libflatbuffers-dev
apt install libspdlog-dev libfmt-dev
apt install ibverbs-utils libibverbs-dev
apt install libboost-dev libboost-stacktrace-dev
pip install -e .
pip install pre-commit
pre-commit install

client example

check example code

  • infinistore/example/client.py
  • infinistore/example/client_async.py
  • infinistore/example/client_async_single.py

unit test

pytest infinistore/test_infinistore.py

pre-commit

pre-commit run --all-files

About

A distributed KV store for disaggregated LLM inference

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •