RisingWave Docker Images

Run RisingWave with Docker Compose

Docker Compose allows you to easily launch a RisingWave instance on a single node. If you are using more than one server, please refer to Deploy RisingWave on Kubernetes.

Ensure you are using the latest version of RisingWave image:

# Ensure risingwave image is of latest version
docker pull ghcr.io/risingwavelabs/risingwave:latest

Playground

Playground mode does not persist any data. Never use it for production purpose.

To start a RisingWave playground, run

# Start playground
docker run -it --pull=always -p 4566:4566 -p 5691:5691 ghcr.io/risingwavelabs/risingwave:latest playground

Standalone (MinIO backend)

To start a RisingWave standalone instance with MinIO backend, run

# Start all components
docker-compose up

⚠️ Important Notes: Memory is crucial for RisingWave! Inappropriate memory configuration may lead to OOM (out-of-memory) errors or poor performance. Before deploying Docker Compose, ensure that the correct memory settings are configured in the docker-compose.yaml file. Here are examples of some typical settings.

Memory for RW container (resource.limits.memory)	8 GiB	14 GiB	28 GiB	58 GiB
compute-opts.total-memory-bytes	6 GiB	10 GiB	20 GiB	46 GiB
frontend-opts.frontend-total-memory-bytes	1 GiB	2 GiB	4 GiB	6 GiB
compactor-opts.compactor-total-memory-bytes	1 GiB	2 GiB	4 GiB	6 GiB
compute-opts.memory-manager-target-bytes	5.6 GiB	9.8 GiB	20.8 GiB	44.8 GiB

Standalone (S3 backend)

To start a RisingWave cluster with s3 backend, configure the aws credit in aws.env. If you want to use some s3 compatible storage like Tencent Cloud COS, just configure one more endpoint. After configuring the environment and fill in your bucket name, run

# Start all components
docker-compose -f docker-compose-with-s3.yml up

It will run with s3 (compatible) object storage with a meta node, a compute node, a frontend, a compactor, a prometheus and a redpanda instance.

Standalone (other backend)

To start a RisingWave cluster with other storage backend, like Google Cloud Storage, Alicloud OSS or Azure Blob Storage, configure the authentication information in multiple_object_storage.env, fill in your bucket name. and run

# Start all components
docker-compose -f docker-compose-with-xxx.yml up

It will run RisingWave with corresponding (object) storage products.

Note

For RisingWave kernel hackers, we always recommend using risedev to start the full cluster, instead of using docker images. See CONTRIBUTING for more information.

Published images

• latest on GHCR (latest nightly build): ghcr.io/risingwavelabs/risingwave:latest
• latest on Docker Hub (latest release): risingwavelabs/risingwave:latest
• Other tags available on both GHCR and Docker Hub:
  • nightly-yyyyMMdd, e.g., nightly-20230108
  • vX.Y.Z, e.g., v0.1.15

Build the images

The docker images for x86_64 are built with AVX2 SIMD extensions, while the images for aarch64 are built with NEON SIMD extensions. These must be available on your machine. If your machine does not support these extensions, you must build the docker image with the build-arg simd_disabled=true.

To build the images, simply run:

docker build . -f docker/Dockerfile

from the project root.

To build the images without SIMD vector extensions, run

docker build . -f docker/Dockerfile --build-arg simd_disabled=true

from the project root and run any subsequent docker commands on the resultant image.

Generate docker-compose.yml

./risedev compose

Common Issues

Error message:

Error { code: "XMinioStorageFull", message: "Storage backend has reached its minimum free drive threshold. Please delete a few objects to proceed."

Solution:

This usually happens on MacOS with Docker Desktop. The Docker Deskup runs in the macOS Hypervisor. All the data, including logs, images, volumes, and so on, is stored in this hypervisor and the hypervisor has a default disk capacity limit. So when this message emerges, simply cleaning up the unused container or image can help mitigate. You can also increase capacity limit by clicking the Docker Desktop icon in the menu bar, then clicking Preferences > Resources > Increase Disk image size.