The fast mamba solver, now in conda!
conda-libmamba-solver is a new (experimental) solver for the conda package manager which uses the solver from the mamba project behind the scenes, while carefully implementing conda's functionality and expected behaviors on top. The library used by mamba to do the heavy-lifting is called libsolv.
Additional information about the project can be found in the blog post on Anaconda's weblog: A Faster Solver for Conda: Libmamba.
The new libmamba integrations are experimental, but you can get a taste of how they are working so far by following these instructions.
Before we start: to use the libmamba integrations you need to update the conda
installation
in your base
environment to at least 4.12.0 or higher.
conda-libmamba-solver
needs to be present in yourbase
environment.
First make sure you are running conda 4.12.0 or higher:
conda update -n base conda
Then install conda-libmamba-solver:
conda install -n base conda-libmamba-solver
- Now you can experiment with different things.
--dry-run
is specially useful to check how different solvers interact. The main switch you need to take care of is the experimental solver option:
# Using default (classic) solver
$ conda create -n demo scipy --dry-run
# This is equivalent
$ conda create -n demo scipy --dry-run --experimental-solver=classic
# Using libmamba integrations
$ conda create -n demo scipy --dry-run --experimental-solver=libmamba
# Using old proof-of-concept, debugging-only libmamba integrations
$ conda create -n demo scipy --dry-run --experimental-solver=libmamba-draft
Hint: You can also enable the experimental solver with the
CONDA_EXPERIMENTAL_SOLVER
environment variable:CONDA_EXPERIMENTAL_SOLVER=libmamba conda install ...
- Use
time
to measure how different solvers perform. Take into account that repodata retrieval is cached across attempts, so only consider timings after warming that up:
# Warm up the repodata cache
$ conda create -n demo scipy --dry-run
# Timings for original solver
$ time conda create -n demo scipy --dry-run --experimental-solver=classic
# Timings for libmamba integrations
$ time conda create -n demo scipy --dry-run --experimental-solver=libmamba
conda create
commands will have similar performance because it's a very simple action! However, things change once you factor in existing environments. Simple commands likeconda install scipy
show ~2x speedups already.
- If you need extra details on why solvers are working in that way, increase verbosity. Output
might get too long for your terminal buffer, so consider using a pager like
less
:
# Verbosity can be expressed with 1, 2 or 3 `v`
$ conda create -n demo scipy --dry-run -vvv --experimental-solver=libmamba 2>&1 | less
If something is not working as expected please:
- Go to https://github.com/conda/conda/issues/new/choose
- Choose the "Libmamba Solver Feedback (Experimental Feature)" option
- Fill out the issue form as complete as possible
- Attach the log file as printed in your terminal output (if applicable)
The conda team will regularly triage the feedback and respond to your issue.
If you don't want to use the experimental solver anymore, you can uninstall it with:
$ conda remove conda-libmamba-solver
This decision has been made to protect your base
installation from unexpected changes. This
package is still in a experimental phase and, as a result, you can only use it in non-base
environments for now.
Use the following command:
$ conda config --set experimental_solver libmamba --env
Note that we are using the --env
flag so the setting is only applied to the active
environment. Otherwise it will have a global effect on all your environments, including base
,
which is now protected. As such, we strongly recommend to enable this setting in a case by case
basis or, even better, on a command by command basis by setting the corresponding command line flags
or environment variables when needed.