Archai is a platform for Neural Network Search (NAS) with a goal to unify several recent advancements in research and making them accessible to non-experts so that anyone can leverage this research to generate efficient deep networks for their own applications. Archai hopes to accelerate NAS research by easily allowing to mix and match different techniques rapidly while still ensuring reproducibility, documented hyper-parameters and fair comparison across the spectrum of these techniques. Archai is extensible and modular to accommodate new algorithms easily (often with only a few new lines of code) offering clean and robust codebase.
conda create --name archai python=3.7
conda activate archai
Follow instructions here to install pytorch for your OS and cuda version. We have tested it with version 1.3+.
Microsoft Visual C++ 14.0 is required for pickle5 package. Get it with Build Tools for Visual Studio
For network visualization, you may need to separately install graphviz. We recommend [TODO]
pip install archai
We recommend installing from the source code:
git clone https://github.com/microsoft/archai.git
cd archai
pip install -e .
Archai requires Python 3.6+ and is tested with PyTorch 1.3+.
cd archai- The below command will run every algorithm through a few batches of cifar10 and for both search and final training
python scripts/main.py. If all went well, you have a working installation! Yay!- Note one can also build and use the cuda 10.1 or 9.2 compatible dockers provided in the dockers folder. These dockers are useful for large scale experimentation on compute clusters.
scripts/main.py is the main point of entry.
python scripts/main.py runs all implemented search algorithms and final training
with a few minibatches of data from cifar10. This is designed to exercise all
code paths and make sure that everything is properly.
python scripts/main.py --darts will run darts search and evaluation (final model training) using only a few minibatches of data from cifar10.
python scripts/main.py --darts --full will run the full search.
Other algorithms can be run by specifying different algorithm names like petridish, xnas, random etc.
Current the following algorithms are implemented:
- Petridish
- DARTS
- [Random search baseline]
- XNAS (this is currently experimental and has not been fully reproduced yet as authors have not released source code at the time of writing.)
- DATA (this is currently experimental and has not been fully reproduced yet as authors have not released source code at the time of writing.)
See Roadmap for details on new algorithms coming soon.
See detailed instructions.
We would love your contributions, feedback, questions, algorithm implementations and feature requests! Please file a Github issue or send us a pull request. Please review the Microsoft Code of Conduct and learn more.
Join the Archai group on Facebook to stay up to date or ask any questions.
Archai has been created and maintained by Shital Shah and Debadeepta Dey in the Reinforcement Learning Group at Microsoft Research AI, Redmond, USA. Archai has benefited immensely from discussions with John Langford, Rich Caruana, and Eric Horvitz
They look forward to Archai becoming more community driven and including major contributors here.
Archai builds on several open source codebases. These includes: Fast AutoAugment, pt.darts, DARTS-PyTorch, DARTS, petridishnn, PyTorch CIFAR-10 Models, NVidia DeepLearning Examples, PyTorch Warmup Scheduler, NAS Evaluation is Frustratingly Hard. Please see install_requires section in setup.py for up to date dependencies list. If you feel credit to any material is missing, please let us know by filing a Github issue.
This project is released under the MIT License. Please review the License file for more details.