minGemma

An attempt to create a straightforward, readable, and fast repository for training and fine-tuning Google's Gemma Models to help people easily leverage advanced AI technology. Project in its entirity is influenced by Andrej Karpathy's minGPT and nanoGPT; however, the implementation is vastly different

Dependencies:

• Pytorch

• Numpy

• pip install datasets for huggingface datasets

Contributing

We welcome contributions from the community! To contribute:

1. Fork the repository.
2. Create a new branch (git checkout -b feature-branch).
3. Make your changes and commit them (git commit -m 'Add new feature').
4. Push to the branch (git push origin feature-branch).
5. Create a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for details.