GitHub - nathanael-fijalkow/LLM_from_scratch: Coding a Transformer from scratch

The main file is a Notebook, LLM_from_scratch.ipynb To include the minbpe submodule, use git clone --recursive https://github.com/nathanael-fijalkow/LLM_from_scratch

Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
minbpe @ 2963f82		minbpe @ 2963f82
.gitmodules		.gitmodules
A practical introduction to LLMs.pdf		A practical introduction to LLMs.pdf
Hugging Face CookBook.ipynb		Hugging Face CookBook.ipynb
LICENSE		LICENSE
LLM Full course.pdf		LLM Full course.pdf
LLM from scratch.ipynb		LLM from scratch.ipynb
LoRA.ipynb		LoRA.ipynb
PEFT.ipynb		PEFT.ipynb
RAG.ipynb		RAG.ipynb
README.md		README.md
Tokenizer_on_code.ipynb		Tokenizer_on_code.ipynb
chunk_list.json		chunk_list.json
exercise_RAG.ipynb		exercise_RAG.ipynb
vectorial_database.pth		vectorial_database.pth
wikipedia_data.json		wikipedia_data.json

Provide feedback