arhxam/arhams-deeplearning-roadmap — explained in plain English
Analysis updated 2026-05-18
Follow a structured two week path to learn deep learning from first principles.
Practice fixing bugs in a small from scratch NumPy neural network.
Learn how to pretrain and post train a GPT style language model step by step.
Study current fine tuning techniques like LoRA and DPO with linked resources.
| arhxam/arhams-deeplearning-roadmap | 0xustaz/streamgate | a-bissell/unleash-lite | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Python | Python | Python |
| Setup difficulty | easy | hard | hard |
| Complexity | 2/5 | 4/5 | 4/5 |
| Audience | researcher | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Most lessons need no GPU, only the pretraining sections require renting cloud compute.
This repository is a curated two week self study plan for learning deep learning from the ground up. It is not a piece of software you install and run. Instead, it is a structured guide made of markdown lesson files that link out to existing videos, books, and courses from well known teachers such as Andrej Karpathy, 3Blue1Brown, and Sebastian Raschka. The path starts small: learners begin with a short, plain NumPy neural network, included in the repository, that recognizes handwritten digits, and are asked to understand and fix small intentional flaws in it. From there, each of about twelve lessons builds on the last, moving through backpropagation, basic language models, attention, building a small version of a GPT style model, and tokenization, before reaching pretraining a base model and then post training it with techniques like supervised fine tuning, direct preference optimization, and reinforcement learning for reasoning. The final lessons cover current fine tuning methods like LoRA and suggest a capstone project. Every lesson offers two parallel options: a primary video to watch, or a full written alternative covering the same material for someone who prefers reading. Each lesson follows the same pattern of stating a goal, explaining why it matters, linking resources, asking the learner to build something hands on, and ending with a checkpoint question to confirm understanding before moving on. The author states that every linked resource was checked to make sure it still works, rather than assumed from memory. A small included folder holds the reference handwritten digit recognizer mentioned above, written in plain NumPy without any deep learning framework. The rest of the repository is the lesson files themselves, plus a single combined file for anyone who prefers one long document. Most of the roadmap does not require a graphics card, though the sections on training larger models point learners toward renting cloud computing time. The project is released under the MIT license, which allows free use, sharing, and modification.
A curated two week self study roadmap of videos and readings that teaches deep learning from a basic neural network up through pretraining and fine tuning a GPT style model.
Mainly Python. The stack also includes Python, NumPy, Markdown.
Free to use, share, and adapt, including for commercial purposes, as long as you keep the copyright notice.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.