Andrej Karpathy ML Lectures
- micrograd: https://github.com/karpathy/micrograd
- Zerop to Hero:https://karpathy.ai/zero-to-hero.html
- transformers
- nano chat
CS231n Winter 2016: Lecture 1
- Pictures and Video are the "Dark Matter" of data. Most of the information on the web is unlabeled pictures or video that humans cannot possible watch/label
CS231n Winter 2016: Lecture 4: Backpropagation, Neural Networks 1
Think in terms of graphs (or circuts) not functions
- Add gate: gradient distributor
- max gate: gradient router
- mul gate: