Reverse List of everything I am trying to use to learn LLMs

Things to learn

Things to Memorize (Spaced Memorization)

Topicwise Breakdown

Suggestions/Edits/Comments here: https://forms.gle/5ySAAHZK6FigPvNt7

New ideas

• [ ] Task Vectors
• [ ] https://steelph0enix.github.io/posts/llama-cpp-guide/
• [ ] CUDA (Device Architecture) | GPU Glossary

Speeding up the GPT - KV cache | Dip'Blog

GPT in 60 Lines of NumPy | Jay Mody

11/22 List

• [x] Revise CuDA (Shane Cook book)
  • [x] Interview Questions (c - Interview questions on CUDA Programming? - Stack Overflow)
• [x] Understand ToRA Paper
• [ ] Sparse Autoencoder Intuition
• [ ] FineTuning Guide
• [ ] Umail Learning Track
  • [ ] DPO
  • [ ] RLHF
  • [ ] Quantization
  • [ ] LoRA
  • [ ] Diffusion Models