profile picture

    GenAI Implementation

    My notes from building models and working through training code: what each part does, why it is there, and what I learn by running it.

    TrackFocus
    Karpathy: Building GPTMicrograd and backpropagation, tiny Shakespeare, and GPT-2
    DeepSeek: TorchFeatherFollowing the implementation and explaining the code as I study it

    For the underlying papers and concepts, see GenAI Research.