I think I gave the wrong reference to the video by Andrej Karpathy that this project is based on. I think the correct reference is "Let's build GPT: from scratch, in code, spelled out."
If that is not correct, you might want to look at the link https://karpathy.ai/zero-to-hero.html (this webpage has links to a course by Andrej Karpathy on building neural networks, from scratch, in code.) The GitHub repository has the link https://github.com/karpathy/ng-video-lecture Sorry that I don't remember which video from Andrej Karpathy that I based the project on. "Deep Dive into LLMs like ChatGPT" is an amazing youtube video put out by Andrej Karpathy a few days ago (it is three and a half hours long). I think it has some concepts that might be useful for making AI work with Metamath. Bill Hale On Friday, February 7, 2025 at 9:33:03 AM UTC-6 David A. Wheeler wrote: > > > > On Feb 6, 2025, at 9:29 PM, [email protected] <[email protected]> wrote: > > > > I started a GitHub repository for an AI Generative Pretrained > Transformer model for Metamath. It is base on a youtube video by Andrej > Karpathy (Building makemore Part 2: MLP). > > Awesome! I've added a link to it from this page: > > https://github.com/metamath/set.mm/wiki/Automated-proving > > --- David A. Wheeler > > -- You received this message because you are subscribed to the Google Groups "Metamath" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/metamath/b47c46ef-52c8-460c-ace0-fdd97330d038n%40googlegroups.com.
