Glauco asked "If you happen to recall the specific video and approximate timestamp where he discusses the model you’ve implemented, I’d greatly appreciate it."
I can't seem to fine the specific video. But the GitHub repo that I used is definitely: https://github.com/karpathy/ng-video-lecture I based my code on gpt.py (which I refactored into multiply py files). This file is 225 lines. I ignored the file bigram.py. This repo uses a Shakespeare corpus to generate Shakespeare like dialog. I kept the model code in gpt.py and just replaced the Shakespeare corpus with a Metamath corpus that I generated from Python. On Saturday, February 8, 2025 at 9:28:17 AM UTC-6 Glauco wrote: > Hi Bill, > > Il giorno venerdì 7 febbraio 2025 alle 21:57:48 UTC+1 [email protected] > wrote: > > > I think I gave the wrong reference to the video by Andrej Karpathy that > this project is based on. I think the correct reference is "Let's build > GPT: from scratch, in code, spelled out." > > > over the past few weeks, I’ve also been exploring Karpathy’s channel. > Unfortunately, I ended up watching some of the videos out of order, and I > keep hearing him reference past content. To address this, I’m now focusing > on the "Make More" series and currently working through the first part > (even though it doesn’t explicitly have "Part 1" in the title). > > If you happen to recall the specific video and approximate timestamp where > he discusses the model you’ve implemented, I’d greatly appreciate it. I’m > really interested in learning more about it. > > Thanks in advance! > Glauco > > > -- You received this message because you are subscribed to the Google Groups "Metamath" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/metamath/969be375-1c73-4bd2-aadc-fb70d44768f8n%40googlegroups.com.
