1 more question Matt: https://openai.com/blog/better-language-models/ They say "enwik8 - bits per character (–) - OURS: 0.93 - LAST RECORD 0.99" But....but...enwiki8 is 100MB! 0.99 alone is 100MB / 8 = 12.5MB. The best compression is 14.8MB though. What are they doing here? 0.93 is 11,625,000 bytes. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T2a0cd9d392f9ff94-M39bf273e3e3f871053b98087 Delivery options: https://agi.topicbox.com/groups/agi/subscription
- Re: [agi] The limitations of the validit... Matt Mahoney
- Re: [agi] The limitations of the va... immortal . discoveries
- Re: [agi] The limitations of the va... James Bowery
- Re: [agi] The limitations of th... immortal . discoveries
- Re: [agi] The limitations o... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... stefan.reich.maker.of.eye via AGI
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... Matt Mahoney
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries
- Re: [agi] The limitatio... immortal . discoveries