It's not hard. Random data compresses to 8 bits per character. On Thu, Aug 19, 2021, 8:19 PM <immortal.discover...@gmail.com> wrote:
> I can't find using Google how BPC (Bits Per Character) evaluation for > prediction works. GPT has a score using this evaluation. It's possible I > could compare my score to GPT's if they can use BPC in the same way. > > I need an exact explanation of BPC, no math terminology or "stretch the > [P] and add a log exp to it in the zone of P in context of the lower odd > bit" lol...Like this: Take your predicted letter probabilities; a=0.11% > likely next, b=0.06%...etc, then take the correct next letter and divide it > by the sum of all letter probabilities that are under 0.5%, then cut it in > half and add the correct letter probability to it. Then times it by 10 and > minus the sum we made. > *Artificial General Intelligence List <https://agi.topicbox.com/latest>* > / AGI / see discussions <https://agi.topicbox.com/groups/agi> + > participants <https://agi.topicbox.com/groups/agi/members> + > delivery options <https://agi.topicbox.com/groups/agi/subscription> > Permalink > <https://agi.topicbox.com/groups/agi/Td13a829978c4c9f3-Mf405ec5d892f3bac096704bd> > ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Td13a829978c4c9f3-M32da3b2667ce88a2a65157e7 Delivery options: https://agi.topicbox.com/groups/agi/subscription
