I can't find using Google how BPC (Bits Per Character) evaluation for prediction works. GPT has a score using this evaluation. It's possible I could compare my score to GPT's if they can use BPC in the same way.
I need an exact explanation of BPC, no math terminology or "stretch the [P] and add a log exp to it in the zone of P in context of the lower odd bit" lol...Like this: Take your predicted letter probabilities; a=0.11% likely next, b=0.06%...etc, then take the correct next letter and divide it by the sum of all letter probabilities that are under 0.5%, then cut it in half and add the correct letter probability to it. Then times it by 10 and minus the sum we made. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/Td13a829978c4c9f3-Mf405ec5d892f3bac096704bd Delivery options: https://agi.topicbox.com/groups/agi/subscription
