On Wednesday, July 01, 2020, at 9:02 PM, Ben Goertzel wrote: > Basically what these NNs are doing is finding very large volumes of simple/shallow data patterns and combining them together. Whereas there are in fact deeper and more abstract patterns present in language data, the transformer NNs underlying GPT3 etc. just can't find them.
Is that what they call "Shallow Learning". All this AI terminology is difficult to keep track of when your more focused on AGI verses AI... ahh well.. ------------------------------------------ Artificial General Intelligence List: AGI Permalink: https://agi.topicbox.com/groups/agi/T100f708e32ae7327-M155bfc36629af5407e151702 Delivery options: https://agi.topicbox.com/groups/agi/subscription
