Matt: The idea is that for a sentence like "Put the green ball on the red block.", a bag of words model is insufficient
1. "Bag of words model" is a good phrase - basically we're always talking about some kind of semantic network/database, no?
2. Bags of words can't understand or generate a single altogether new word - like "hammer", say - if there is no pre-existing reference in the bag. "Bags of lego bricks" can only produce constructions of lego bricks - not rocks. logs, mud, cards, or miscellaneous junkyard items. Bags of words can only produce constructions of those same words, not new ones.
3. They can't even understand all combinations/constructions of *existing* words.
"Put the red block on the green ball" - may be impossible. Or not. Neither a program or a human being can tell without looking and perhaps without physically experimenting. Jim is going to waste another year finding that out - and then forgetting it, and starting all over again.. and again.
4. COGNITIVE SYNERGY (switching to other thread) is baloney. If you add three progs together and get three bags of building blocks [or words] what you end up with is three and only three kinds of structures. If you add a lego brickbuilding prog to a log- and concrete-slab building prog, you will end up with structures combining those three blocks AND NO OTHERS. You will have not the slightest generativity - the progs won't suddenly be able to construct junkyard shanty huts with corrugated roofing or rock walls.
As always, Ben, Kurzweil et al can provide not the slightest hint of an *effective mechanism* for their proposals - or indeed of the AGI *effect* they are trying to achieve. No effective mechanism, no operational definition, just baloney. That's your problem, Ben :)
------------------------------------------- AGI Archives: https://www.listbox.com/member/archive/303/=now RSS Feed: https://www.listbox.com/member/archive/rss/303/21088071-f452e424 Modify Your Subscription: https://www.listbox.com/member/?member_id=21088071&id_secret=21088071-58d57657 Powered by Listbox: http://www.listbox.com
