Re: [agi] Can symbolic approach entirely replace NN approach?

1. @Can symblic approach ... 2. @Rob Freeman LLMs, What's wrong with NLP (2009-2024),  Whisper *1*. *IMO the sharpness of the division "neat" and "scruffy",  NN and symbolic is confused: Neural Networks are also symbolic:* http://artificial-mind.blogspot.com/2019/04/neural-networks-are-also-symb

Re: [agi] Can symbolic approach entirely replace NN approach?

On Wed, May 29, 2024 at 11:24 AM Matt Mahoney wrote: > Natural language is ambiguous at every level including tokens. Is > "someone" one word or two? > Tom Etter 's tragically unfinished final paper "Membership and Identity

Re: [agi] Can symbolic approach entirely replace NN approach?

My point was that token boundaries are fuzzy. This causes problems because LLMs predict tokens, not characters or bits. There was a thread on Reddit about ChatGPT not being able to count the number of R's in "strawberry". The problem is that it sees the word but not the letters. https://www.reddit.

Re: [agi] Can symbolic approach entirely replace NN approach?

On Sat, Jun 15, 2024 at 1:29 AM twenkid wrote: > > ... > 2. Yes, the tokenization in current LLMs is usually "wrong", ... it should > be on concepts and world models: ... it should predict the *physical* future > of the virtual worlds Thanks for comments. I can see you've done a lot of thinkin