On Thu, May 23, 2024 at 9:19 PM Rob Freeman <chaotic.langu...@gmail.com>
wrote:

> ...(Regarding the HNet paper)
> The ideas of relational category in that paper might really shift the
> needle for current language models.
>
> That as distinct from the older "grammar of mammalian brain capacity"
> paper, which I frankly think is likely a dead end.
>

Quoting the HNet paper:

> We conjecture that ongoing hierarchical construction of
> such entities can enable increasingly “symbol-like” repre-
> sentations, arising from lower-level “statistic-like” repre-
> sentations. Figure 9 illustrates construction of simple “face”
> configuration representations, from exemplars constructed
> within the CLEVR system consisting of very simple eyes,
> nose, mouth features. Categories (¢) and sequential rela-
> tions ($) exhibit full compositionality into sequential rela-
> tions of categories of sequential relations, etc.; these define
> formal grammars (Rodriguez & Granger 2016; Granger
> 2020). Exemplars (a,b) and near misses (c,d) are presented,
> initially yielding just instances, which are then greatly re-
> duced via abductive steps (see Supplemental Figure 13).

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/T682a307a763c1ced-Mb30f879a8ccbe35506565e18
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to