[
https://issues.apache.org/jira/browse/ARROW-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17208689#comment-17208689
]
Andrew Lamb commented on ARROW-10128:
-------------------------------------
Thanks [~jorgecarleitao] -- I wonder what you mean by "none of our arrays
support this encoding" ? Do you have any more specifics of where the specs
differ?
The `DictionaryArray` seems to support indexes / values according yo me
understanding of the spec. I would say that the DictionaryArray type is not
particularly easy to work with (as the Rust type only encodes the type of the
index array, not (also) the type of the dictionary values)
> [Rust] Dictionary-encoding is out of spec
> -----------------------------------------
>
> Key: ARROW-10128
> URL: https://issues.apache.org/jira/browse/ARROW-10128
> Project: Apache Arrow
> Issue Type: Task
> Components: Rust
> Reporter: Jorge Leitão
> Priority: Major
>
> According to [the
> spec|https://arrow.apache.org/docs/format/Columnar.html#physical-memory-layout],
> every array can be dictionary-encoded, on which its values are encoded by a
> unique set of values.
> However, none of our arrays support this encoding and the physical memory
> layout of this encoding is not being fulfilled.
> We have a DictionaryArray, but, AFAIK, it does not respect the physical
> memory layout set out by the spec.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
