Thanks François, I didn't find it in pyarrow. I'll check again. On Fri, Feb 7, 2020 at 9:18 PM Francois Saint-Jacques < fsaintjacq...@gmail.com> wrote:
> Arrow does have a Map type [1][2][3]. It is represented as a list of pairs. > > François > > [1] > https://github.com/apache/arrow/blob/762202418541e843923b8cae640d15b4952a0af6/format/Schema.fbs#L60-L87 > [2] > https://github.com/apache/arrow/blob/762202418541e843923b8cae640d15b4952a0af6/cpp/src/arrow/type.h#L691-L719 > [3] > https://github.com/apache/arrow/blob/762202418541e843923b8cae640d15b4952a0af6/java/vector/src/main/java/org/apache/arrow/vector/complex/MapVector.java#L36-L47 > > On Fri, Feb 7, 2020 at 3:55 AM Shawn Yang <shawn.ck.y...@gmail.com> wrote: > > > > Hi guys, > > I'm writing an cross-language row-oriented serialization framework mainly > > for java/python for now. I detained many data types and schema, field, > such > > as Byte, short, int, long, double, float, map, array, struct,. But then I > > find using Arrow schema is a better choice. Since my framework need to > > support conversion between my row-format and arrow columnar format. If I > do > > all it by myself, I need to support schema conversion and schema > > serialization. Which is not necessary if I use arrow schema. > > > > But I find that arrow doesn't have a map data type, which is I needed > > exactly. I know I can use struct to mock it or ExtensionType for it. But > > it's not very convenient. So I want to know whether will Map type be > > supported by arrow? > > > > Thanks. Regards >
