I see. Now the question is what we should do about such columns in the ORC writer as well as maybe some other writers since the Null type, as opposed to all Null columns of a numeric or binary type, doesn’t exist in such formats.
On Sunday, November 21, 2021, Antoine Pitrou <[email protected]> wrote: > On Sun, 21 Nov 2021 04:21:52 -0500 > Ian Joiner <[email protected]> wrote: > > Hi, > > > > When an all NA column from Pandas of the object type is converted to > Arrow using Table.from_pandas we get a column of the NullType type as > opposed to StringType/BinaryType. Is this actually intended? > > It is. Why would we get a StringType/BinaryType? > > >
