Hey channel,

I'm trying to fix issue 4350
<https://issues.apache.org/jira/browse/ARROW-4350>, which is a result of
arrow.Table<-> pandas.df conversion is not symmetric

basically we decide to use numpy array as the basis of list when converting
from arrow table to pandas. which makes me wondering why? since pandas df
doesn't have a very good multi-dimension array schema. and numpy array is
very strict with the compact memory layout. So it is very hard to support
any more than 1-D array/list data inside of pandas df cell using numpy 1D
array of 1D array.  And it actually caused a lot of problem for us to use
the result of arrow in python land.

Would it be possible to just use pure python list if the data is more than
1D ?

I can't think of any easy fix for that issue, if any of you have any
suggestions, please let me know :)

THanks!

Reply via email to