Hi Lukas, Thanks for raising up this topic :) I heard about Apache Arrow for a while but haven't investigated it deeply.
I will do some investigation later. If you have some integration guides or examples, welcome to share~ Thanks, ————————————————— Jialin Qiao Lukas Ott <[email protected]> 于2022年3月8日周二 17:54写道： > In the documenation I was looking for a linkage to Apache Arrow for example > to do similar things like this: A gentle introduction to Apache Arrow with > Apache Spark and Pandas | by Antonio Cachuan | Towards Data Science > < > https://towardsdatascience.com/a-gentle-introduction-to-apache-arrow-with-apache-spark-and-pandas-bb19ffe0ddae > > > > So would indeed be a neat feature to support Apache Arrow > specification directly: > Apache Arrow | Apache Arrow <https://arrow.apache.org/> > > Specs: Arrow Columnar Format — Apache Arrow v7.0.0 > <https://arrow.apache.org/docs/format/Columnar.html> > > So for instance that dataframes can be accessed directly via Python, R or > other programming languages. > > What do you think? > > Regards, > otluk >
