Some possible integrations: (1) maybe we can provide new APIs which use Arrow for read and write. - it may be very helpful for Python API. - according to my understanding, we have to use gRPC to reimplement the RPC layer.
(2) maybe we can provide new APIs to TsFile modules, like Arrow-Parqeut. I think the work is acceptable and the difficulty is controllable. Best, ----------------------------------- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Jialin Qiao <qiaojia...@apache.org> 于2022年3月8日周二 21:00写道： > Hi, > > Forgot to answer questions... > IoTDB does not support Apache Arrow now, but we are glad to do some > integration if possible. > > Thanks > ————————————————— > Jialin Qiao > > > Jialin Qiao <qiaojia...@apache.org> 于2022年3月8日周二 20:47写道： > > > Hi Lukas, > > > > Thanks for raising up this topic :) > > I heard about Apache Arrow for a while but haven't investigated it > deeply. > > > > I will do some investigation later. If you have some integration guides > or > > examples, welcome to share~ > > > > Thanks, > > ————————————————— > > Jialin Qiao > > > > > > Lukas Ott <ott.lukas...@gmail.com> 于2022年3月8日周二 17:54写道： > > > >> In the documenation I was looking for a linkage to Apache Arrow for > >> example > >> to do similar things like this: A gentle introduction to Apache Arrow > >> with > >> Apache Spark and Pandas | by Antonio Cachuan | Towards Data Science > >> < > >> > https://towardsdatascience.com/a-gentle-introduction-to-apache-arrow-with-apache-spark-and-pandas-bb19ffe0ddae > >> > > >> > >> So would indeed be a neat feature to support Apache Arrow > >> specification directly: > >> Apache Arrow | Apache Arrow <https://arrow.apache.org/> > >> > >> Specs: Arrow Columnar Format — Apache Arrow v7.0.0 > >> <https://arrow.apache.org/docs/format/Columnar.html> > >> > >> So for instance that dataframes can be accessed directly via Python, R > or > >> other programming languages. > >> > >> What do you think? > >> > >> Regards, > >> otluk > >> > > >
