Re: Alluxio cache read support

Le 06/09/2022 à 09:45, Manoj Kumar a écrit : Hi Sutou Kouhei/Team *[Background]* Working on intel gazelle_plugin , It's a C++ based backend with an arrow compute engine for spark. Now during scan i.e reading data from HDFS/Cloud currently we

Re: Alluxio cache read support

ystemE > > (You're using Apache Arrow C++, right?) > > > Thanks, > -- > kou > > In > "Alluxio cache read support" on Mon, 5 Sep 2022 16:58:57 +0530, > Manoj Kumar wrote: > > > Hi Team, > > > > Anyone know how to access HDFS/cloud FS backend by Alluxio via the arrow > > filesystem ? >

Re: Alluxio cache read support

Hi, Could you try our HDFS support? * https://arrow.apache.org/docs/cpp/dataset.html#reading-from-cloud-storage * https://arrow.apache.org/docs/cpp/api/filesystem.html#_CPPv4N5arrow2fs16HadoopFileSystemE (You're using Apache Arrow C++, right?) Thanks, -- kou In "Alluxio cache

Alluxio cache read support

Hi Team, Anyone know how to access HDFS/cloud FS backend by Alluxio via the arrow filesystem ?