Re: Alluxio cache read support

2022-09-06 Thread Manoj Kumar
ystemE > > (You're using Apache Arrow C++, right?) > > > Thanks, > -- > kou > > In > "Alluxio cache read support" on Mon, 5 Sep 2022 16:58:57 +0530, > Manoj Kumar wrote: > > > Hi Team, > > > > Anyone know how to access HDFS/cloud FS backend by Alluxio via the arrow > > filesystem ? >

Alluxio cache read support

2022-09-05 Thread Manoj Kumar
Hi Team, Anyone know how to access HDFS/cloud FS backend by Alluxio via the arrow filesystem ?

Re: HDFS ORC to Arrow Dataset

2021-09-09 Thread Manoj Kumar
, Manoj Kumar wrote: > Hi Wes, > > Thanks, > > *[ Part 1 ]* > *C++ HDFS/ORC [Completed]* > Steps which I followed : > 1) arrow::fs::HadoopFileSystem --> create a hadoop FS > 2) std::shared_ptr -->then create a stream > 3) Pass that stream to adapters::orc

Re: HDFS ORC to Arrow Dataset

2021-09-08 Thread Manoj Kumar
/arrow/tree/master/cpp/src/arrow/dataset > > > > We have CSV, Arrow (IPC), and Parquet interfaces. > > > > But we have an HDFS filesystem implementation and an ORC reader > > implementation, so mechanically all of the pieces are there but need > > to be connected

Fwd: HDFS ORC to Arrow Dataset

2021-09-07 Thread Manoj Kumar
Hi Dev-Community, Anyone can help me to guide how to read ORC directly from HDFS to an arrow dataset. Thanks Manoj

Re: Installing Arrow

2016-07-13 Thread Manoj Kumar
ffort into dealing with the optional dependencies > of pyarrow, or even deciding what is optional vs required. So for now > installing parquet-cpp is needed for building the Python extensions. > > - Wes > > On Wed, Jul 6, 2016 at 11:05 AM, Manoj Kumar > <manojkumarsivaraj...@gma

[jira] [Created] (ARROW-240) Installation instructions for pyarrow

2016-07-13 Thread Manoj Kumar (JIRA)
Manoj Kumar created ARROW-240: - Summary: Installation instructions for pyarrow Key: ARROW-240 URL: https://issues.apache.org/jira/browse/ARROW-240 Project: Apache Arrow Issue Type: Improvement

Re: Installing Arrow

2016-07-06 Thread Manoj Kumar
uot;PARQUET_HOME" to be to install the python port? Thanks! On Tue, Jul 5, 2016 at 3:47 PM, Manoj Kumar <manojkumarsivaraj...@gmail.com> wrote: > Hi Wes, > > I updated Boost and it works now. > > I'll send a pull request to make a note for that soon. > > On Tue

Re: Installing Arrow

2016-07-05 Thread Manoj Kumar
r-images/blob/master/linux-anvil/Dockerfile > > > > I hit another bug due to old boost-devel in CentOS, so I'd need to > > look more into that > > > > - Wes > > > > On Tue, Jul 5, 2016 at 10:40 AM, Manoj Kumar > > <manojkumarsivaraj...@gmail.com> wrote: &

Re: Installing Arrow

2016-07-05 Thread Manoj Kumar
ke `yum groupinstall > > "Development Tools"` might help install this and other related libraries > > you will probably find yourself needing. > > It might be useful to make a note of this in the README as well on what > the > > expected/required native li

Installing Arrow

2016-07-01 Thread Manoj Kumar
Hi, I am trying to install Arrow using the following instructions. ./cpp/thirdparty/download_thirdparty.sh ./cpp/thirdparty/build_thirdparty.sh It fails with this error: + cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/home/manoj/arrow/cpp/thirdparty/installed