About support ORC Filter pushdown

2021-11-26 Thread Shen, Xiangxiang
Hi all, In arrow dataset, Filter pushdown can improve reading files performance greatly. We notice parquet has implemented, https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484. But ORC filefor

Re: [DISCUSS] A repository for collaborative prototyping + algorithms / performance research?

2021-11-26 Thread Micah Kornfield
> > People would make pull requests like any other repository, but it > would be a bit more free form than our other repositories. The goal is > to get this kind of collaboration (code and the discussions) happening > on Arrow community channels. What is the expectation around code reviews for th

[Python] How to make a new C++ header file available in Python

2021-11-26 Thread Ian Joiner
Hi, I have added a new C++ header file, arrow/adapters/orc/adapter_options.h which is not recognized in Cython in our Github Action builds. I wonder what kind of changes (in CMake? I haven’t found any relevant piece in the one CMakeLists.txt in the python directory though) are necessary to mak

Re: [VOTE][RUST] Release Apache Arrow Rust 6.3.0 RC1

2021-11-26 Thread Jörn Horstmann
+1 non-binding Updated our query engine (which was already on an earlier commit of the active_release branch) and everything works fine On Fri, Nov 26, 2021 at 3:22 PM Wang Xudong wrote: > +1 non-binding > > "Release candidate looks good!" > > --- > xudong963 > > Andrew Lamb 于2021年11月26日周五 下午9

Re: [VOTE][RUST] Release Apache Arrow Rust 6.3.0 RC1

2021-11-26 Thread Wang Xudong
+1 non-binding "Release candidate looks good!" --- xudong963 Andrew Lamb 于2021年11月26日周五 下午9:45写道: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 6.3.0. > > This release candidate is based on commit: > 686ac184c10f99c89ef555cc97b2231fba4d4cee [1] > >

[VOTE][RUST] Release Apache Arrow Rust 6.3.0 RC1

2021-11-26 Thread Andrew Lamb
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 6.3.0. This release candidate is based on commit: 686ac184c10f99c89ef555cc97b2231fba4d4cee [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, ver