Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread David
Hello, Thanks for the clarification, sorry for the confusion and SPAM. I did indeed believe that these changes went out in ORC 1.7.0. I'll check in again for ORC 1.8.0 :) Thanks, David On Mon, Oct 4, 2021 at 10:42 PM Dongjoon Hyun wrote: > It seems that you are confused about Apache ORC 1.7.

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread Dongjoon Hyun
It seems that you are confused about Apache ORC 1.7.0 release. None of the above JIRAs (except ORC-848) are part of Apache ORC 1.7.0. The `main` branch is still under active development and any patch could be reverted before Apache ORC 1.8.0 release. For ORC-848, it's a single patch. It would be

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread David
Hello, I do not know that there there is any one JIRA/PR that would show remarkable results, but perhaps the collection would: ORC-829, ORC-831, ORC-830, ORC-842, ORC-854, ORC-853, ORC-852, ORC-848, ORC-847, ORC-837, ORC-836, ORC-835, ORC-834, Thanks, David On Mon, Oct 4, 2021 at 7:43 PM Dongjo

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread Dongjoon Hyun
Which JIRAs do you mean specifically in Apache ORC 1.7.0? Could you elaborate your contributions and improvement specifically in Apache ORC 1.7? I believe you are the best person to share it with us. :) Best, Dongjoon. On Mon, Oct 4, 2021 at 1:36 PM David wrote: > Hello Dongjoon, > > It is I

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread David
Hello Dongjoon, It is I "belugabehr" !!! :) a.k.a dmolli...@apache.org I made quite a few optimizations that did not change the API. Just curious to see if anyone, in the "real world," derived benefit from my work. Thanks! On Mon, Oct 4, 2021 at 3:40 PM Dongjoon Hyun wrote: > Hi, David. > >

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread Dongjoon Hyun
Hi, David. It always depends on your use case. Did you try the following new features? https://orc.apache.org/docs/releases.html ORC-742 LazyIO of non-filter columns ORC-577 Support row-level filtering ORC-751 Implement Predicate Pushdown in C++ Reader ORC-780 Support LZ4 Compression in C++ Writ

Re: Apache ORC 1.7.0 Adoption Status

2021-10-04 Thread David
Hello Gang, I have invested some time in squeezing out performance for ORC 1.7. Just curious if there are any measurable improvements out there. Thanks. On Tue, Sep 28, 2021, 12:36 AM Dongjoon Hyun wrote: > Hi, All. > > The following is the Apache ORC 1.7.0 release and adoption status (as of

Apache ORC 1.7.0 Adoption Status

2021-09-27 Thread Dongjoon Hyun
Hi, All. The following is the Apache ORC 1.7.0 release and adoption status (as of today). 2021-09-15: Apache ORC 1.7.0 is released 2021-09-20: Apache Spark (dongjoon, https://github.com/apache/spark/pull/34045) 2021-09-20: Apache Iceberg (william, https://github.com/apache/iceberg/pull/3160) 2021