Re: Re: ORC scanner - points for discussion

2018-02-12 Thread Jim Apple
I agree with the previous comments on this thread. Thank you for contributing, Quanlong!

Re: Re: ORC scanner - points for discussion

2018-02-12 Thread Dimitris Tsirogiannis
Does the patch also implement an ORC writer? Dimitris On Mon, Feb 12, 2018 at 8:48 AM, Jim Apple wrote: > I agree with the previous comments on this thread. Thank you for > contributing, Quanlong! >

Re: Re: ORC scanner - points for discussion

2018-02-12 Thread Tim Armstrong
Putting it behind a flag sounds good to me too. Hopefully we can get feedback from Hulu and other users of Impala that will try out the experimental version. On Mon, Feb 12, 2018 at 10:26 AM, Dimitris Tsirogiannis < dtsirogian...@cloudera.com> wrote: > Does the patch also implement an ORC writer?

Re: Re: Re: ORC scanner - points for discussion

2018-02-12 Thread Tim Armstrong
Maybe it would make sense to create an Epic in JIRA for ORC scanner enhancements, following on from the initial implementation. I don't really feel strongly as long as the related JIRAs are linked together somehow. On Mon, Feb 12, 2018 at 1:42 PM, Quanlong Huang wrote: > Dimitris, as the first s

Re: Re: Re: ORC scanner - points for discussion

2018-03-28 Thread Tim Armstrong
It looks like the review is converging, so hopefully we can get this in soon and people can play around with it in their development environments some more. Also, I wanted to call out all of the bugs that Quanlong has found and been fixing in the ORC C++ library - he's found a whole bunch of pre-e