Parquet filter pushdown and string fields that use dictionary encoding

2017-05-29 Thread Stefán Baxter
Hi, I would like to verify that my understanding of parquet filter pushdown in Drill (https://drill.apache.org/docs/parquet-filter-pushdown/) is correct. Is it correctly understood that Drill does not support predicate push-down for string fields when dictionary based string encoding is enabled?

Re: Parquet filter pushdown and string fields that use dictionary encoding

2017-05-31 Thread Kunal Khatua
sue of correctness for comparison is what makes the dependency on min-max statistics by the Parquet library be unreliable. From: Stefán Baxter Sent: Monday, May 29, 2017 1:41:30 PM To: user Subject: Parquet filter pushdown and string fields that use dictionary encoding

Re: Parquet filter pushdown and string fields that use dictionary encoding

2017-05-31 Thread Stefán Baxter
for comparison is what makes the dependency on > min-max statistics by the Parquet library be unreliable. > > > > From: Stefán Baxter > Sent: Monday, May 29, 2017 1:41:30 PM > To: user > Subject: Parquet filter pushdown and string fields t

Re: Parquet filter pushdown and string fields that use dictionary encoding

2017-05-31 Thread Kunal Khatua
ost likely) be done during execution time, and I don't believe Drill does that as yet. <http://www.mapr.com/> From: Stefán Baxter Sent: Wednesday, May 31, 2017 5:08:23 PM To: user Subject: Re: Parquet filter pushdown and string fields that use dictio

Re: Parquet filter pushdown and string fields that use dictionary encoding

2017-05-31 Thread Jinfeng Ni
ng execution time, and I don't believe Drill does that as yet. > > > > <http://www.mapr.com/> > > > From: Stefán Baxter > Sent: Wednesday, May 31, 2017 5:08:23 PM > To: user > Subject: Re: Parquet filter pushdown and string f

Re: Parquet filter pushdown and string fields that use dictionary encoding

2017-05-31 Thread Stefán Baxter
is present in the subsequent data pages. This would (most likely) be done > > during execution time, and I don't believe Drill does that as yet. > > > > > > > > <http://www.mapr.com/> > > > > ____________ > > From: Stef