Re: Question about Bloom Filter in Spark 2.0

2016-06-22 Thread BaiRan
gt; SPARK-12818 is about building a bloom filter on existing data. It has nothing > to do with the ORC bloom filter, which can be used to do predicate pushdown. > > > On Tue, Jun 21, 2016 at 7:45 PM, BaiRan <liz...@icloud.com > <mailto:liz...@icloud.com>> wrote: &g

Question about Bloom Filter in Spark 2.0

2016-06-21 Thread BaiRan
Hi all, I have a question about bloom filter implementation in Spark-12818 issue. If I have a ORC file with bloom filter metadata, how can I utilise it by Spark SQL? Thanks. Best, Ran