Re: Lucene Plugin :: Join Filter and pushdown

2016-01-15 Thread Stefán Baxter
Hi, I would be more than happy to pay for this support if someone renders professional services in this area and is willing to assist us in getting this going. What Drill reader/plugins currently support joins based on filters/indexes that I can study? Regards, -Stefan On Thu, Jan 14, 2016 a

Re: Lucene Plugin :: Join Filter and pushdown

2016-01-14 Thread rahul challapalli
Use Case : In the case of a left join between a non-index table and a lucene index, it is more efficient to read the join keys from the non-index table and push them into the LuceneGroupScan. This way we can avoid reading the whole index. I was suggesting converting the plan for Q1 into a plan simi

Lucene Plugin :: Join Filter and pushdown

2016-01-14 Thread Stefán Baxter
Hi, I'm working on the Lucene plugin (see previous email) and the focus now is support for joins with filter push-down to avoid the default table scan that is provided by default. I'm fairly new to Drill and in over my head, to be honest, but this is fun and with this addition the Lucene plugin c