Re: Progress on Hive "Push Down Filtering"

2014-12-04 Thread James Andrew-Smith
there hasn't been much happening on this front since the > functionality is fairly restricted and not really > pluggable especially when > dealing with non-HDFS resources. The ORC support has improved things a bit > however it's still early days... > > Cheers,

Progress on Hive "Push Down Filtering"

2014-12-03 Thread James Andrew-Smith
Has there been any progress on the "Push Down Filtering" mentioned by Costin? ( http://ryrobes.com/systems/connecting-tableau-to-elasticsearch-read-how-to-query-elasticsearch-with-hive-sql-and-hadoop/#comment-1169375542 ) Right now I am working around this by creating a lot of specific table ma

Using Hadoop/Hive With Aggregations

2014-12-03 Thread James Andrew-Smith
I want to expose some aggregate SUM/MIN/MAX data from ES through to my Hive tables. Currently I have created an table which needs to scroll through all the rows and then re-aggregate these statistics in Hive. This feels very inefficient. Is it possible to create an ES query with Aggregations