I have been working on a project, tentatively called Q4A (Query for
Accumulo). Another possible name is ASQ (Accumulo Streaming Query) [discus].
This is a streaming query as the query is completed via a stream, should
never group data in memory. To batch, intermediate results would be written
Andrew,
Have you considered leveraging existing SQL query layers like Hive or
Spark's SQL/DataFrames API? There are some pretty massive optimizations
involved in that API making the push-down predicates / selections pretty
easy to adapt for Accumulo.
On Mon, Apr 27, 2015 at 8:37 PM, Andrew Wells
I'm always looking for places to help out and integrate/share designs
ideas. I look forward to chatting with you about Q4A at the hackathon
tomorrow!
Have you, by chance, seen the Spark SQL adapter for the Accumulo Recipes
Event Entity Stores [1]? At the very least, it's a good example of using
Andrew,
This is a cool thing to work on, I hope you have great success!
A couple of questions about the motivations behind this, if you don't mind -
- There are several SQL implementations already in the Hadoop ecosystem. In
what ways do you expect this to improve upon
