Hi, I have a series of queries to extract from multiple tables in hive and do a feature engineering on the extracted final data.. I can run queries using spark sql and use mllib to perform the feature transformation I needed. The question is do you guys use any kind of tool to perform this workflow for executing the query or is there any tool which on giving a template/JSON will construct the spark sql queries for me?
Thanks Subash