[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-8324: ----------------------------------- Target Version/s: (was: 1.4.0) > Register Query as view through JDBC interface > --------------------------------------------- > > Key: SPARK-8324 > URL: https://issues.apache.org/jira/browse/SPARK-8324 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 1.4.0 > Reporter: Mayoor Rao > Labels: features > Attachments: Jira_request_register_query_as_view.docx > > > We currently have capability of adding csv, json, parquet, etc files as table > through beeline using Datasource API. We need a mechanism to register a > complex queries as a table through jdbc interface. The query definition could > be composed using the table names which are again registered as spark tables > using datasource API. > The query definition should be persisted and should have an option to > re-register when the thriftserver is restarted. > The sql command should be able to either take a filename which contains the > json content or it should take the json content directly. > There should be an option to save the output of the queries and register the > output as table. > Advantage > • Create adhoc join statements across different data-sources using Spark > from external BI interface. So no persistence of pre-aggregated needed. > • No dependency of creation of programs to generate adhoc analytics > • Enable business users to model the data across diverse data sources in > real time without any programming > • Enable persistence of the query output through jdbc interface. No extra > programming required. > SQL Syntax for registering a set of queries or files as table - > REGISTERSQLJOB USING FILE/JSON <FILENAME/JSONContent> -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org