[
https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299657#comment-14299657
]
Tor Myklebust edited comment on SPARK-5472 at 1/31/15 4:12 AM:
---------------------------------------------------------------
You appear to understand the issue perfectly. You have to write the case class
mapper, work out the schema, and register the thing as a temporary table. Once
you've done all that for one table, you have to do something rather similar for
the next table you want to load. And all this work requires Scala coding
rather than a short SQL query. This is more complexity for the user than the
problem really deserves, and it appears to be easy to automate in a reasonably
transparent way.
was (Author: tmyklebu):
You appear to understand the issue perfectly. You have to write the case class
mapper, work out the schema, and register the thing as a temporary table. Once
you've done all that for one table, you have to do something rather similar for
the next table you want to load. And all this work requires Scala coding
rather than a short SQL query. This is more complexity for the user than the
problem really deserves.
> Add support for reading from and writing to a JDBC database
> -----------------------------------------------------------
>
> Key: SPARK-5472
> URL: https://issues.apache.org/jira/browse/SPARK-5472
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Tor Myklebust
> Assignee: Tor Myklebust
> Priority: Blocker
>
> It would be nice to be able to make a table in a JDBC database appear as a
> table in Spark SQL. This would let users, for instance, perform a JOIN
> between a DataFrame in Spark SQL with a table in a Postgres database.
> It might also be nice to be able to go the other direction -- save a
> DataFrame to a database -- for instance in an ETL job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
