Hi, I do not think that SPARK will automatically determine the partitions. Actually it does not automatically determine the partitions. In case a table has a few million records, it all goes through the driver.
Ofcourse, I have only tried JDBC connections in AURORA, Oracle and Postgres. Regards, Gourav Sengupta On Tue, Oct 10, 2017 at 10:14 PM, weand <andreas.we...@gmail.com> wrote: > Is Hive from Spark via JDBC working for you? In case it does, I would be > interested in your setup :-) > > We can't get this working. See bug here, especially my last comment: > https://issues.apache.org/jira/browse/SPARK-21063 > > Regards > Andreas > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
