I am testing this in spark-shell. I am following the Spark documentation by simply adding the PostgreSQL driver to the Spark Classpath.
SPARK_CLASSPATH=/path/to/postgresql/driver spark-shell Then, I run the code below to connect to the PostgreSQL database to query. This is when I have problems. Thanks, Ben > On Sep 16, 2016, at 3:29 PM, Nikolay Zhebet <phpap...@gmail.com> wrote: > > Hi! Can you split init code with current comand? I thing it is main problem > in your code. > > 16 сент. 2016 г. 8:26 PM пользователь "Benjamin Kim" <bbuil...@gmail.com > <mailto:bbuil...@gmail.com>> написал: > Has anyone using Spark 1.6.2 encountered very slow responses from pulling > data from PostgreSQL using JDBC? I can get to the table and see the schema, > but when I do a show, it takes very long or keeps timing out. > > The code is simple. > > val jdbcDF = sqlContext.read.format("jdbc").options( > Map("url" -> > "jdbc:postgresql://dbserver:port/database?user=user&password=password", > "dbtable" -> “schema.table")).load() > > jdbcDF.show > > If anyone can help, please let me know. > > Thanks, > Ben >
