Re: JdbcRDD and ClassTag issue

2015-07-20 Thread nitinkalra2000
Thanks Sujee :) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/JdbcRDD-and-ClassTag-issue-tp18570p23912.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To

Apache Spark : spark.eventLog.dir on Windows Environment

2015-07-20 Thread nitinkalra2000
Hi All, I am working on Spark 1.4 on windows environment. I have to set eventLog directory so that I can reopen the Spark UI after application has finished. But I am not able to set eventLog.dir, It gives an error on Windows environment. Configuation is : entry key=spark.eventLog.enabled

Debugging Apache Spark clustered application from Eclipse

2015-06-24 Thread nitinkalra2000
I am trying to debug Spark application running on eclipse in clustered/distributed environment but not able to succeed. Application is java based and I am running it through Eclipse. Configurations to spark for Master/worker is provided through Java only. Though I can debug the code on driver

Spark and insertion into RDBMS/NoSQL

2014-11-12 Thread nitinkalra2000
Hi All, We are exploring insertion into RDBMS(SQL Server) through Spark by JDBC Driver. The excerpt from the code is as follows : We are doing insertion inside an action : Integer res = flatMappedRDD.reduce(new Function2Integer,Integer,Integer(){

JdbcRDD and ClassTag issue

2014-11-11 Thread nitinkalra2000
Hi All, I am trying to access SQL Server through JdbcRDD. But getting error on ClassTag place holder. Here is the code which I wrote public void readFromDB() { String sql = Select * from Table_1 where values = ? and values = ?;