Spark Jobs not getting shown in Spark UI browser

2016-07-26 Thread Prashant verma
Hi All, I have recently started using Spark 1.6.2 for running my spark jobs. But now my jobs are not getting shown in the spark browser UI, even though the job is running fine which i can see in shell output. Any suggestions. Thanks, Prashant Verma

Restarting Spark Streaming Job periodically

2016-07-24 Thread Prashant verma
Hi All, I want to restart my spark streaming job periodically after every 15 mins using JAVA. Is it possible and if yes, how should i proceed. Thanks, Prashant

RE: Dataframes

2016-02-11 Thread Prashant Verma
Hi Gaurav, You can try something like this. SparkConf conf = new SparkConf(); JavaSparkContext sc = new JavaSparkContext(conf); SQLContext sqlContext = new org.apache.spark.sql.SQLContext(sc); Class.forName("com.mysql.jdbc.Driver"); String url="url"; Properties prop = new