Returns Null when reading data from XML Ask Question

2018-02-27 Thread Sateesh Karuturi
I am trying to Parsing the data from XML file through Spark using databrics library Here is my code: import org.apache.spark.SparkConfimport org.apache.spark.SparkContextimport org.apache.spark.sql.SQLContextimport org.apache.spark.sql.functionsimport java.text.Formatimport

access Broadcast Variables in Spark java

2016-12-20 Thread Sateesh Karuturi
I need to process spark Broadcast variables using Java RDD API. This is my code what i have tried so far: This is only sample code to check whether its works or not? In my case i need to work on two csvfiles. SparkConf conf = new SparkConf().setAppName("BroadcastVariable").setMaster("local");

Getting empty values while receiving from kafka Spark streaming

2016-09-18 Thread Sateesh Karuturi
i am very new to *Spark streaming* and i am implementing small exercise like sending *XML* data from *kafka* and need to receive that *streaming* data through *spark streaming.* I tried in all possible ways.. but every time i am getting *empty values.* *There is no problem in Kafka side, only

Spark Streaming from existing RDD

2016-01-29 Thread Sateesh Karuturi
Anyone please help me out how to create a DStream from existing RDD. My code is: JavaSparkContext ctx = new JavaSparkContext(conf);JavaRDD rddd = ctx.parallelize(arraylist); Now i need to use these *rddd* as input to *JavaStreamingContext*.

Stream S3 server to Cassandra

2016-01-28 Thread Sateesh Karuturi
Hello Anyone... please help me to how to Stream the XML files from S3 server to cassandra db using Spark Streaming java. presently iam using Spark core to do that job..but problem is i have to to run for every 15 mints.. thats why iam looking for Spark Streaming.

how to fetch all of data from hbase table in spark java

2015-12-18 Thread Sateesh Karuturi
Hello experts... i am new to spark, anyone please explain me how to fetch data from hbase table in spark java Thanks in Advance...

flatMap function in Spark

2015-12-08 Thread Sateesh Karuturi
Guys... I am new to Spark.. Please anyone please explain me how flatMap function works with a little sample example... Thanks in advance...

RDD functions

2015-12-04 Thread Sateesh Karuturi
Hello Spark experts... Iam new to Apache Spark..Can anyone send me the proper Documentation to learn RDD functions. Thanks in advance...

[no subject]

2015-12-04 Thread Sateesh Karuturi
user-sc.1449231970.fbaoamghkloiongfhbbg-sateesh.karuturi9= gmail@spark.apache.org