Analyzing json Data streams using sparkSQL in spark streaming returns java.lang.ClassNotFoundException

2016-03-08 Thread Nesrine BEN MUSTAPHA
Hello, I tried to use sparkSQL to analyse json data streams within a standalone application. here the code snippet that receive the streaming data: *final JavaReceiverInputDStream lines = streamCtx.socketTextStream("localhost", Integer.parseInt(args[0]), StorageLevel.MEMORY_AND_DISK_SER_2());*

local class incompatible: stream classdesc

2016-03-01 Thread Nesrine BEN MUSTAPHA
Hi, I installed a standalone spark cluster with two workers. I developed a Java Application that use the maven dependency of spark (same version as the spark cluster). In my class Spark jobs I have only two methods considered as two different jobs: the first one is the example of spark word