Re: filtering the correct value in Spark streaming data from Kafka

2016-04-23 Thread Mich Talebzadeh
This seems to be a solution. Just recall this is streaming prices coming in consisting of three fields as below: ID timestamp Signal 5145,20160424-000321,99.54898291795853400767 // I am only interested in the third field in the comma separated fields which I call

filtering the correct value in Spark streaming data from Kafka

2016-04-23 Thread Mich Talebzadeh
Hi, I have Spark and Kafka streaming test for CEP signal. Pretty basic set up val ssc = new StreamingContext(conf, Seconds(10)) ssc.checkpoint("checkpoint") val kafkaParams = Map[String, String]("bootstrap.servers" -> "rhes564:9092", "schema.registry.url" -> "http://rhes564:8081;,