further descriptions: Environment: Spark cluster running in standalone mode with 1 master, 5 slaves, each has 4 vCPUS, 8GB RAM data is being streamed from 3 node kafka cluster (managed by 3 node zk cluster).
Checkpointing is being done at hadoop-cluster, plus we are also saving state in HBase (on top of hadoop-cluster) and recovering it while starting the streaming appplication Please find the screen shot <http://apache-spark-user-list.1001560.n3.nabble.com/file/n27201/Screen_Shot_2559-06-21_at_3.png> -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/scala-NotImplementedError-put-should-not-be-called-on-an-EmptyStateMap-while-doing-stateful-computatg-tp27200p27201.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
