Message
Subject: Re: updateStateByKey performance API
Date: Wed, 18 Mar 2015 13:06:15 +0200
From: Nikos Viorres nvior...@gmail.com
To: Akhil Das ak...@sigmoidanalytics.com
CC: user@spark.apache.org user@spark.apache.org
Hi Akhil,
Yes, that's what we are planning on doing at the end
in context:
http://apache-spark-user-list.1001560.n3.nabble.com/updateStateByKey-performance-API-tp22113.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
as non-serialized but then i
am
worried about GC and checkpointing performance
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/updateStateByKey-performance-API-tp22113.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Hi all,
We are having a few issues with the performance of updateStateByKey
operation in Spark Streaming (1.2.1 at the moment) and any advice would be
greatly appreciated. Specifically, on each tick of the system (which is set
at 10 secs) we need to update a state tuple where the key is the
performance
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/updateStateByKey-performance-API-tp22113.html
Sent from the Apache Spark User List mailing list archive at Nabble.com