Re: Spark Direct Streaming With ZK Updates

2015-08-24 Thread suchenzang
Forgot to include the PR I was referencing: https://github.com/apache/spark/pull/4805/ -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Direct-Streaming-With-ZK-Updates-tp24423p24424.html Sent from the Apache Spark User List mailing list archive

Re: Spark Direct Streaming With ZK Updates

2015-08-24 Thread Cody Koeninger
to include the PR I was referencing: https://github.com/apache/spark/pull/4805/ -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Direct-Streaming-With-ZK-Updates-tp24423p24424.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Spark Direct Streaming With ZK Updates

2015-08-24 Thread suchenzang
, osr.untilOffset.toString) } } Why would there be serialization issues when I'm not trying to pass ZkClient to any of the workers? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Direct-Streaming-With-ZK-Updates-tp24423p24432.html Sent from

Re: Spark Direct Streaming With ZK Updates

2015-08-24 Thread Cody Koeninger
not trying to pass ZkClient to any of the workers? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Direct-Streaming-With-ZK-Updates-tp24423p24432.html Sent from the Apache Spark User List mailing list archive at Nabble.com