PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

Hi, I've been playing with the expiramental PairDStreamFunctions.mapWithState feature and I've seem to have stumbled across a bug, and was wondering if anyone else has been seeing this behavior. I've opened up an issue in the Spark JIRA, I simply want to pass this along in case anyone else is

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

Let me know if you do need a pull request for this, I can make that happen (given someone does a vast PR to make sure I'm understanding this problem right). On Thu, Feb 4, 2016 at 8:21 PM, Shixiong(Ryan) Zhu wrote: > Thanks for reporting it. I will take a look. > > On

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

Shixiong has already opened the PR - https://github.com/apache/spark/pull/11081 On Thu, Feb 4, 2016 at 11:11 AM, Yuval Itzchakov wrote: > Let me know if you do need a pull request for this, I can make that happen > (given someone does a vast PR to make sure I'm understanding

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

Awesome. Thanks for the super fast reply. On Thu, Feb 4, 2016, 21:16 Tathagata Das wrote: > Shixiong has already opened the PR - > https://github.com/apache/spark/pull/11081 > > On Thu, Feb 4, 2016 at 11:11 AM, Yuval Itzchakov > wrote: > >> Let

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

Thanks for reporting it. I will take a look. On Thu, Feb 4, 2016 at 6:56 AM, Yuval.Itzchakov wrote: > Hi, > I've been playing with the expiramental PairDStreamFunctions.mapWithState > feature and I've seem to have stumbled across a bug, and was wondering if > anyone else has

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

i think we need to add port http://serverfault.com/questions/317903/aws-ec2-open-port-8080 do u remember doing anything like this earlier for aws 1 On Fri, Feb 5, 2016 at 1:07 AM, Yuval Itzchakov wrote: > Awesome. Thanks for the super fast reply. > > > On Thu, Feb 4, 2016,

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

http://coenraets.org/blog/2011/11/set-up-an-amazon-ec2-instance-with-tomcat-and-mysql-5-minutes-tutorial/ The default Tomcat server uses port 8080. You need to open that port on your instance to make sure your Tomcat server is available on the Web (you could also change the default port). In the

Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S]

I am sorry for spam, I replied in wrong thread sleepy head :-( On Fri, Feb 5, 2016 at 1:15 AM, Sachin Aggarwal wrote: > > http://coenraets.org/blog/2011/11/set-up-an-amazon-ec2-instance-with-tomcat-and-mysql-5-minutes-tutorial/ > > The default Tomcat server uses port