Re: "collecting" DStream data

2016-05-15 Thread Daniel Haviv
eption. Also, you can’t update the > value of a broadcast variable, since it’s immutable. > > Thanks, > Silvio > > From: Daniel Haviv <daniel.ha...@veracity-group.com> > Date: Sunday, May 15, 2016 at 6:23 AM > To: user <user@spark.apache.org> > Subject: &qu

Re: "collecting" DStream data

2016-05-15 Thread Silvio Fiorito
6 at 6:23 AM To: user <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: "collecting" DStream data Hi, I have a DStream I'd like to collect and broadcast it's values. To do so I've created a mutable HashMap which i'm filling with foreachRDD but when I'm check

"collecting" DStream data

2016-05-15 Thread Daniel Haviv
Hi, I have a DStream I'd like to collect and broadcast it's values. To do so I've created a mutable HashMap which i'm filling with foreachRDD but when I'm checking it, it remains empty. If I use ArrayBuffer it works as expected. This is my code: val arr =