Re: Broadcast var is null

2015-10-06 Thread Nick Peterson
(e, str) > } > }) > > logger.info("** Total reduced count: " + > mappedEvents.collect().length) > } > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-var-is-null-

Re: Broadcast var is null

2015-10-06 Thread Sean Owen
se { >> val str = broadcastVar.value.mkString(" | ") >> l.info("broadcastVar is " + str) >> (e, str) >> } >> }) >> >> logger.info("** Total reduced count: " + >> mappedEvents.collect

Re: Broadcast var is null

2015-10-06 Thread dpristin
This advice solved the problem: "Stop having your object extend App, and instead give it a main method." https://issues.apache.org/jira/browse/SPARK-4170 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-var-is-null-tp24927p24959.html

Re: Broadcast var is null

2015-10-06 Thread dpristin
broadcastVar.value.mkString(" | ") l.info("broadcastVar is " + str) (e, str) } }) logger.info("** Total reduced count: " + mappedEvents.collect().length) } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble

Re: Broadcast var is null

2015-10-05 Thread Adrian Tanase
quot; + x.collect.mkString("|"))) ssc.start() ssc.awaitTermination() } Any input is very much appreciated! Regards, Dmitry. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabbl

Re: Broadcast var is null

2015-10-05 Thread Tathagata Das
(x => logger.info("Data: " + > x.collect.mkString("|"))) > > ssc.start() > ssc.awaitTermination() > } > > Any input is very much appreciated! > > Regards, > Dmitry. > > > > > > > > -- > View this message in

Re: Broadcast var is null

2015-10-05 Thread Dmitry Pristin
println("broadcastVar is null") >> } else { >> println("broadcastVar value: " + broadcastVar.value.mkString("|")) >> } >> x >&