(e, str)
> }
> })
>
> logger.info("** Total reduced count: " +
> mappedEvents.collect().length)
> }
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-var-is-null-
se {
>> val str = broadcastVar.value.mkString(" | ")
>> l.info("broadcastVar is " + str)
>> (e, str)
>> }
>> })
>>
>> logger.info("** Total reduced count: " +
>> mappedEvents.collect
This advice solved the problem: "Stop having your object extend App, and
instead give it a
main method." https://issues.apache.org/jira/browse/SPARK-4170
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-var-is-null-tp24927p24959.html
broadcastVar.value.mkString(" | ")
l.info("broadcastVar is " + str)
(e, str)
}
})
logger.info("** Total reduced count: " +
mappedEvents.collect().length)
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble
quot; +
x.collect.mkString("|")))
ssc.start()
ssc.awaitTermination()
}
Any input is very much appreciated!
Regards,
Dmitry.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabbl
(x => logger.info("Data: " +
> x.collect.mkString("|")))
>
> ssc.start()
> ssc.awaitTermination()
> }
>
> Any input is very much appreciated!
>
> Regards,
> Dmitry.
>
>
>
>
>
>
>
> --
> View this message in
println("broadcastVar is null")
>> } else {
>> println("broadcastVar value: " + broadcastVar.value.mkString("|"))
>> }
>> x
>&