I am using the following to broadcast and it explicitly requires classtag sparkSession.sparkContext().broadcast
On Mon, Aug 8, 2016 at 12:09 PM, Holden Karau <hol...@pigscanfly.ca> wrote: > Classtag is Scala concept (see http://docs.scala-lang. > org/overviews/reflection/typetags-manifests.html) - although this should > not be explicitly required - looking at http://spark.apache.org/ > docs/latest/api/scala/index.html#org.apache.spark.SparkContext we can see > that in Scala the classtag tag is implicit and if your calling from Java > http://spark.apache.org/docs/latest/api/scala/index. > html#org.apache.spark.api.java.JavaSparkContext the classtag doesn't need > to be specified (instead it uses a "fake" class tag automatically for you). > Where are you seeing the different API? > > On Sun, Aug 7, 2016 at 11:32 PM, Aseem Bansal <asmbans...@gmail.com> > wrote: > >> Earlier for broadcasting we just needed to use >> >> sparkcontext.broadcast(objectToBroadcast) >> >> But now it is >> >> sparkcontext.broadcast(objectToBroadcast, classTag) >> >> What is classTag here? >> > > > > -- > Cell : 425-233-8271 > Twitter: https://twitter.com/holdenkarau >
