If your using this from Java you might find it easier to construct a JavaSparkContext, the broadcast function will automatically use a fake class tag.
On Sun, Aug 7, 2016 at 11:57 PM, Aseem Bansal <asmbans...@gmail.com> wrote: > I am using the following to broadcast and it explicitly requires classtag > > sparkSession.sparkContext().broadcast > > On Mon, Aug 8, 2016 at 12:09 PM, Holden Karau <hol...@pigscanfly.ca> > wrote: > >> Classtag is Scala concept (see http://docs.scala-lang.or >> g/overviews/reflection/typetags-manifests.html) - although this should >> not be explicitly required - looking at http://spark.apache.org/doc >> s/latest/api/scala/index.html#org.apache.spark.SparkContext we can see >> that in Scala the classtag tag is implicit and if your calling from Java >> http://spark.apache.org/docs/latest/api/scala/index.htm >> l#org.apache.spark.api.java.JavaSparkContext the classtag doesn't need >> to be specified (instead it uses a "fake" class tag automatically for you). >> Where are you seeing the different API? >> >> On Sun, Aug 7, 2016 at 11:32 PM, Aseem Bansal <asmbans...@gmail.com> >> wrote: >> >>> Earlier for broadcasting we just needed to use >>> >>> sparkcontext.broadcast(objectToBroadcast) >>> >>> But now it is >>> >>> sparkcontext.broadcast(objectToBroadcast, classTag) >>> >>> What is classTag here? >>> >> >> >> >> -- >> Cell : 425-233-8271 >> Twitter: https://twitter.com/holdenkarau >> > > -- Cell : 425-233-8271 Twitter: https://twitter.com/holdenkarau
