Re: Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe]

Mongo libs provide a way to convert to case class On Wed 18 Jul 2018 at 20:23, Chethan wrote: > Hi Dev, > > I am streaming from mongoDB using Kafka with spark streaming, It returns > me document [org.bson.document] . I wan to convert this rdd to dataframe > to process with other data. > > Any

Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe]

Hi Dev, I am streaming from mongoDB using Kafka with spark streaming, It returns me document [org.bson.document] . I wan to convert this rdd to dataframe to process with other data. Any suggestions will be helpful. Thanks, Chethan.

Re: Pyspark access to scala/java libraries

Hi You can access your java packages using following in pySpark obj = sc._jvm.yourPackage.className() Kind Regards Harsh Takkar On Wed, Jul 18, 2018 at 4:00 AM Mohit Jaggi wrote: > Thanks 0xF0F0F0 and Ashutosh for the pointers. > > Holden, > I am trying to look into sparklingml...what am I