try .pipe(.py) on RDD Thanks, Prem
On Wed, Jul 4, 2018 at 7:59 PM, Chetan Khatri <chetan.opensou...@gmail.com> wrote: > Can someone please suggest me , thanks > > On Tue 3 Jul, 2018, 5:28 PM Chetan Khatri, <chetan.opensou...@gmail.com> > wrote: > >> Hello Dear Spark User / Dev, >> >> I would like to pass Python user defined function to Spark Job developed >> using Scala and return value of that function would be returned to DF / >> Dataset API. >> >> Can someone please guide me, which would be best approach to do this. >> Python function would be mostly transformation function. Also would like to >> pass Java Function as a String to Spark / Scala job and it applies to RDD / >> Data Frame and should return RDD / Data Frame. >> >> Thank you. >> >> >> >>
