Prem sure, Thanks for suggestion. On Wed, Jul 4, 2018 at 8:38 PM, Prem Sure <sparksure...@gmail.com> wrote:
> try .pipe(.py) on RDD > > Thanks, > Prem > > On Wed, Jul 4, 2018 at 7:59 PM, Chetan Khatri <chetan.opensou...@gmail.com > > wrote: > >> Can someone please suggest me , thanks >> >> On Tue 3 Jul, 2018, 5:28 PM Chetan Khatri, <chetan.opensou...@gmail.com> >> wrote: >> >>> Hello Dear Spark User / Dev, >>> >>> I would like to pass Python user defined function to Spark Job developed >>> using Scala and return value of that function would be returned to DF / >>> Dataset API. >>> >>> Can someone please guide me, which would be best approach to do this. >>> Python function would be mostly transformation function. Also would like to >>> pass Java Function as a String to Spark / Scala job and it applies to RDD / >>> Data Frame and should return RDD / Data Frame. >>> >>> Thank you. >>> >>> >>> >>> >
