Re: [PySpark] [SparkR] Is it possible to invoke a PySpark function with a SparkR DataFrame?

2019-07-16 Thread Felix Cheung
: Monday, July 15, 2019 6:58:32 AM To: user@spark.apache.org Subject: [PySpark] [SparkR] Is it possible to invoke a PySpark function with a SparkR DataFrame? Hi all, Forgive this naïveté, I’m looking for reassurance from some experts! In the past we created a tailored Spark library for our

[PySpark] [SparkR] Is it possible to invoke a PySpark function with a SparkR DataFrame?

2019-07-15 Thread Fiske, Danny
Hi all, Forgive this naïveté, I'm looking for reassurance from some experts! In the past we created a tailored Spark library for our organisation, implementing Spark functions in Scala with Python and R "wrappers" on top, but the focus on Scala has alienated our analysts/statisticians/data