Can you please quantify the difference and provide the query code?
On Fri, Mar 29, 2019 at 9:11 AM neeraj bhadani
wrote:
> Hi Team,
>I am executing same spark code using the Spark SQL API and DataFrame
> API, however, Spark SQL is taking longer than expected.
>
> PFB Sudo code.
>
>
i found jira that seems related:
https://issues.apache.org/jira/browse/SPARK-25047
On Fri, Mar 29, 2019 at 4:01 PM Koert Kuipers wrote:
> hi all,
> we are switching from scala 2.11 to 2.12 with a spark 2.4.1 release
> candidate and so far this has been going pretty smoothly.
>
> however we do
