Re: The main difference use case between orderBY and sort

2016-07-29 Thread Mich Talebzadeh
Within the realm of ANSI SQL there is ORDER BY but no SORT BY. ORDERR BY sorts the result set in ascending or descending order. In SQL sorting is the term and ORDER BY is part of the syntax. In map-reduce pragma for example in Hive QL, SORT BY sorts data per reducer. As I understand the

Re: The main difference use case between orderBY and sort

2016-07-29 Thread Daniel Santana
As far as I know *sort* is just an alias of *orderBy* (or vice-versa) And your last operation is taking longer because you are sorting it twice. -- *Daniel Santana* Senior Software Engineer EVERY*MUNDO* 25 SE 2nd Ave., Suite 900 Miami, FL 33131 USA main:+1 (305) 375-0045 EveryMundo.com

The main difference use case between orderBY and sort

2016-07-29 Thread Ashok Kumar
Hi, In Spark programing I can use df.filter(col("transactiontype") === "DEB").groupBy("transactiondate").agg(sum("debitamount").cast("Float").as("Total Debit Card")).orderBy("transactiondate").show(5) or df.filter(col("transactiontype") ===