Re: Windows operation orderBy desc

2016-08-24 Thread Selvam Raman
Hi all, i am using window function to find out the latest record using row_number; the hive table is partitioned. when i run the function it runs for 545. what is the reason for 545 task. Thanks, selvam R On Mon, Aug 1, 2016 at 8:09 PM, Mich Talebzadeh wrote: >

Re: Windows operation orderBy desc

2016-08-01 Thread Mich Talebzadeh
You need to get the position right val wSpec = Window.partitionBy("col1").orderBy(desc("col2")) HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Windows operation orderBy desc

2016-08-01 Thread Ashok Kumar
Hi, in the following Window spec I want orderBy ("") to be displayed in descending order please val W = Window.partitionBy("col1").orderBy("col2") If I Do val W = Window.partitionBy("col1").orderBy("col2".desc) It throws error console>:26: error: value desc is not a member of String How can I