RowNumber in HiveContext returns null or negative values

Hi all, would this be a bug?? val ws = Window. partitionBy("clrty_id"). orderBy("filemonth_dtt") val nm = "repeatMe" df.select(df.col("*"), rowNumber().over(ws).cast("int").as(nm))

Re: RowNumber in HiveContext returns null or negative values

Which version of Spark? On Thu, Oct 8, 2015 at 7:25 AM, wrote: > Hi all, would this be a bug?? > > val ws = Window. > partitionBy("clrty_id"). > orderBy("filemonth_dtt") > > val nm = "repeatMe" >

RE: RowNumber in HiveContext returns null or negative values

Hi, thanks for looking into. v1.5.1. I am really worried. I dont have hive/hadoop for real in the environment. Saif From: Michael Armbrust [mailto:mich...@databricks.com] Sent: Thursday, October 08, 2015 2:57 PM To: Ellafi, Saif A. Cc: user Subject: Re: RowNumber in HiveContext returns null

RE: RowNumber in HiveContext returns null or negative values

...@databricks.com Cc: user@spark.apache.org Subject: RE: RowNumber in HiveContext returns null or negative values Hi, thanks for looking into. v1.5.1. I am really worried. I dont have hive/hadoop for real in the environment. Saif From: Michael Armbrust [mailto:mich...@databricks.com] Sent: Thursday

RE: RowNumber in HiveContext returns null or negative values

08, 2015 3:01 PM To: mich...@databricks.com Cc: user@spark.apache.org Subject: RE: RowNumber in HiveContext returns null or negative values Hi, thanks for looking into. v1.5.1. I am really worried. I dont have hive/hadoop for real in the environment. Saif From: Michael Armbrust [mailto:mich

Re: RowNumber in HiveContext returns null or negative values

with HiveContext + cluster mode. > > > > Saif > > > > *From:* saif.a.ell...@wellsfargo.com [mailto:saif.a.ell...@wellsfargo.com] > > *Sent:* Thursday, October 08, 2015 3:01 PM > *To:* mich...@databricks.com > *Cc:* user@spark.apache.org > *Subject:* RE: R