[ https://issues.apache.org/jira/browse/SPARK-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-3587: ----------------------------------- Component/s: SQL > Spark SQL can't support lead() over() window function > ----------------------------------------------------- > > Key: SPARK-3587 > URL: https://issues.apache.org/jira/browse/SPARK-3587 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.0.2, 1.1.0 > Environment: operator system is suse 11.3, three node ,every node has > 48GB MEM and 16 CPU > Reporter: caoli > Original Estimate: 504h > Remaining Estimate: 504h > > When run the following SQL: > "select c.plateno, c.platetype,c.bay_id as start_bay_id,c.pastkkdate as > start_time,lead(c.bay_id) over(partition by c.plateno order by c.pastkkdate) > as end_bay_id, lead(c.pastkkdate) over(partition by c.plateno order by > c.pastkkdate) as end_time from bay_car_test1 c" > ----in HIVE, it is OK, > -----but run in Spark SQL with HiveContext, it is error with: > java.lang.RuntimeException: > Unsupported language features in query: select c.plateno, > c.platetype,c.bay_id as start_bay_id,c.pastkkdate as > start_time,lead(c.bay_id) over(partition by c.plateno order by c.pastkkdate) > as end_bay_id, lead(c.pastkkdate) over(partition by c.plateno order by > c.pastkkdate) as end_time from bay_car_test1 c > TOK_QUERY > is Spark SQLcan't support lead() and over() function? -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org