[
https://issues.apache.org/jira/browse/SPARK-16837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom Magrino updated SPARK-16837:
--------------------------------
Description:
Right now, the constructors for the TimeWindow expression in Catalyst
incorrectly uses the windowDuration in place of the slideDuration. This will
cause incorrect windowing semantics after time window expressions are analyzed
by Catalyst.
Relevant code is here:
https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54
was:
Right now, the constructors for the TimeWindow expression in Catalyst
incorrectly uses the windowDuration in place of the slideDuration. This will
cause incorrect windowing semantics the after time window expressions are
analyzed by Catalyst.
Relevant code is here:
https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54
> TimeWindow incorrectly drops slideDuration in constructors
> ----------------------------------------------------------
>
> Key: SPARK-16837
> URL: https://issues.apache.org/jira/browse/SPARK-16837
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Tom Magrino
>
> Right now, the constructors for the TimeWindow expression in Catalyst
> incorrectly uses the windowDuration in place of the slideDuration. This will
> cause incorrect windowing semantics after time window expressions are
> analyzed by Catalyst.
> Relevant code is here:
> https://github.com/apache/spark/blob/branch-2.0/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala#L29-L54
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
