[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580521#comment-17580521 ]
Apache Spark commented on SPARK-39184: -------------------------------------- User 'bersprockets' has created a pull request for this issue: https://github.com/apache/spark/pull/37542 > ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones > ------------------------------------------------------------------------------ > > Key: SPARK-39184 > URL: https://issues.apache.org/jira/browse/SPARK-39184 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.3, 3.2.1, 3.3.0, 3.4.0 > Reporter: Bruce Robbins > Assignee: Bruce Robbins > Priority: Major > Fix For: 3.4.0, 3.3.1, 3.2.3 > > > The following query gets an {{ArrayIndexOutOfBoundsException}} when run from > the {{America/Los_Angeles}} time-zone: > {noformat} > spark-sql> select sequence(timestamp'2022-03-13 00:00:00', > timestamp'2022-03-16 03:00:00', interval 1 day 1 hour) as x; > 22/05/13 14:47:27 ERROR SparkSQLDriver: Failed in [select > sequence(timestamp'2022-03-13 00:00:00', timestamp'2022-03-16 03:00:00', > interval 1 day 1 hour) as x] > java.lang.ArrayIndexOutOfBoundsException: 3 > {noformat} > In fact, any such query will get an {{ArrayIndexOutOfBoundsException}} if the > start-stop period in your time-zone includes more instances of "spring > forward" than instances of "fall back" and the start-stop period is evenly > divisible by the interval. > In the {{America/Los_Angeles}} time-zone, examples include: > {noformat} > -- This query encompasses 2 instances of "spring forward" but only one > -- instance of "fall back". > select sequence( > timestamp'2022-03-13', > timestamp'2022-03-13' + (interval '42' hours * 209), > interval '42' hours) as x; > {noformat} > {noformat} > select sequence( > timestamp'2022-03-13', > timestamp'2022-03-13' + (interval '31' hours * 11), > interval '31' hours) as x; > {noformat} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org