[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788157#comment-17788157 ] Gera Shegalov commented on SPARK-44973: --- 3.0.3 is the oldest version on my box and it exhibits the same bug: {code:java} scala> spark.version res1: String = 3.0.3 scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false) java.lang.ArrayIndexOutOfBoundsException: -1 at org.apache.spark.sql.catalyst.util.NumberConverter$.convert(NumberConverter.scala:148) at org.apache.spark.sql.catalyst.expressions.Conv.nullSafeEval(mathExpressions.scala:338) at org.apache.spark.sql.catalyst.expressions.TernaryExpression.eval(Expression.scala:690) at org.apache.spark.sql.catalyst.expressions.UnaryExpression.eval(Expression.scala:457) {code} > CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException > -- > > Key: SPARK-44973 > URL: https://issues.apache.org/jira/browse/SPARK-44973 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.3, 3.4.1, 3.5.0 >Reporter: Gera Shegalov >Priority: Major > Labels: pull-request-available > > {code:scala} > scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false) > java.lang.ArrayIndexOutOfBoundsException: -1 > at > org.apache.spark.sql.catalyst.util.NumberConverter$.convert(NumberConverter.scala:183) > at > org.apache.spark.sql.catalyst.expressions.Conv.nullSafeEval(mathExpressions.scala:463) > at > org.apache.spark.sql.catalyst.expressions.TernaryExpression.eval(Expression.scala:821) > at > org.apache.spark.sql.catalyst.expressions.ToPrettyString.eval(ToPrettyString.scala:57) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.org$apache$spark$sql$catalyst$optimizer$ConstantFolding$$constantFolding(expressions.scala:81) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.$anonfun$constantFolding$4(expressions.scala:91) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17787619#comment-17787619 ] Mark Jarvin commented on SPARK-44973: - I believe it's affected back to 3.3.1: [https://github.com/apache/spark/blob/v3.3.1/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/NumberConverter.scala#L131] > CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException > -- > > Key: SPARK-44973 > URL: https://issues.apache.org/jira/browse/SPARK-44973 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.3, 3.4.1, 3.5.0 >Reporter: Gera Shegalov >Priority: Major > Labels: pull-request-available > > {code:scala} > scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false) > java.lang.ArrayIndexOutOfBoundsException: -1 > at > org.apache.spark.sql.catalyst.util.NumberConverter$.convert(NumberConverter.scala:183) > at > org.apache.spark.sql.catalyst.expressions.Conv.nullSafeEval(mathExpressions.scala:463) > at > org.apache.spark.sql.catalyst.expressions.TernaryExpression.eval(Expression.scala:821) > at > org.apache.spark.sql.catalyst.expressions.ToPrettyString.eval(ToPrettyString.scala:57) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.org$apache$spark$sql$catalyst$optimizer$ConstantFolding$$constantFolding(expressions.scala:81) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.$anonfun$constantFolding$4(expressions.scala:91) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17787454#comment-17787454 ] Dongjoon Hyun commented on SPARK-44973: --- I added 3.3.3 to the `Affected Version`. {code} scala> spark.version res1: String = 3.3.3 scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false) java.lang.ArrayIndexOutOfBoundsException: -1 {code} > CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException > -- > > Key: SPARK-44973 > URL: https://issues.apache.org/jira/browse/SPARK-44973 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.3.3, 3.4.1, 3.5.0 >Reporter: Gera Shegalov >Priority: Major > Labels: pull-request-available > > {code:scala} > scala> sql(s"SELECT CONV('${Long.MinValue}', 10, -2)").show(false) > java.lang.ArrayIndexOutOfBoundsException: -1 > at > org.apache.spark.sql.catalyst.util.NumberConverter$.convert(NumberConverter.scala:183) > at > org.apache.spark.sql.catalyst.expressions.Conv.nullSafeEval(mathExpressions.scala:463) > at > org.apache.spark.sql.catalyst.expressions.TernaryExpression.eval(Expression.scala:821) > at > org.apache.spark.sql.catalyst.expressions.ToPrettyString.eval(ToPrettyString.scala:57) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.org$apache$spark$sql$catalyst$optimizer$ConstantFolding$$constantFolding(expressions.scala:81) > at > org.apache.spark.sql.catalyst.optimizer.ConstantFolding$.$anonfun$constantFolding$4(expressions.scala:91) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org