ulysses you created SPARK-35005: ----------------------------------- Summary: Improve error msg if UTF8String concatWs over int length Key: SPARK-35005 URL: https://issues.apache.org/jira/browse/SPARK-35005 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.2.0 Reporter: ulysses you
We encounter a very extreme case with expression `concat_ws`, and the error msg is {code:java} Caused by: java.lang.NegativeArraySizeException at org.apache.spark.unsafe.types.UTF8String.concatWs {code} Seems the `UTF8String.concat` has already done the length check, so it's better to add in `concatWs`. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org