Serge Rielau created SPARK-42399: ------------------------------------ Summary: CONV() silently overflows returning wrong results Key: SPARK-42399 URL: https://issues.apache.org/jira/browse/SPARK-42399 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.4.0 Reporter: Serge Rielau
spark-sql> SELECT CONV(SUBSTRING('0xffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff', 3), 16, 10); 18446744073709551615 Time taken: 2.114 seconds, Fetched 1 row(s) spark-sql> set spark.sql.ansi.enabled = true; spark.sql.ansi.enabled true Time taken: 0.068 seconds, Fetched 1 row(s) spark-sql> SELECT CONV(SUBSTRING('0xffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff', 3), 16, 10); 18446744073709551615 Time taken: 0.05 seconds, Fetched 1 row(s) In ANSI mode we should raise an error for sure. In non ANSI either an error or a NULL maybe be acceptable. Alternatively, of course, we could consider if we can support arbitrary domains since the result is a STRING again. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org