liuxian created SPARK-23358: ------------------------------- Summary: When the number of partitions is greater than 2^28, it will result in an error result Key: SPARK-23358 URL: https://issues.apache.org/jira/browse/SPARK-23358 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.4.0 Reporter: liuxian
In the `checkIndexAndDataFile`,the `blocks` is the ` Int` type, when it is greater than 2^28, `blocks*8` will overflow, and this will result in an error result. In fact, `blocks` is actually the number of partitions. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org