caican created SPARK-38444: ------------------------------ Summary: Automatically calculate the upper and lower bounds of partitions when no specified partition related params Key: SPARK-38444 URL: https://issues.apache.org/jira/browse/SPARK-38444 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.1.2 Reporter: caican
when access rdbms, such as mysql, if partitionColumn, lowerBound, upperBound, numPartitions are not specified, by default only one partition to scan database is working. It makes load data from database slow and makes it difficult for users to configure multiple parameters to improve parallelism. -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org