caican created SPARK-38444:
------------------------------

             Summary: Automatically calculate the upper and lower bounds of 
partitions when no specified partition related params
                 Key: SPARK-38444
                 URL: https://issues.apache.org/jira/browse/SPARK-38444
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.1.2
            Reporter: caican


when access rdbms, such as mysql, if partitionColumn, lowerBound, upperBound, 
numPartitions are not specified, by default only one partition to scan database 
is working. 

It makes load data from database slow and makes it difficult for users to 
configure multiple parameters to improve parallelism.

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to