XiDuo You created SPARK-43420:
---------------------------------

             Summary: Make DisableUnnecessaryBucketedScan smart with table cache
                 Key: SPARK-43420
                 URL: https://issues.apache.org/jira/browse/SPARK-43420
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.5.0
            Reporter: XiDuo You


If a bucket scan has no interesting partition or contains shuffle exchange, 
then we would disable it. But If the bucket scan is inside table cache, the 
cached plan would be accessed multi-times, then we should not disable it as it 
could preserve output partitioning and more likely be reused.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to