subject:"\[GitHub\] \[spark\] VindhyaG commented on pull request #40462\: \[SPARK\-42832\]\[SQL\] Remove repartition if it is the child of LocalLimit"

[GitHub] [spark] VindhyaG commented on pull request #40462: [SPARK-42832][SQL] Remove repartition if it is the child of LocalLimit

2023-03-22 Thread via GitHub

VindhyaG commented on PR #40462: URL: https://github.com/apache/spark/pull/40462#issuecomment-1479847214 > > Can you please explain more on scenarios when rebalancepartitions becomes child of locallimit? i tried SELECT * FROM t WHERE id > 1 LIMIT 5; with spark 2.4.4 version and rebalancepar

[GitHub] [spark] VindhyaG commented on pull request #40462: [SPARK-42832][SQL] Remove repartition if it is the child of LocalLimit

2023-03-18 Thread via GitHub

VindhyaG commented on PR #40462: URL: https://github.com/apache/spark/pull/40462#issuecomment-1474925826 Can you please explain more on scenarios when rebalancepartitions becomes child of locallimit? i tried SELECT * FROM t WHERE id > 1 LIMIT 5; with spark 2.4.4 version and rebalancep