[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-05 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-773475101 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-05 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-773883162 thanks for the review, merging to master/3.1! This is an automated message from the Apache Git Service. To res

[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-04 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-773475101 Tests pass and it's ready for review. @rdblue @brkyvz @viirya This is an automated message from the Apache Gi

[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-03 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-772616469 My new approach doesn't work for dataframe queries, so I went back to the original approach, with some improvement to fix the perf regression. The patch is much smaller now, p

[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-02 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-771734590 cc @rdblue @brkyvz @HyukjinKwon @viirya @imback82 This is an automated message from the Apache Git Service. T

[GitHub] [spark] cloud-fan commented on pull request #31440: [SPARK-34331][SQL] Speed up DS v2 metadata col resolution

2021-02-02 Thread GitBox
cloud-fan commented on pull request #31440: URL: https://github.com/apache/spark/pull/31440#issuecomment-771734590 cc @rdblue @brkyvz @HyukjinKwon @viirya @imback82 This is an automated message from the Apache Git Service. T