[GitHub] [spark] dongjoon-hyun opened a new pull request #31912: [SPARK-34811][CORE] Redact fs.s3a.access.key like secret and token

2021-03-20 Thread GitBox
dongjoon-hyun opened a new pull request #31912: URL: https://github.com/apache/spark/pull/31912 ### What changes were proposed in this pull request? Like we redact secrets and tokens, this PR aims to redact access key. ### Why are the changes needed? ### Does thi

[GitHub] [spark] SparkQA commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
SparkQA commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803522439 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40881/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
SparkQA commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803521816 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40881/ -- This is an automated message from the Apache

[GitHub] [spark] tanelk commented on pull request #31907: [SPARK-34807][SQL] Move TransposeWindow before Operator push down

2021-03-20 Thread GitBox
tanelk commented on pull request #31907: URL: https://github.com/apache/spark/pull/31907#issuecomment-803521361 @wangyum, I'll answer your question (https://github.com/apache/spark/pull/31677#pullrequestreview-616975279) here. Just to clarify - the #31677 does not fix the issue, you are

[GitHub] [spark] c21 commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
c21 commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803520810 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803519860 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136291/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803519860 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136291/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803499228 **[Test build #136291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136291/testReport)** for PR 31908 at commit [`7aa7e69`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803519703 **[Test build #136291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136291/testReport)** for PR 31908 at commit [`7aa7e69`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803514644 **[Test build #136298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136298/testReport)** for PR 31911 at commit [`519ac59`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803518792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803518594 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136294/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803509661 **[Test build #136297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136297/testReport)** for PR 31878 at commit [`aeef7fb`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803518595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803519451 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136298/ -- This

[GitHub] [spark] SparkQA commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
SparkQA commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803519397 **[Test build #136298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136298/testReport)** for PR 31911 at commit [`519ac59`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31874: [SPARK-34708][SQL] Code-gen for left semi/anti broadcast nested loop join (build right side)

2021-03-20 Thread GitBox
SparkQA commented on pull request #31874: URL: https://github.com/apache/spark/pull/31874#issuecomment-803519323 **[Test build #136300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136300/testReport)** for PR 31874 at commit [`f2e846d`](https://github.com

[GitHub] [spark] c21 commented on a change in pull request #31874: [SPARK-34708][SQL] Code-gen for left semi/anti broadcast nested loop join (build right side)

2021-03-20 Thread GitBox
c21 commented on a change in pull request #31874: URL: https://github.com/apache/spark/pull/31874#discussion_r598222928 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastNestedLoopJoinExec.scala ## @@ -452,4 +457,50 @@ case class BroadcastNest

[GitHub] [spark] dongjoon-hyun commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
dongjoon-hyun commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803519024 Thank you so much, @attilapiros ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
dongjoon-hyun commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803518979 The failure is irrelevant. ``` [info] - SPARK-34757: should ignore cache for SNAPSHOT dependencies *** FAILED *** (412 milliseconds) [info] 0 equaled 0 (SparkSub

[GitHub] [spark] AmplabJenkins commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803518927 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136297/ -- This

[GitHub] [spark] SparkQA commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
SparkQA commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803518829 **[Test build #136299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136299/testReport)** for PR 31909 at commit [`e34c5ae`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
SparkQA commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803518828 **[Test build #136297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136297/testReport)** for PR 31878 at commit [`aeef7fb`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803518792 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40880/ -- T

[GitHub] [spark] SparkQA commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
SparkQA commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803518785 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40880/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803518595 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40879/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803518594 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136294/ -- This

[GitHub] [spark] SparkQA commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
SparkQA commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803518349 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40880/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
SparkQA commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803517820 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40879/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
SparkQA commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803517127 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40879/ -- This is an automated message from the Apache

[GitHub] [spark] wangyum commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
wangyum commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803516777 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [spark] wangyum closed pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
wangyum closed pull request #31910: URL: https://github.com/apache/spark/pull/31910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] HyukjinKwon commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
HyukjinKwon commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803515683 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [spark] HyukjinKwon commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
HyukjinKwon commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803515659 @bozhang2820 the test failure seems related to your PR https://github.com/apache/spark/commit/86ea5203201a1b7611f0beaa9c7759d480fb21af. Yeah I can also confirm that the test

[GitHub] [spark] SparkQA removed a comment on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803503898 **[Test build #136294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136294/testReport)** for PR 31910 at commit [`3f07b79`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
SparkQA commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803515233 **[Test build #136294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136294/testReport)** for PR 31910 at commit [`3f07b79`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
SparkQA commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803514644 **[Test build #136298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136298/testReport)** for PR 31911 at commit [`519ac59`](https://github.com

[GitHub] [spark] c21 commented on pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
c21 commented on pull request #31911: URL: https://github.com/apache/spark/pull/31911#issuecomment-803514447 cc @maropu could you help take look when you have time, thanks. The PR has exactly same change with https://github.com/apache/spark/pull/31892. -- This is an automated message

[GitHub] [spark] c21 opened a new pull request #31911: [SPARK-34796][SQL][3.1] Initialize counter variable for LIMIT code-gen in doProduce()

2021-03-20 Thread GitBox
c21 opened a new pull request #31911: URL: https://github.com/apache/spark/pull/31911 ### What changes were proposed in this pull request? This PR is to fix the LIMIT code-gen bug in https://issues.apache.org/jira/browse/SPARK-34796, where the counter variable from `BaseLimi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803512627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40878/

[GitHub] [spark] AmplabJenkins commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803512627 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40878/ -- T

[GitHub] [spark] dongjoon-hyun commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
dongjoon-hyun commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803512564 The failure is irrelevant. ``` [info] - SPARK-34757: should ignore cache for SNAPSHOT dependencies *** FAILED *** (1 second, 254 milliseconds) [info] 0 equaled 0

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803511979 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40878/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803511376 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40878/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
SparkQA commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803509661 **[Test build #136297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136297/testReport)** for PR 31878 at commit [`aeef7fb`](https://github.com

[GitHub] [spark] wangyum commented on pull request #31878: [SPARK-34784][BUILD] Upgrade Jackson to 2.12.2

2021-03-20 Thread GitBox
wangyum commented on pull request #31878: URL: https://github.com/apache/spark/pull/31878#issuecomment-803509509 Jenkins, retest this please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803499257 **[Test build #136292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136292/testReport)** for PR 31649 at commit [`145dba0`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803508278 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136293/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803508565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40876/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803508319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40877/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803508370 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136292/ -

[GitHub] [spark] SparkQA commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
SparkQA commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803508561 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40876/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803508565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40876/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803508370 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136292/ -- This

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803508352 **[Test build #136296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136296/testReport)** for PR 31886 at commit [`4185e73`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803508342 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] SparkQA commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
SparkQA commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803508315 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40877/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803508319 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40877/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803508278 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136293/ -- This

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803508239 **[Test build #136292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136292/testReport)** for PR 31649 at commit [`145dba0`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
SparkQA commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803507782 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40876/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803499310 **[Test build #136293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136293/testReport)** for PR 30679 at commit [`e1db9f4`](https://gi

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803507704 **[Test build #136293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136293/testReport)** for PR 30679 at commit [`e1db9f4`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
SparkQA commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803507614 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40877/ -- This is an automated message from the Apache

[GitHub] [spark] maropu commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
maropu commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803506269 NOTE: I'm checking if the result in the golden files is correct query-by-query. -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] maropu commented on a change in pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-20 Thread GitBox
maropu commented on a change in pull request #31886: URL: https://github.com/apache/spark/pull/31886#discussion_r598214512 ## File path: sql/core/src/test/resources/tpcds-query-results/v1_4/q1.sql.out ## @@ -0,0 +1,125 @@ +-- Automatically generated by TPCDSQueryTestSuite + +--

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803504740 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136295/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803503908 **[Test build #136295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136295/testReport)** for PR 31899 at commit [`34690ed`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803504740 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136295/ -- This

[GitHub] [spark] SparkQA commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
SparkQA commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803504714 **[Test build #136295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136295/testReport)** for PR 31899 at commit [`34690ed`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-802893284 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803503801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40873/

[GitHub] [spark] SparkQA commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
SparkQA commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803503908 **[Test build #136295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136295/testReport)** for PR 31899 at commit [`34690ed`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
SparkQA commented on pull request #31910: URL: https://github.com/apache/spark/pull/31910#issuecomment-803503898 **[Test build #136294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136294/testReport)** for PR 31910 at commit [`3f07b79`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803503758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40874/

[GitHub] [spark] maropu commented on pull request #30018: [SPARK-33122][SQL] Remove redundant aggregates in the Optimzier

2021-03-20 Thread GitBox
maropu commented on pull request #30018: URL: https://github.com/apache/spark/pull/30018#issuecomment-803503800 Thanks for the reviews, @dongjoon-hyun ! Please open a new follow-up PR to address them, @tanelk . -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803503756 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40875/

[GitHub] [spark] AmplabJenkins commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803503801 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40873/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803503757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136290/ -

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803503797 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40873/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803503756 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40875/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803503757 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136290/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
AmplabJenkins commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803503758 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40874/ -- T

[GitHub] [spark] maropu commented on pull request #31900: Update sql-ref-syntax-dml-insert-into.md

2021-03-20 Thread GitBox
maropu commented on pull request #31900: URL: https://github.com/apache/spark/pull/31900#issuecomment-803503695 The fix itself looks fine to me. Please follow the @HyukjinKwon suggestion above. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803503563 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40875/ -- This is an automated message from the A

[GitHub] [spark] maropu commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
maropu commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803503349 It seems the other DDL stats have the same syntax, e.g. `ALTER TABLE`. Could you fix them, too, in this PR? -- This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] maropu commented on pull request #31899: [SPARK-34525][DOCS] Update Spark Create Table DDL to reflect alternative key value notation

2021-03-20 Thread GitBox
maropu commented on pull request #31899: URL: https://github.com/apache/spark/pull/31899#issuecomment-803503235 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] SparkQA commented on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
SparkQA commented on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803503109 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40873/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803503048 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40874/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803502927 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40875/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
SparkQA removed a comment on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803493780 **[Test build #136290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136290/testReport)** for PR 31909 at commit [`e34c5ae`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
SparkQA commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803502542 **[Test build #136290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136290/testReport)** for PR 31909 at commit [`e34c5ae`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31649: [SPARK-34542][BUILD] Upgrade Parquet to 1.12.0

2021-03-20 Thread GitBox
SparkQA commented on pull request #31649: URL: https://github.com/apache/spark/pull/31649#issuecomment-803502356 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40874/ -- This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
dongjoon-hyun commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803502131 Also, cc @mridulm since this is a behavior change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] dongjoon-hyun commented on pull request #31909: [SPARK-34809][CORE] Enable spark.hadoopRDD.ignoreEmptySplits by default

2021-03-20 Thread GitBox
dongjoon-hyun commented on pull request #31909: URL: https://github.com/apache/spark/pull/31909#issuecomment-803501833 Thank you, @HyukjinKwon . Ya, I remember those commits. :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] williamhyun opened a new pull request #31910: [SPARK-34810][TEST] Update PostgreSQL test with the latest results.

2021-03-20 Thread GitBox
williamhyun opened a new pull request #31910: URL: https://github.com/apache/spark/pull/31910 ### What changes were proposed in this pull request? This PR aims to update `PostgresIntegrationSuite` with the latest results. ### Why are the changes needed? The latest Postg

[GitHub] [spark] HyukjinKwon commented on pull request #31900: Update sql-ref-syntax-dml-insert-into.md

2021-03-20 Thread GitBox
HyukjinKwon commented on pull request #31900: URL: https://github.com/apache/spark/pull/31900#issuecomment-803500258 @robert4os, can you keep the PR template, and answer each questions, and follow http://spark.apache.org/contributing.html (e.g., fix PR title, filing a JIRA, etc.)? -- Th

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31908: [SPARK-34808][SQL] Removes outer join if it only has DISTINCT on streamed side

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #31908: URL: https://github.com/apache/spark/pull/31908#issuecomment-803445827 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136284/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
AmplabJenkins removed a comment on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803499128 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-20 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803499310 **[Test build #136293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136293/testReport)** for PR 30679 at commit [`e1db9f4`](https://github.com

  1   2   3   >