[GitHub] [spark] MaxGekk commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
MaxGekk commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803785118 @HyukjinKwon The purpose is to give others enough info about the environment to get the same benchmark results. Do you really think that: ``` Java HotSpot(TM) 64-Bit

[GitHub] [spark] cloud-fan commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

2021-03-21 Thread GitBox
cloud-fan commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598442650 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598442365 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598440649 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] HyukjinKwon commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803782570 I think the benchmark results include that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598440649 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] MaxGekk commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
MaxGekk commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803780677 @HyukjinKwon Could you update PR's description and point out the environment in which you run the benchmark, please. -- This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
SparkQA commented on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803780201 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40909/ -- This is an automated message from the Apache

[GitHub] [spark] MaxGekk commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
MaxGekk commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598438961 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] SparkQA removed a comment on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803730936 **[Test build #136324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136324/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803778202 **[Test build #136324 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136324/testReport)** for PR 31517 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31922: [SPARK-34818][PYTHON][DOCS] Reorder the items in User Guide at PySpark documentation

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31922: URL: https://github.com/apache/spark/pull/31922#issuecomment-803777036 cc @zero323, @srowen, @viirya can you take a quick look please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon opened a new pull request #31922: [SPARK-34818][PYTHON][DOCS] Reorder the items in User Guide at PySpark documentation

2021-03-21 Thread GitBox
HyukjinKwon opened a new pull request #31922: URL: https://github.com/apache/spark/pull/31922 ### What changes were proposed in this pull request? This PR proposes to reorder the items in User Guide in PySpark documentation in order to place general guides first and advance ones

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803776259 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40911/ --

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-21 Thread GitBox
SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803773652 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40905/ --

[GitHub] [spark] SparkQA commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-03-21 Thread GitBox
SparkQA commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-803772614 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40910/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-03-21 Thread GitBox
SparkQA commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-803768105 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40910/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803766091 **[Test build #136331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136331/testReport)** for PR 31917 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598428153 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] sarutak commented on pull request #31718: [SPARK-34225][CORE] Don't encode further when a URI form string is passed to addFile or addJar

2021-03-21 Thread GitBox
sarutak commented on pull request #31718: URL: https://github.com/apache/spark/pull/31718#issuecomment-803764301 Merged to `master` and `branch-3.1`. Thank you @srowen and @HyukjinKwon . -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] asfgit closed pull request #31718: [SPARK-34225][CORE] Don't encode further when a URI form string is passed to addFile or addJar

2021-03-21 Thread GitBox
asfgit closed pull request #31718: URL: https://github.com/apache/spark/pull/31718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [spark] SparkQA commented on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
SparkQA commented on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803763315 **[Test build #136330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136330/testReport)** for PR 31921 at commit

[GitHub] [spark] MaxGekk commented on a change in pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
MaxGekk commented on a change in pull request #31917: URL: https://github.com/apache/spark/pull/31917#discussion_r598427096 ## File path: sql/core/benchmarks/CSVBenchmark-results.txt ## @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31918: URL: https://github.com/apache/spark/pull/31918#issuecomment-803762578 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40903/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803762577 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40907/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803762580 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136327/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803762552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31918: URL: https://github.com/apache/spark/pull/31918#issuecomment-803762578 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40903/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803762552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803762577 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40907/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803762580 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136327/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803730648 **[Test build #136322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136322/testReport)** for PR 31917 at commit

[GitHub] [spark] SparkQA commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803761914 **[Test build #136322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136322/testReport)** for PR 31917 at commit

[GitHub] [spark] MaxGekk closed pull request #30678: [MINOR][SQL] Spelling: filters - PushedFilers

2021-03-21 Thread GitBox
MaxGekk closed pull request #30678: URL: https://github.com/apache/spark/pull/30678 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] MaxGekk commented on pull request #30678: [MINOR][SQL] Spelling: filters - PushedFilers

2021-03-21 Thread GitBox
MaxGekk commented on pull request #30678: URL: https://github.com/apache/spark/pull/30678#issuecomment-803760318 +1, LGTM, I am merging this to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
SparkQA commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803756870 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40907/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
SparkQA commented on pull request #31918: URL: https://github.com/apache/spark/pull/31918#issuecomment-803753903 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40903/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
SparkQA commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803753661 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40907/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803745469 **[Test build #136327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136327/testReport)** for PR 31921 at commit

[GitHub] [spark] SparkQA commented on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
SparkQA commented on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803752499 **[Test build #136327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136327/testReport)** for PR 31921 at commit

[GitHub] [spark] SparkQA commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803752597 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40904/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803750709 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40904/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
SparkQA commented on pull request #31918: URL: https://github.com/apache/spark/pull/31918#issuecomment-803750601 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40903/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803746350 **[Test build #136329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136329/testReport)** for PR 31920 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803749292 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136329/

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803749292 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136329/ -- This

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803749271 **[Test build #136329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136329/testReport)** for PR 31920 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31866: [SPARK-34778][BUILD] Upgrade to Avro 1.10.2

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31866: URL: https://github.com/apache/spark/pull/31866#issuecomment-803748803 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136317/

[GitHub] [spark] AmplabJenkins commented on pull request #31866: [SPARK-34778][BUILD] Upgrade to Avro 1.10.2

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31866: URL: https://github.com/apache/spark/pull/31866#issuecomment-803748803 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136317/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #31866: [SPARK-34778][BUILD] Upgrade to Avro 1.10.2

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31866: URL: https://github.com/apache/spark/pull/31866#issuecomment-803699183 **[Test build #136317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136317/testReport)** for PR 31866 at commit

[GitHub] [spark] SparkQA commented on pull request #31866: [SPARK-34778][BUILD] Upgrade to Avro 1.10.2

2021-03-21 Thread GitBox
SparkQA commented on pull request #31866: URL: https://github.com/apache/spark/pull/31866#issuecomment-803748078 **[Test build #136317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136317/testReport)** for PR 31866 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803747471 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40908/

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803747471 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40908/ --

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803747460 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40908/ --

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803746350 **[Test build #136329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136329/testReport)** for PR 31920 at commit

[GitHub] [spark] SparkQA commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-03-21 Thread GitBox
SparkQA commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-803745506 **[Test build #136328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136328/testReport)** for PR 31847 at commit

[GitHub] [spark] SparkQA commented on pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type in parquet

2021-03-21 Thread GitBox
SparkQA commented on pull request #31921: URL: https://github.com/apache/spark/pull/31921#issuecomment-803745469 **[Test build #136327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136327/testReport)** for PR 31921 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803745231 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] Ngone51 commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
Ngone51 commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803745024 This PR addressed the comment from https://github.com/apache/spark/pull/31881/files#r597370114 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803744858 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136326/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803744856 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40905/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803744854 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803744853 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40906/

[GitHub] [spark] AmplabJenkins commented on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803744853 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40906/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803744856 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40905/ --

[GitHub] [spark] AmplabJenkins commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803744857 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803744858 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136326/ -- This

[GitHub] [spark] Ngone51 commented on a change in pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
Ngone51 commented on a change in pull request #31919: URL: https://github.com/apache/spark/pull/31919#discussion_r598411889 ## File path: core/src/main/scala/org/apache/spark/ContextCleaner.scala ## @@ -172,18 +172,18 @@ private[spark] class ContextCleaner(

[GitHub] [spark] SparkQA commented on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803742993 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40906/ --

[GitHub] [spark] Ngone51 commented on a change in pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
Ngone51 commented on a change in pull request #31919: URL: https://github.com/apache/spark/pull/31919#discussion_r598410411 ## File path: sql/core/src/main/scala/org/apache/spark/sql/util/QueryExecutionListener.scala ## @@ -131,6 +127,14 @@ class ExecutionListenerManager

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31918: URL: https://github.com/apache/spark/pull/31918#discussion_r598402368 ## File path: core/src/test/scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala ## @@ -304,22 +304,4 @@ class SparkSubmitUtilsSuite extends

[GitHub] [spark] HyukjinKwon commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803739966 Sure, running now  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] Ngone51 commented on pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

2021-03-21 Thread GitBox
Ngone51 commented on pull request #31898: URL: https://github.com/apache/spark/pull/31898#issuecomment-803739884 cc @xuanyuanking -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] Ngone51 commented on a change in pull request #31898: [SPARK-34790][CORE] Disable fetching shuffle blocks in batch when io encryption is enabled

2021-03-21 Thread GitBox
Ngone51 commented on a change in pull request #31898: URL: https://github.com/apache/spark/pull/31898#discussion_r598407556 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala ## @@ -51,15 +51,17 @@ private[spark] class

[GitHub] [spark] yaooqinn opened a new pull request #31921: [SPARK-34817][SQL] Read parquet unsigned types that stored as int32 physical type

2021-03-21 Thread GitBox
yaooqinn opened a new pull request #31921: URL: https://github.com/apache/spark/pull/31921 ### What changes were proposed in this pull request? Unsigned types may be used to produce smaller in-memory representations of the data. These types used by frameworks(e.g. hive,

[GitHub] [spark] SparkQA removed a comment on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA removed a comment on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803734535 **[Test build #136326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136326/testReport)** for PR 31920 at commit

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803736488 **[Test build #136326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136326/testReport)** for PR 31920 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #31858: [SPARK-34768][SQL] Respect the default input buffer size in Univocity

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31858: URL: https://github.com/apache/spark/pull/31858#issuecomment-803736372 I performed the benchmark before after this commit, and I do see the perf improvement here. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] beliefer commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-03-21 Thread GitBox
beliefer commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-803736320 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] HyukjinKwon commented on pull request #31858: [SPARK-34768][SQL] Respect the default input buffer size in Univocity

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31858: URL: https://github.com/apache/spark/pull/31858#issuecomment-803736270 ```diff Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz Parsing quoted values:Best Time(ms) Avg Time(ms) Stdev(ms)Rate(M/s) Per Row(ns)

[GitHub] [spark] HyukjinKwon commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
HyukjinKwon commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803735034 cc @mridulm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-21 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803734965 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40901/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31919: URL: https://github.com/apache/spark/pull/31919#discussion_r598402805 ## File path: sql/core/src/main/scala/org/apache/spark/sql/util/QueryExecutionListener.scala ## @@ -131,6 +127,14 @@ class ExecutionListenerManager

[GitHub] [spark] SparkQA commented on pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
SparkQA commented on pull request #31920: URL: https://github.com/apache/spark/pull/31920#issuecomment-803734535 **[Test build #136326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136326/testReport)** for PR 31920 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
HyukjinKwon commented on a change in pull request #31918: URL: https://github.com/apache/spark/pull/31918#discussion_r598402368 ## File path: core/src/test/scala/org/apache/spark/deploy/SparkSubmitUtilsSuite.scala ## @@ -304,22 +304,4 @@ class SparkSubmitUtilsSuite extends

[GitHub] [spark] beliefer opened a new pull request #31920: [SPARK-33604][SQL] Group exception messages in sql/execution

2021-03-21 Thread GitBox
beliefer opened a new pull request #31920: URL: https://github.com/apache/spark/pull/31920 ### What changes were proposed in this pull request? This PR group exception messages in `/core/src/main/scala/org/apache/spark/sql/execution`. ### Why are the changes needed? It

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
dongjoon-hyun commented on a change in pull request #31919: URL: https://github.com/apache/spark/pull/31919#discussion_r598401461 ## File path: core/src/main/scala/org/apache/spark/ContextCleaner.scala ## @@ -172,18 +172,18 @@ private[spark] class ContextCleaner(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2021-03-21 Thread GitBox
AmplabJenkins removed a comment on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-803732890 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40902/

[GitHub] [spark] AmplabJenkins commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2021-03-21 Thread GitBox
AmplabJenkins commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-803732890 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40902/ --

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2021-03-21 Thread GitBox
SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-803732877 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40902/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
SparkQA commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803732611 **[Test build #136325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136325/testReport)** for PR 31919 at commit

[GitHub] [spark] Ngone51 commented on pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
Ngone51 commented on pull request #31919: URL: https://github.com/apache/spark/pull/31919#issuecomment-803732196 cc @mridulm @HyukjinKwon -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] Ngone51 opened a new pull request #31919: [SPARK-34087][FOLLOW-UP][SQL] Manage ExecutionListenerBus register inside itself

2021-03-21 Thread GitBox
Ngone51 opened a new pull request #31919: URL: https://github.com/apache/spark/pull/31919 ### What changes were proposed in this pull request? Move `ExecutionListenerBus` register (both `ListenerBus` and `ContextCleaner` register) into itself. Also with a minor

[GitHub] [spark] SparkQA commented on pull request #30679: [SPARK-33717][LAUNCHER] deprecate spark.launcher.childConectionTimeout

2021-03-21 Thread GitBox
SparkQA commented on pull request #30679: URL: https://github.com/apache/spark/pull/30679#issuecomment-803731499 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40901/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31517: [WIP][SPARK-34309][BUILD][CORE][SQL] [K8S]Use Caffeine instead of Guava Cache

2021-03-21 Thread GitBox
SparkQA commented on pull request #31517: URL: https://github.com/apache/spark/pull/31517#issuecomment-803730936 **[Test build #136324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136324/testReport)** for PR 31517 at commit

[GitHub] [spark] SparkQA commented on pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-03-21 Thread GitBox
SparkQA commented on pull request #31886: URL: https://github.com/apache/spark/pull/31886#issuecomment-803730661 **[Test build #136323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136323/testReport)** for PR 31886 at commit

[GitHub] [spark] SparkQA commented on pull request #31917: [SPARK-34815][SQL] Update CSVBenchmark

2021-03-21 Thread GitBox
SparkQA commented on pull request #31917: URL: https://github.com/apache/spark/pull/31917#issuecomment-803730648 **[Test build #136322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136322/testReport)** for PR 31917 at commit

[GitHub] [spark] SparkQA commented on pull request #31918: Revert "[SPARK-34757][CORE][DEPLOY] Ignore cache for SNAPSHOT dependencies in spark-submit"

2021-03-21 Thread GitBox
SparkQA commented on pull request #31918: URL: https://github.com/apache/spark/pull/31918#issuecomment-803730608 **[Test build #136321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136321/testReport)** for PR 31918 at commit

[GitHub] [spark] yaooqinn commented on pull request #31916: [SPARK-34772][TESTS][FOLLOWUP] Disable a test case using Hive 1.2.1 in Java9+ environment

2021-03-21 Thread GitBox
yaooqinn commented on pull request #31916: URL: https://github.com/apache/spark/pull/31916#issuecomment-803730237 late +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] SparkQA commented on pull request #29695: [SPARK-22390][SPARK-32833][SQL] [WIP]JDBC V2 Datasource aggregate push down

2021-03-21 Thread GitBox
SparkQA commented on pull request #29695: URL: https://github.com/apache/spark/pull/29695#issuecomment-803730195 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40902/ -- This is an automated message from the Apache

  1   2   3   4   5   >