SparkQA commented on pull request #31517:
URL: https://github.com/apache/spark/pull/31517#issuecomment-803778202
**[Test build #136324 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136324/testReport)**
for PR 31517 at commit
[`adc6d92`](https://github.co
SparkQA removed a comment on pull request #31517:
URL: https://github.com/apache/spark/pull/31517#issuecomment-803730936
**[Test build #136324 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136324/testReport)**
for PR 31517 at commit
[`adc6d92`](https://gi
MaxGekk commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598438961
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
SparkQA commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803780201
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40909/
--
This is an automated message from the Apache
MaxGekk commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803780677
@HyukjinKwon Could you update PR's description and point out the environment
in which you run the benchmark, please.
--
This is an automated message from the Apache Git Servic
HyukjinKwon commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598440649
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
HyukjinKwon commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803782570
I think the benchmark results include that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
HyukjinKwon commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598440649
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
HyukjinKwon commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598442365
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
cloud-fan commented on a change in pull request #31898:
URL: https://github.com/apache/spark/pull/31898#discussion_r598442650
##
File path:
core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala
##
@@ -51,15 +51,17 @@ private[spark] class BlockStoreShuffleR
MaxGekk commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803785118
@HyukjinKwon The purpose is to give others enough info about the environment
to get the same benchmark results. Do you really think that:
```
Java HotSpot(TM) 64-Bit Server
SparkQA commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803786190
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40909/
--
This is an automated message from the A
HyukjinKwon commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803787041
@MaxGekk If we care about that, it would be great if we include that in
benchmark results.
--
This is an automated message from the Apache Git Service.
To respond to the m
AmplabJenkins commented on pull request #31847:
URL: https://github.com/apache/spark/pull/31847#issuecomment-803787636
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40910/
--
T
AmplabJenkins commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803787635
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40909/
--
T
AmplabJenkins commented on pull request #31920:
URL: https://github.com/apache/spark/pull/31920#issuecomment-803787637
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40911/
--
T
AmplabJenkins commented on pull request #31517:
URL: https://github.com/apache/spark/pull/31517#issuecomment-803787983
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136324/
--
This
AmplabJenkins removed a comment on pull request #31517:
URL: https://github.com/apache/spark/pull/31517#issuecomment-803787983
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136324/
-
AmplabJenkins removed a comment on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803787635
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40909/
AmplabJenkins removed a comment on pull request #31920:
URL: https://github.com/apache/spark/pull/31920#issuecomment-803787637
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40911/
AmplabJenkins removed a comment on pull request #31847:
URL: https://github.com/apache/spark/pull/31847#issuecomment-803787636
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40910/
HyukjinKwon commented on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803788733
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
romainx commented on pull request #27356:
URL: https://github.com/apache/spark/pull/27356#issuecomment-803788747
@HyukjinKwon sure I will have a look and I will try to draft a PR, it could
take some time since it's my first contribution here. Thanks for the proposal.
--
This is an automa
HyukjinKwon closed pull request #31918:
URL: https://github.com/apache/spark/pull/31918
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, pl
HyukjinKwon commented on pull request #27356:
URL: https://github.com/apache/spark/pull/27356#issuecomment-803789413
Sure, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific co
SparkQA commented on pull request #31922:
URL: https://github.com/apache/spark/pull/31922#issuecomment-803790212
**[Test build #136332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136332/testReport)**
for PR 31922 at commit
[`a01b89e`](https://github.com
SparkQA commented on pull request #31919:
URL: https://github.com/apache/spark/pull/31919#issuecomment-803790245
**[Test build #136333 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136333/testReport)**
for PR 31919 at commit
[`dfd7d38`](https://github.com
MaxGekk commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803790641
@HyukjinKwon I care of reproducible benchmark results. Currently, you don't
provide enough info to reproduce the same. I would prefer to follow scientific
approach, and have a c
SparkQA commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803790976
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40912/
--
This is an automated message from the Apache
MaxGekk commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598447129
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
SparkQA commented on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803792375
**[Test build #136321 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136321/testReport)**
for PR 31918 at commit
[`19b7172`](https://github.co
SparkQA removed a comment on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803730608
**[Test build #136321 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136321/testReport)**
for PR 31918 at commit
[`19b7172`](https://gi
HyukjinKwon commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803792545
@MaxGekk, We should better have a way to do that, or at least document that
we should do that. All I read is:
https://github.com/apache/spark/blob/d65f534c5ad4385b7c5198f
HyukjinKwon edited a comment on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803792545
@MaxGekk, We should better have a way to do that, or at least document that
we should do extra steps. All I read is:
https://github.com/apache/spark/blob/d65f534c5
AmplabJenkins commented on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803793642
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136321/
--
This
AmplabJenkins removed a comment on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803793642
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136321/
-
wangyum commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598449310
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
AmplabJenkins removed a comment on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803794337
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40912/
AmplabJenkins commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803794337
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40912/
--
T
SparkQA commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803794304
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40912/
--
This is an automated message from the A
SparkQA commented on pull request #31919:
URL: https://github.com/apache/spark/pull/31919#issuecomment-803795594
**[Test build #136325 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136325/testReport)**
for PR 31919 at commit
[`53be3fa`](https://github.co
SparkQA removed a comment on pull request #31919:
URL: https://github.com/apache/spark/pull/31919#issuecomment-803732611
**[Test build #136325 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136325/testReport)**
for PR 31919 at commit
[`53be3fa`](https://gi
SparkQA commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803795712
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40913/
--
This is an automated message from the Apache
dongjoon-hyun commented on pull request #31918:
URL: https://github.com/apache/spark/pull/31918#issuecomment-803796312
Thank you, @bozhang2820 and @HyukjinKwon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
AmplabJenkins commented on pull request #31919:
URL: https://github.com/apache/spark/pull/31919#issuecomment-803796617
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136325/
--
This
AmplabJenkins removed a comment on pull request #31919:
URL: https://github.com/apache/spark/pull/31919#issuecomment-803796617
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136325/
-
dongjoon-hyun commented on a change in pull request #31919:
URL: https://github.com/apache/spark/pull/31919#discussion_r598451669
##
File path: core/src/main/scala/org/apache/spark/ContextCleaner.scala
##
@@ -172,18 +172,18 @@ private[spark] class ContextCleaner(
registerF
MaxGekk commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598452062
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
cloud-fan commented on pull request #31898:
URL: https://github.com/apache/spark/pull/31898#issuecomment-803800454
This reminds me of
`CompressionCodec.supportsConcatenationOfSerializedStreams`. We have to disable
the shuffle batch fetch if it can't work.
This patch LGTM. Later on,
xuanyuanking commented on a change in pull request #31898:
URL: https://github.com/apache/spark/pull/31898#discussion_r598454149
##
File path:
core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.scala
##
@@ -51,15 +51,17 @@ private[spark] class BlockStoreShuff
yaooqinn commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803801061
cc @HyukjinKwon @cloud-fan @dongjoon-hyun thanks for reviewing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
SparkQA commented on pull request #31921:
URL: https://github.com/apache/spark/pull/31921#issuecomment-803801410
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40913/
--
This is an automated message from the A
beliefer commented on pull request #31920:
URL: https://github.com/apache/spark/pull/31920#issuecomment-803802246
retest this please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
wangyum commented on a change in pull request #31917:
URL: https://github.com/apache/spark/pull/31917#discussion_r598455353
##
File path: sql/core/benchmarks/CSVBenchmark-results.txt
##
@@ -2,66 +2,66 @@
Benchmark to measure CSV read/write performance
===
HyukjinKwon commented on a change in pull request #31921:
URL: https://github.com/apache/spark/pull/31921#discussion_r598455484
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
##
@@ -130,13 +130,11 @@ class
SparkQA commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803802814
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40914/
--
This is an automated message from the Apache
HyukjinKwon commented on a change in pull request #31921:
URL: https://github.com/apache/spark/pull/31921#discussion_r598455740
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
##
@@ -130,13 +130,11 @@ class
cloud-fan closed pull request #31842:
URL: https://github.com/apache/spark/pull/31842
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, plea
cloud-fan commented on pull request #31842:
URL: https://github.com/apache/spark/pull/31842#issuecomment-803803661
thanks, merging to master!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
zhongyu09 commented on pull request #31167:
URL: https://github.com/apache/spark/pull/31167#issuecomment-803803842
> This PR seems to be superseded by the author at #31269
>
> ```
> [SPARK-33933][SQL] Materialize BroadcastQueryStage first to try to avoid
broadcast timeout in AQE
Ngone51 commented on a change in pull request #31876:
URL: https://github.com/apache/spark/pull/31876#discussion_r598457153
##
File path: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala
##
@@ -28,16 +28,23 @@ import org.apache.spark.internal.config
import org.ap
SparkQA commented on pull request #31922:
URL: https://github.com/apache/spark/pull/31922#issuecomment-803807868
**[Test build #136332 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136332/testReport)**
for PR 31922 at commit
[`a01b89e`](https://github.co
SparkQA removed a comment on pull request #31922:
URL: https://github.com/apache/spark/pull/31922#issuecomment-803790212
**[Test build #136332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136332/testReport)**
for PR 31922 at commit
[`a01b89e`](https://gi
cloud-fan commented on pull request #29642:
URL: https://github.com/apache/spark/pull/29642#issuecomment-803808606
Is this patch still needed? IIRC we already have this in hive partition
pruning.
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
SparkQA commented on pull request #31917:
URL: https://github.com/apache/spark/pull/31917#issuecomment-803809435
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/40914/
--
This is an automated message from the A
cloud-fan commented on pull request #31909:
URL: https://github.com/apache/spark/pull/31909#issuecomment-803809778
late LGTM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
HyukjinKwon commented on pull request #31922:
URL: https://github.com/apache/spark/pull/31922#issuecomment-803810957
Thx!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
F
HyukjinKwon closed pull request #31922:
URL: https://github.com/apache/spark/pull/31922
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, pl
HyukjinKwon commented on pull request #31922:
URL: https://github.com/apache/spark/pull/31922#issuecomment-803811160
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
yaooqinn commented on a change in pull request #31921:
URL: https://github.com/apache/spark/pull/31921#discussion_r598463339
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
##
@@ -130,13 +130,11 @@ class Par
yaooqinn commented on a change in pull request #31921:
URL: https://github.com/apache/spark/pull/31921#discussion_r598463339
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
##
@@ -130,13 +130,11 @@ class Par
yaooqinn commented on a change in pull request #31921:
URL: https://github.com/apache/spark/pull/31921#discussion_r598463339
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
##
@@ -130,13 +130,11 @@ class Par
401 - 472 of 472 matches
Mail list logo
