Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98383/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98383 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98383/testReport)**
for PR 22482 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22847
**[Test build #98384 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98384/testReport)**
for PR 22847 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22847
@cloud-fan @rednaxelafx I missed that! Please help review.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98383 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98383/testReport)**
for PR 22482 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22864
**[Test build #4406 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4406/testReport)**
for PR 22864 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98379/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98379 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98379/testReport)**
for PR 22482 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98380/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98380 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98380/testReport)**
for PR 22482 at commit
Github user Udbhav30 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22906#discussion_r230269652
--- Diff:
core/src/test/scala/org/apache/spark/io/CompressionCodecSuite.scala ---
@@ -128,6 +130,69 @@ class CompressionCodecSuite extends SparkFunSuite {
Github user KyleLi1985 commented on the issue:
https://github.com/apache/spark/pull/22893
> Hm, actually that's the best case. You're exercising the case where the
code path you prefer is fast. And the case where the precision bound applies is
exactly the case where the branch you
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98377/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22927
**[Test build #98377 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98377/testReport)**
for PR 22927 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22255
Also cc @hvanhovell
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22255
@dongjoon-hyun Do you want to take this over?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22255
https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L902
@rdblue Can we use created_by?
```
/** String for application that wrote this
Github user KyleLi1985 commented on the issue:
https://github.com/apache/spark/pull/22893
> Hm, actually that's the best case. You're exercising the case where the
code path you prefer is fast. And the case where the precision bound applies is
exactly the case where the branch you
Github user KyleLi1985 commented on the issue:
https://github.com/apache/spark/pull/22893
There is my test for situation sparse-sparse, dense-dense, sparse-dense case
`
import org.apache.spark.{SparkConf, SparkContext}
import
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98382 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98382/testReport)**
for PR 22482 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98382/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22482
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98382 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98382/testReport)**
for PR 22482 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22847
did you address
https://github.com/apache/spark/pull/22847#issuecomment-434836278 ?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98376/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22788
**[Test build #98376 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98376/testReport)**
for PR 22788 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4714/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98381/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98374/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
**[Test build #98381 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98381/testReport)**
for PR 22897 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22504
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22504
**[Test build #98374 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98374/testReport)**
for PR 22504 at commit
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r230041592
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroEncoder.scala ---
@@ -0,0 +1,533 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4714/
---
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22608
It depends on how we're getting the Hadoop images. If we're building
everything from scratch, we could run everything in one container - though
having a container run more than one process
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22864
**[Test build #4405 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4405/testReport)**
for PR 22864 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
**[Test build #98381 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98381/testReport)**
for PR 22897 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r230255203
--- Diff:
resource-managers/kubernetes/docker/src/test/hadoop/conf/yarn-site.xml ---
@@ -0,0 +1,26 @@
+
+
+
+
+
+
+
+
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22847
@cloud-fan @gatorsmile How about merging this PR first? And then we can
dissuss those performance issue in other PR?
1. One PR to improve WideTableBenchmark #22823 WIP.
2. One PR to add more
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22608
> Think we want different images for each
You don't need to, right? You can have a single image with all the stuff
needed. That would also make setting up the test faster (less images to
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15599
@shatestest Your problem is different from the issue this PR tries to
resolve. If you can provide a test case to reproduce it, feel free to open a
JIRA
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22921
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22921
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98373/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22921
**[Test build #98373 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98373/testReport)**
for PR 22921 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4713/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22919
Let me go ahead with documenting one then tomorrow.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98380 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98380/testReport)**
for PR 22482 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4713/
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22905#discussion_r230250684
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ColumnarFileFormat.scala
---
@@ -0,0 +1,32 @@
+/*
+ * Licensed to
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/22482
retest this, please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22482
**[Test build #98379 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98379/testReport)**
for PR 22482 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22818
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22818
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98371/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22818
**[Test build #98371 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98371/testReport)**
for PR 22818 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22927
For SparkR failure, https://issues.apache.org/jira/browse/SPARK-25923 is
filed.
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22905#discussion_r230249905
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala
---
@@ -306,7 +306,15 @@ case class FileSourceScanExec(
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22608
> You seem to be running different pods for KDC, NN and DN. Is there an
advantage to that?
>
> Seems to me you could do the same thing with a single pod and simplify
things here.
>
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
**[Test build #98378 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98378/testReport)**
for PR 22897 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98370/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21688
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21688
**[Test build #98370 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98370/testReport)**
for PR 21688 at commit
Github user yucai commented on a diff in the pull request:
https://github.com/apache/spark/pull/22847#discussion_r230248773
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -812,6 +812,17 @@ object SQLConf {
.intConf
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22847
I used the WideTableBenchmark to test this configuration.
4 scenarioes are tested, `2048` is always better than `1024`, overall it is
also good and looks more safe to avoid hitting 8KB limitaion.
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22927
Thank you, @squito and @gatorsmile . I address the review comments.
The SparkR failure looks irrelevant to this. I also observed that in
another unrelated PR
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22927
**[Test build #98377 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98377/testReport)**
for PR 22927 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22864
**[Test build #4406 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4406/testReport)**
for PR 22864 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22788
**[Test build #98376 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98376/testReport)**
for PR 22788 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22788
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22917
**[Test build #4404 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4404/testReport)**
for PR 22917 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22927
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98368/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22927
**[Test build #98368 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98368/testReport)**
for PR 22927 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22864
**[Test build #4403 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4403/testReport)**
for PR 22864 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22919
True. but it's a bit difficult to say it's a downside because `-i` has a
quite major issue as described above - user's code suddenly does not work with
implicit method (like symbol `'id` or
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4710/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r230227737
--- Diff: dev/make-distribution.sh ---
@@ -191,7 +191,8 @@ fi
# Only create and copy the dockerfiles directory if the kubernetes
artifacts were built.
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r230228691
--- Diff:
resource-managers/kubernetes/docker/src/test/scripts/run-kerberos-test.sh ---
@@ -0,0 +1,40 @@
+#!/usr/bin/env bash
+#
+# Licensed to
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22608#discussion_r230228286
--- Diff:
resource-managers/kubernetes/docker/src/test/scripts/populate-data.sh ---
@@ -0,0 +1,39 @@
+#!/usr/bin/env bash
+#
+# Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
**[Test build #98375 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98375/testReport)**
for PR 22897 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22897
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98375/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22924
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98362/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22924
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22924
**[Test build #98362 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98362/testReport)**
for PR 22924 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22897
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/4710/
---
1 - 100 of 441 matches
Mail list logo
