Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22181
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/22181
LGTM. Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21330
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21330
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21332
**[Test build #95122 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95122/testReport)**
for PR 21332 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22157
cc @gatorsmile and @cloud-fan .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dbtsai closed the pull request at:
https://github.com/apache/spark/pull/22160
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22160
Closed this PR since we're in favor of
https://github.com/apache/spark/pull/21749
---
-
To unsubscribe, e-mail:
Github user yunjzhang commented on the issue:
https://github.com/apache/spark/pull/22177
my fault, just fixed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21749
@srowen It does work, and I have used it for my development recently. You
should be able to build with my branch to test it out. I was trying to merge
two source trees yesterday, and I realized I
Github user GregOwen commented on the issue:
https://github.com/apache/spark/pull/22174
Closing this for now since it seems like this might break existing workflows
---
-
To unsubscribe, e-mail:
Github user GregOwen closed the pull request at:
https://github.com/apache/spark/pull/22174
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user raofu commented on the issue:
https://github.com/apache/spark/pull/22157
@dongjoon-hyun, thanks lot for the pointers! I've update the PR
description. Please let me know if there is any other information you'd like me
to add.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22171
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95111/
Test PASSed.
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22177
Probably you put wrong JIRA in the title. `SPARK-25199` -> `SPARK-25119`
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22171
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22171
**[Test build #95111 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95111/testReport)**
for PR 22171 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22157
Jenkins is usually retriggered when it detects the change. Maybe, it seems
to be busy.
-
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22157
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/22186
Not sure what is up with the build here; worked with mvn locally. Possibly
my use of a java 8 lamda-expression as the hook?
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22136
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22136
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95120/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22136
**[Test build #95120 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95120/testReport)**
for PR 22136 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22112
> Without making shuffle output order repeatable, we do not have a way to
properly fix this.
Perhaps I'm missing it, but you are saying shuffle here, but just shuffle
itself can't fix
Github user raofu commented on the issue:
https://github.com/apache/spark/pull/22157
@dongjoon-hyun Title updated. Thanks for adding the test coverage! I've
merged your commit. Can you help kick off another Jenkins run? I don't think I
have the permission to do it.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22063
**[Test build #95121 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95121/testReport)**
for PR 22063 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22063
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22063
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22136
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22136
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22185
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95110/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22185
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22136
**[Test build #95120 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95120/testReport)**
for PR 22136 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22185
**[Test build #95110 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95110/testReport)**
for PR 22185 at commit
Github user huaxingao commented on a diff in the pull request:
https://github.com/apache/spark/pull/22136#discussion_r212088986
--- Diff: python/pyspark/ml/tests.py ---
@@ -844,6 +844,28 @@ def test_string_indexer_from_labels(self):
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22157
Thank you for pinging me, @srowen .
@raofu Instead of changing the existing test coverage, we had better add
additional test cases which all files are corrupted.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22187
**[Test build #95119 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95119/testReport)**
for PR 22187 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22187
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22187
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95108/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21977
**[Test build #95108 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95108/testReport)**
for PR 21977 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21334
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22182
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20637
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20637
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95109/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20637
**[Test build #95109 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95109/testReport)**
for PR 20637 at commit
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/22112
Catching up on discussion ...
@cloud-fan
> shuffled RDD will never be deterministic unless the shuffle key is the
entire record and key ordering is specified.
Let me rephrase
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/22121#discussion_r212075677
--- Diff: docs/avro-data-source-guide.md ---
@@ -0,0 +1,377 @@
+---
+layout: global
+title: Apache Avro Data Source Guide
+---
+
+*
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22187#discussion_r212075572
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/RowBasedHashMapGenerator.scala
---
@@ -44,31 +44,19 @@ class
Github user yunjzhang commented on the issue:
https://github.com/apache/spark/pull/22177
thanks for the suggestion, just rename the PR.
before fix
after fix
Github user markhamstra commented on the issue:
https://github.com/apache/spark/pull/22176
Yes, this is better than what we had, but maybe it can be better still.
---
-
To unsubscribe, e-mail:
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212072262
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -81,9 +97,9 @@
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/22176
@markhamstra That's a good point. However, since this is just following
our current codes if you check the usages of `newDaemonCachedThreadPool`, and
the changes here should be safe considering
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21749
Talked with @zsxwing . We do not need to revert the version bump, as long
as this PR does not introduce a new regression.
BTW, merging to the RC branches should be treated as
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212070807
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -81,9 +97,9 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212069991
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -96,3 +112,25 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212068833
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Constants.scala
---
@@ -74,8 +74,15 @@ private[spark] object
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212069720
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -16,11 +16,17 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22146#discussion_r212068140
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/TemplateVolumeStep.scala
---
@@ -0,0 +1,51 @@
+/*
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22173#discussion_r212070669
--- Diff:
common/network-common/src/main/java/org/apache/spark/network/TransportContext.java
---
@@ -144,14 +161,17 @@ public TransportChannelHandler
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/22136#discussion_r212069129
--- Diff: python/pyspark/ml/tests.py ---
@@ -844,6 +844,28 @@ def test_string_indexer_from_labels(self):
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22187#discussion_r212062744
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/RowBasedHashMapGenerator.scala
---
@@ -44,31 +44,19 @@ class
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22187#discussion_r212062022
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/RowBasedHashMapGenerator.scala
---
@@ -44,31 +44,19 @@ class
Github user markhamstra commented on the issue:
https://github.com/apache/spark/pull/22176
@zsxwing we really should have considered whether this should be a
configuration variable instead of a fixed number of threads in any environment.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22189
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22189
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22189
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user movrsprbp opened a pull request:
https://github.com/apache/spark/pull/22189
Correct missing punctuation in the documentation
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21320
let me take a look this today. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22188
**[Test build #95118 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95118/testReport)**
for PR 22188 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22188
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22188
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user bersprockets opened a pull request:
https://github.com/apache/spark/pull/22188
[SPARK-25164][SQL] Avoid rebuilding column and path list for each column in
parquet reader
## What changes were proposed in this pull request?
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22187
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22187
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22063
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22063
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95106/
Test FAILed.
---
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22180#discussion_r212059380
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
---
@@ -368,7 +369,11 @@ private[spark] class
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22180#discussion_r212059286
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
---
@@ -143,6 +143,7 @@ private[spark] class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22063
**[Test build #95106 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95106/testReport)**
for PR 22063 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22187
**[Test build #95117 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95117/testReport)**
for PR 22187 at commit
GitHub user kiszk opened a pull request:
https://github.com/apache/spark/pull/22187
[SPARK-25178][SQL] change the generated code of the keySchema / valueSchema
for xxxHashMapGenerator
## What changes were proposed in this pull request?
This PR generates the code that to
Github user mallman commented on the issue:
https://github.com/apache/spark/pull/21320
@gatorsmile Any concerns about merging this PR at this point?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22121
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22121
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95116/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22121
**[Test build #95116 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95116/testReport)**
for PR 22121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22042
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95115/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22042
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22042
**[Test build #95115 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95115/testReport)**
for PR 22042 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21770
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21770
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95103/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21770
**[Test build #95103 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95103/testReport)**
for PR 21770 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22121
**[Test build #95116 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95116/testReport)**
for PR 22121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22121
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22121
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22121#discussion_r212043748
--- Diff: docs/avro-data-source-guide.md ---
@@ -0,0 +1,377 @@
+---
+layout: global
+title: Apache Avro Data Source Guide
+---
+
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22176
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22186
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95114/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22186
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
201 - 300 of 600 matches
Mail list logo
