Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154724747
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark-base/Dockerfile
---
@@ -0,0 +1,43 @@
+#
+# Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19717
**[Test build #84437 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84437/testReport)**
for PR 19717 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84437/
Test FAILed.
---
Github user mpetruska commented on the issue:
https://github.com/apache/spark/pull/19879
This one has a "Major" priority; but otherwise yes, it should be resolved
in Scala 2.12 version.
---
-
To unsubscribe,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19879
Yes, I think it's reasonable to pull these fixes forward to patch
medium-sized problems. We don't have 2.12 support fully working yet, even, so
punting the solution to 2.12 means punting to 3.0,
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154752978
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154752924
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19869
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84435/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19869
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rezasafi commented on the issue:
https://github.com/apache/spark/pull/19848
Thank you very much @vanzin, @mridulm and @jiangxb1987. I really appreciate
it. I will create PR for branch 2.2 ASAP.
---
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19881
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/19865
Thank you. I think so for this case.
In general, to make global `ev.value` or to pass a global variable to
`consume()` may potentially cause this problem.
As @cloud-fan suggested, I
Github user mpetruska commented on the issue:
https://github.com/apache/spark/pull/19879
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19591
**[Test build #84442 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84442/testReport)**
for PR 19591 at commit
Github user maracujah commented on the issue:
https://github.com/apache/spark/pull/19224
What is the status of this item?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19880
**[Test build #84434 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84434/testReport)**
for PR 19880 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19880
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19861
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84433/
Test PASSed.
---
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154746008
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -702,6 +715,19 @@ object SparkSubmit extends CommandLineUtils with
Github user icexelloss commented on the issue:
https://github.com/apache/spark/pull/19872
> I thought @ueshin is working on this BTW.
Oh, I certainly don't want to duplicate @ueshin 's work. I am under the
impression that @ueshin is working on two-stage PySpark UDAF with
GitHub user jcuquemelle opened a pull request:
https://github.com/apache/spark/pull/19881
[SPARK-22683][CORE] Add tasksPerExecutorSlot parameter
## What changes were proposed in this pull request?
let's say an executor has spark.executor.cores / spark.task.cpus taskSlots
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19861
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154743731
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user mpetruska commented on the issue:
https://github.com/apache/spark/pull/19879
By the way, are these contributions valuable, or should the focus be 2.12?
---
-
To unsubscribe, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154755799
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -537,6 +540,7 @@ object DataSource extends Logging
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19869
**[Test build #84435 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84435/testReport)**
for PR 19869 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19871
**[Test build #84436 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84436/testReport)**
for PR 19871 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19871
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19591
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19631
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154726920
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark-base/Dockerfile
---
@@ -0,0 +1,43 @@
+#
+# Licensed to the Apache
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19810
@cloud-fan would you mind continuing the review?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/19864
@viirya any thoughts?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154742713
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154742876
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user dale-chang91 commented on the issue:
https://github.com/apache/spark/pull/5503
What is the result of this pull request? I can't seem to find the code in
the code base anywhere
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19871
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84436/
Test PASSed.
---
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154750457
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -55,14 +63,35 @@ private[spark] object Config
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154771178
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154771100
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154770325
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154754517
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/Client.scala
---
@@ -0,0 +1,234 @@
+/*
+ * Licensed
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154770165
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154759574
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,164 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154759746
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,164 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154750025
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala ---
@@ -388,6 +388,32 @@ class SparkSubmitSuite
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154759371
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,164 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154771774
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154759879
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,164 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154749355
--- Diff:
core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ---
@@ -590,6 +600,11 @@ private[deploy] class SparkSubmitArguments(args:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154759045
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0 +1,164 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154757417
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala
---
@@ -0,0 +1,181 @@
+/*
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154751082
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -119,5 +139,60 @@ private[spark] object Config
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154756363
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesFileUtils.scala
---
@@ -0,0 +1,68 @@
+/*
+
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19717
**[Test build #84437 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84437/testReport)**
for PR 19717 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19877#discussion_r154729236
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ---
@@ -1832,6 +1832,27 @@ class DAGSchedulerSuite extends SparkFunSuite
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/19852#discussion_r154737303
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -319,7 +319,7 @@ private[spark] abstract class BasePythonRunner[IN,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19871
**[Test build #84439 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84439/testReport)**
for PR 19871 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19717
**[Test build #84440 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84440/testReport)**
for PR 19717 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19870#discussion_r154764850
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala
---
@@ -838,6 +838,8 @@ case class
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/19870
thanks @gatorsmile, I agree and I updated the PR accordingly. Thanks.
---
-
To unsubscribe, e-mail:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154755221
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/DriverConfigurationStepsOrchestrator.scala
---
@@ -0,0 +1,121
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19861
**[Test build #84433 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84433/testReport)**
for PR 19861 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19870
LGTM pending Jenkins
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84434/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19717
**[Test build #84438 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84438/testReport)**
for PR 19717 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19878
**[Test build #84431 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84431/testReport)**
for PR 19878 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19878
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84431/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19878
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19881
Please see JIRA. I don't think this is worth doing.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user vanzin closed the pull request at:
https://github.com/apache/spark/pull/19631
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mpetruska commented on the issue:
https://github.com/apache/spark/pull/19879
Jenkins, re-test this, please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154752812
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -363,6 +363,14 @@ object SQLConf {
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19871#discussion_r154756706
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala
---
@@ -537,6 +540,7 @@ object DataSource extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19870
**[Test build #84441 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84441/testReport)**
for PR 19870 at commit
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154783519
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84438/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19520
We should close this. I don't see any user benefit in supporting slashes in
app ids.
---
-
To unsubscribe, e-mail:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19770#discussion_r154787608
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -643,6 +633,44 @@ private[history] class
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19770#discussion_r154784102
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -616,23 +620,9 @@ private[history] class
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154800789
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154800800
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala
---
@@ -0,0
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154800774
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154800754
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/BaseDriverConfigurationStep.scala
---
@@ -0,0
Github user tedmiston commented on the issue:
https://github.com/apache/spark/pull/17671
Anyone know what the status of this PR is? I'd really like to be able to
run Sentry on my PySpark code in production.
---
-
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/19717#discussion_r154800815
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesFileUtils.scala
---
@@ -0,0 +1,68 @@
+/*
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19717
**[Test build #84440 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84440/testReport)**
for PR 19717 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19717
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84440/
Test PASSed.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19884
Great, @BryanCutler . Could you put the highlight in the PR description,
too?
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19884#discussion_r154810506
--- Diff: pom.xml ---
@@ -185,7 +185,7 @@
2.8
1.8
1.0.0
-0.4.0
+0.8.0-SNAPSHOT
--- End diff --
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/19884
This is a WIP to start updating Spark to use Arrow 0.8.0 which will be
released soon.
TODO:
- [ ] Update to reflect Java API changes
- [ ] Update to reflect Python API
GitHub user rezasafi opened a pull request:
https://github.com/apache/spark/pull/19886
[SPARK-22162][BRANCH-2.2] Executors and the driver should use consistent
JobIDs in the RDD commit protocol
I have modified SparkHadoopMapReduceWriter so that executors and the driver
always use
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19883
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/8/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19883
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/19883
[SPARK-22684][SQL] datetime functions should not generate useless mutable
states
## What changes were proposed in this pull request?
Some datetime functions are defining mutable states
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19872#discussion_r154782452
--- Diff: python/pyspark/sql/group.py ---
@@ -89,8 +89,15 @@ def agg(self, *exprs):
else:
# Columns
assert
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19882
**[Test build #84443 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/84443/testReport)**
for PR 19882 at commit
1 - 100 of 490 matches
Mail list logo
