Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22184#discussion_r213426538
--- Diff: docs/sql-programming-guide.md ---
@@ -1895,6 +1895,10 @@ working with timestamps in `pandas_udf`s to get the
best performance, see
-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2639/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21976
**[Test build #95353 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95353/testReport)**
for PR 21976 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22237
If we can finish it before the code freeze, it will be 2.4; otherwise it is
3.0
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22247
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22247
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95354/
Test PASSed.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22233
Basically, this PR is to revert the code to the original .par -based
solution.
LGTM Thanks! Merged to master.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22247
**[Test build #95354 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95354/testReport)**
for PR 22247 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22233#discussion_r213423805
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
---
@@ -60,7 +60,8 @@ class HiveCatalogedDDLSuite extends
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2639/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22192
**[Test build #95376 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95376/testReport)**
for PR 22192 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95374/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95374 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95374/testReport)**
for PR 22257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95373 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95373/testReport)**
for PR 22257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95373/
Test PASSed.
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22237
> to match the current behaviour to PERMISSIVE mode, explain that in the
migration guide.
@HyukjinKwon Should I target to Spark 3.0 or 2.4?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95375 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95375/testReport)**
for PR 22205 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22233#discussion_r213419455
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
---
@@ -52,23 +52,24 @@ class InMemoryCatalogedDDLSuite extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2638/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2638/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22251
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22251
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95367/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22251
**[Test build #95367 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95367/testReport)**
for PR 22251 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95374 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95374/testReport)**
for PR 22257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95355/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95355 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95355/testReport)**
for PR 22205 at commit
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22257
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22258
**[Test build #95372 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95372/testReport)**
for PR 22258 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95373 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95373/testReport)**
for PR 22257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22258
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22258
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22257
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22257
the network was disabled, so i fixed that:
```
virsh # net-list --all
Name State Autostart Persistent
GitHub user sarutak opened a pull request:
https://github.com/apache/spark/pull/22258
[SPARK-25266] Fix memory leak vulnerability in Barrier Execution Mode
## What changes were proposed in this pull request?
BarrierCoordinator$ uses Timer and TimerTask. `TimerTask#cancel()`
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95371 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95371/testReport)**
for PR 22112 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22256
@mccheah.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user shaneknapp commented on the issue:
https://github.com/apache/spark/pull/22257
taking a look now
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95370 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95370/testReport)**
for PR 22205 at commit
Github user suryag10 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r213408857
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadoopsteps/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,186
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22251#discussion_r213407599
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -1099,6 +1098,27 @@ class AvroSuite extends QueryTest with
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21977
The last couple of commits have failed a test case, but there have been no
code changes since a passing test. I think master is just a bit flaky right now
and that this PR is fine.
---
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22251#discussion_r213407441
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -1099,6 +1098,27 @@ class AvroSuite extends QueryTest with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95369 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95369/testReport)**
for PR 22112 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95368 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95368/testReport)**
for PR 22205 at commit
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r213407352
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -62,14 +63,20 @@ private[spark] object PythonEvalType {
*/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22251
**[Test build #95367 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95367/testReport)**
for PR 22251 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22164
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21087
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22177
That looks better indeed. I'll backport that one to 2.3.
@yunjzhang could you close this PR?
---
-
To unsubscribe,
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22233#discussion_r213406078
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
---
@@ -52,23 +52,24 @@ class InMemoryCatalogedDDLSuite extends
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21087
@kiszk Please submit a follow-up PR to address your comment?
---
-
To unsubscribe, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22164
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22164#discussion_r213405174
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnRMClient.scala
---
@@ -126,4 +136,21 @@ private[spark] class YarnRMClient
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21087
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95364/
Test PASSed.
---
Github user hhbyyh commented on the issue:
https://github.com/apache/spark/pull/22236
Take it and good luck.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95364 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95364/testReport)**
for PR 22257 at commit
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22257
@shaneknapp we seem to be having some minikube issues with the testing env
:(
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22253
@aai95 The goal of this JIRA is moving the tests to .java files. Thanks.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22247
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22247
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2630/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22257
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2630/
---
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22247#discussion_r213400676
--- Diff: python/pyspark/java_gateway.py ---
@@ -147,6 +147,39 @@ def do_server_auth(conn, auth_secret):
raise Exception("Unexpected reply from
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22247
**[Test build #95365 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95365/testReport)**
for PR 22247 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95366 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95366/testReport)**
for PR 22112 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22198
@maropu and @dilipbiswal and @gatorsmile .
The complexity comes because this PR duplicates the existing name
resolution logic. Although we may move `matchedTableIdentifier` to
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/22247#discussion_r213398017
--- Diff: python/pyspark/taskcontext.py ---
@@ -108,38 +108,12 @@ def _load_from_socket(port, auth_secret):
"""
Load data from a given
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r213397871
--- Diff: core/src/main/scala/org/apache/spark/rdd/MapPartitionsRDD.scala
---
@@ -32,12 +32,16 @@ import org.apache.spark.{Partition, TaskContext}
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22112#discussion_r213397293
--- Diff: core/src/main/scala/org/apache/spark/rdd/MapPartitionsRDD.scala
---
@@ -32,12 +32,16 @@ import org.apache.spark.{Partition, TaskContext}
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22257
**[Test build #95364 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95364/testReport)**
for PR 22257 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22173
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95352/
Test FAILed.
---
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/22257
@liyinan926 @u2takey for review
@mccheah for merge
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95356/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22205
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user ifilonenko opened a pull request:
https://github.com/apache/spark/pull/22257
[SPARK-25264][K8S] Fix comma-delineated arguments passed into PythonRunner
and RRunner
## What changes were proposed in this pull request?
Fixes the issue brought up in
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22173
**[Test build #95352 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95352/testReport)**
for PR 22173 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22205
**[Test build #95356 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95356/testReport)**
for PR 22205 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21546
**[Test build #95363 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95363/testReport)**
for PR 21546 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21546
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21546
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
301 - 400 of 687 matches
Mail list logo
