Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21833
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user PenguinToast opened a pull request:
https://github.com/apache/spark/pull/21833
[PYSPARK] [TEST] [MINOR] Fix UDFInitializationTests
## What changes were proposed in this pull request?
Fix a typo in pyspark sql tests
You can merge this pull request into a Git
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21831
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21831
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21802
Do we really need full codegen for all of these collection functions? They
seem pretty slow and specialization with full codegen won't help perf that much
(and might even hurt by blowing up the code
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21826
cc @gatorsmile @cloud-fan @HyukjinKwon this is a good thing to do?
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21822
**[Test build #93370 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93370/testReport)**
for PR 21822 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21826
Jenkins, test this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21822
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21831
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1189/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21831
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21832
**[Test build #93369 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93369/testReport)**
for PR 21832 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1189/
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21829
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21831
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21832
add to whitelist
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21829
LGTM
Thanks! Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21508
cc @maropu Help review this?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
**[Test build #93368 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93368/testReport)**
for PR 21831 at commit
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21653#discussion_r20409
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -723,6 +723,21 @@ private[spark] class TaskSetManager(
def
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21653#discussion_r204177708
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -723,6 +723,21 @@ private[spark] class TaskSetManager(
def
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21831#discussion_r204177925
--- Diff: resource-managers/kubernetes/integration-tests/pom.xml ---
@@ -25,7 +25,7 @@
spark-kubernetes-integration-tests_2.11
-
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21635
+1 @jerryshao
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r204171230
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceTypeHelper.scala
---
@@ -0,0 +1,119 @@
+/*
+ * Licensed to the
Github user dilipbiswal commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204169456
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -533,7 +537,8 @@ trait CheckAnalysis extends
Github user bkrieger commented on the issue:
https://github.com/apache/spark/pull/21508
@gatorsmile @hvanhovell any chance you can take a look at this?
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19194
**[Test build #93367 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93367/testReport)**
for PR 19194 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19194
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19194
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/19194
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204167870
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -533,7 +537,8 @@ trait CheckAnalysis extends
Github user dilipbiswal commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204166360
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -533,7 +537,8 @@ trait CheckAnalysis extends
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21831#discussion_r204165909
--- Diff: resource-managers/kubernetes/integration-tests/pom.xml ---
@@ -25,7 +25,7 @@
spark-kubernetes-integration-tests_2.11
-
Github user chemikadze commented on the issue:
https://github.com/apache/spark/pull/7786
@vanzin If those would be implemented, would it have any change to get
merged? We use preemption quite a lot and current behavior is not the best we
can get: logs sometimes getting overfilled
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21831#discussion_r204165401
--- Diff: resource-managers/kubernetes/integration-tests/pom.xml ---
@@ -25,7 +25,7 @@
spark-kubernetes-integration-tests_2.11
-
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/20856
@HyukjinKwon @cloud-fan Thanks for pinging me, sorry for replying late.
Yeah I looked at the final fixing at #21815, it looks good for a fixing at this
particular problem.
> It seems to me
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21831
cc @mccheah @ssuchter
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21830
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93353/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21830
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21830
**[Test build #93353 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93353/testReport)**
for PR 21830 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204163484
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
---
@@ -33,6 +49,116 @@ abstract class LogicalPlan
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204163551
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -533,7 +537,8 @@ trait CheckAnalysis extends
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204163424
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
---
@@ -23,8 +23,24 @@ import
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21822
**[Test build #93366 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93366/testReport)**
for PR 21822 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204163328
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -2390,16 +2375,21 @@ class Analyzer(
* scoping
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21832
Test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mmolimar commented on the issue:
https://github.com/apache/spark/pull/18447
Hi @HyukjinKwon
For me it's fine:
"In some SQL db you have to query explicitly the table schema, ie: select
data_type from all_tab_columns where table_name = 'my_table'or something like
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93351/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21822
**[Test build #93351 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93351/testReport)**
for PR 21822 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21832#discussion_r204161199
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
@@ -606,7 +607,15 @@ private[client] class Shim_v0_13 extends
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204160853
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -533,7 +537,8 @@ trait CheckAnalysis extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93360/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21748
**[Test build #93360 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93360/testReport)**
for PR 21748 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21798
**[Test build #93364 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93364/testReport)**
for PR 21798 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21798
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21798
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93364/
Test PASSed.
---
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21822#discussion_r204160150
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -787,6 +782,7 @@ class Analyzer(
right
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21118
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21831
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21118
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21831
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1185/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21608
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21608
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93352/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21608
**[Test build #93352 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93352/testReport)**
for PR 21608 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21798
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93363/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21798
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21798
**[Test build #93363 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93363/testReport)**
for PR 21798 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21832#discussion_r204157323
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
@@ -606,7 +606,15 @@ private[client] class Shim_v0_13 extends
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/21748
LGTM for the docs updates.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21832#discussion_r204156800
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/client/FiltersSuite.scala ---
@@ -72,6 +72,10 @@ class FiltersSuite extends SparkFunSuite
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21118
**[Test build #93365 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93365/testReport)**
for PR 21118 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21798
**[Test build #93364 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93364/testReport)**
for PR 21798 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21832
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1185/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21832
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21832
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20057
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21832
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20057
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user PenguinToast opened a pull request:
https://github.com/apache/spark/pull/21832
[SPARK-24879][SQL] Fix NPE in Hive partition pruning filter pushdown
## What changes were proposed in this pull request?
We get a NPE when we have a filter on a partition column of the
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21118
Rebased on master to fix conflicts.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21798
**[Test build #93363 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93363/testReport)**
for PR 21798 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21831
**[Test build #93362 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93362/testReport)**
for PR 21831 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/21831
cc @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21774
Need to revert this PR since it breaks the build.
spark-master-compile-maven-hadoop-2.6 #7902 (broken since this build)
---
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/21831
[SPARK-24880][BUILD]Fix the group id for spark-kubernetes-integration-tests
## What changes were proposed in this pull request?
The correct group id should be `org.apache.spark`. This is
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21748
Never mind, think it's recovering now.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21748
**[Test build #93361 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93361/testReport)**
for PR 21748 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93361/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21748
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
101 - 200 of 606 matches
Mail list logo
