Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21991
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22018
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21990
@RussellSpitzer, let's close other ones except for this and name it
`[SPARK-25003][PYSPARK] Use SessionExtensions in Pyspark`. Let me review this
one within few days. Also, I don't think we
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21991
**[Test build #94324 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94324/testReport)**
for PR 21991 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22018
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21988
Yea, let's just close except the master one.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
GitHub user habren opened a pull request:
https://github.com/apache/spark/pull/22018
[SPARK-25038][SQL] Accelerate Spark Plan generation when Spark SQL reâ¦
https://issues.apache.org/jira/browse/SPARK-25038
When Spark SQL read large amount of data, it take a long time
Github user fuqiliang commented on the issue:
https://github.com/apache/spark/pull/20666
Hi, guys, I am a spark user.
I have a question for this "JSON doesn't support partial results for
corrupted records." behavior.
In spark 1.6, the partial results is given, but when
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21937
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94327/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #94327 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94327/testReport)**
for PR 21860 at commit
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21937
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21937
LGTM.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21937#discussion_r208085448
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3767,230 +3767,160 @@ object
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20611
**[Test build #94334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94334/testReport)**
for PR 20611 at commit
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21222
Thanks @zsxwing for merging and thanks all for reviewing!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21991
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21622
Thanks @HyukjinKwon for merging, and thanks all for reviewing!
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20611
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21721
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
https://github.com/apache/spark/commit/51bee7aca13451167fa3e701fcd60f023eae5e61
looks good :-)
---
-
To unsubscribe,
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21721
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22016
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94328/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94319/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22016
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22016
**[Test build #94328 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94328/testReport)**
for PR 22016 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21451
**[Test build #94319 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94319/testReport)**
for PR 21451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94330/
Test FAILed.
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21622
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22009
**[Test build #94330 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94330/testReport)**
for PR 22009 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #94333 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94333/testReport)**
for PR 21898 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21622
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21898
is there a way to increase the build timeout? cc @shaneknapp
---
-
To unsubscribe, e-mail:
Github user skambha commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208079529
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala
---
@@ -201,7 +204,7 @@ case class Alias(child:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21898
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208079335
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala
---
@@ -201,7 +204,7 @@ case class Alias(child:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
Let me leave it to you @dbtsai. I thought you live in a timezone completely
different with me.
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21991
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94322/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21991
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21978
I'd like to wait for https://github.com/apache/spark/pull/17185
#17185 allows users to do `db1.table1.col1`, and we can later extend it to
`catalog1.db1.table1.col1`.
We should
Github user skambha commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208078928
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala
---
@@ -794,19 +795,37 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21991
**[Test build #94322 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94322/testReport)**
for PR 21991 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
Yes, I think so. I was about to merge this in that way :-). Seems to me we
are good to merge now since the current change is only checked by Python lint
which is already passed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21980
**[Test build #94332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94332/testReport)**
for PR 21980 at commit
Github user skambha commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208078754
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala
---
@@ -201,7 +204,7 @@ case class Alias(child:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21980
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21980
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94318/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #94318 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94318/testReport)**
for PR 21898 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21980
**[Test build #94331 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94331/testReport)**
for PR 21980 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21980
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21980
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22009
**[Test build #94330 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94330/testReport)**
for PR 22009 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21980#discussion_r208078032
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala
---
@@ -854,6 +854,26 @@ class StreamingQuerySuite extends
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21991
@HyukjinKwon thanks! Is it possible to use this script to merge this PR
which has many people involve? A good demonstration of collaboration in the
community.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21991
**[Test build #94329 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94329/testReport)**
for PR 21991 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21991
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21991
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21956
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94321/
Test PASSed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21632
cc also @jkbradley
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21199
**[Test build #94321 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94321/testReport)**
for PR 21199 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21991
I am merging this since this is not actually tested and only thing is
Python linter which is already passed.
---
-
To
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22016
**[Test build #94328 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94328/testReport)**
for PR 22016 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21956
@kiszk, I would appreciate if you feel free to open a PR fixing them, or
suggest them in someone's PR fixing them.
---
-
To
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21956
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21980
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21980#discussion_r208075258
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala
---
@@ -854,6 +854,26 @@ class StreamingQuerySuite extends
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22016
It's okie but mind taking another look and fix them in a batch while we are
here, @tynan-cr?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21721
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/17185
LGTM except some code style comment, thanks for working on it!
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22016
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21721
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94320/
Test PASSed.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208074858
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala
---
@@ -794,19 +795,37 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21721
**[Test build #94320 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94320/testReport)**
for PR 21721 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208074745
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala
---
@@ -169,25 +181,50 @@ package object expressions {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #94327 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94327/testReport)**
for PR 21860 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17185#discussion_r208073035
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/namedExpressions.scala
---
@@ -201,7 +204,7 @@ case class Alias(child:
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21596
Are we still waiting for the 2.4 code freeze @gatorsmile @Fokko ?
---
-
To unsubscribe, e-mail:
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22011#discussion_r208068968
--- Diff:
core/src/main/scala/org/apache/spark/api/java/JavaRDDBarrier.scala ---
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22011#discussion_r208068705
--- Diff: python/pyspark/rdd.py ---
@@ -2429,6 +2441,29 @@ def _wrap_function(sc, func, deserializer,
serializer, profiler=None):
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21895
This should also be backported to branch 2.2 and 2.3 @mridulm , this is a
regression.
@mgaido91 would you please create backport PRs for the separate branches?
---
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208067280
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosFineGrainedSchedulerBackend.scala
---
@@ -453,4 +453,8 @@
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208066204
--- Diff:
core/src/test/scala/org/apache/spark/BarrierStageOnSubmittedSuite.scala ---
@@ -185,4 +185,56 @@ class BarrierStageOnSubmittedSuite extends
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208067143
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -402,6 +403,18 @@ class DAGScheduler(
}
}
+
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208066391
--- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala ---
@@ -653,6 +653,10 @@ class SparkContextSuite extends SparkFunSuite with
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208066484
--- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala ---
@@ -653,6 +653,10 @@ class SparkContextSuite extends SparkFunSuite with
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208065883
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -496,6 +496,12 @@ class
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22001#discussion_r208065660
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1597,6 +1597,15 @@ class SparkContext(config: SparkConf) extends
Logging {
101 - 200 of 713 matches
Mail list logo
