Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21774#discussion_r203945436
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/package.scala ---
@@ -36,4 +40,27 @@ package object avro {
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21815
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21815#discussion_r203947912
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/FileSourceScanExecSuite.scala
---
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21774
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21758
Hi @jiangxb1987 one question about barrier task.
For example, `rddA` is marked as barrier, and `rddB` is a normal RDD, if
`rddC = rddA.union(rddB)`, seems it contains both normal task and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21774
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r203962951
--- Diff: python/pyspark/sql/functions.py ---
@@ -2382,6 +2382,20 @@ def array_sort(col):
return
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21789
@cloud-fan @gatorsmile this change seems reasonable to me. Do you think we
can trigger a build? Thanks.
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21733
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21733
**[Test build #93324 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93324/testReport)**
for PR 21733 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21733
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93324/
Test FAILed.
---
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21824
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93326/
Test FAILed.
---
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r203964623
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3805,3 +3799,332 @@ object ArrayUnion
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21825
**[Test build #93329 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93329/testReport)**
for PR 21825 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21825
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21825
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21825
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r203968311
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -85,14 +85,20 @@ case class ReusedExchangeExec(override
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r203968608
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1184,6 +1186,137 @@ case class
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21823#discussion_r203969926
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala
---
@@ -237,7 +239,7 @@ abstract class QueryPlan[PlanType <:
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21774
I will create another separate PR to totally remove SerializableSchema.
---
-
To unsubscribe, e-mail:
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21789
@zuotingbing I think what @dongjoon-hyun was suggesting you was to put
`[STS]` instead of `[SQL]` in the title of the PR. May you please update
accordingly? Thanks.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21815
Let me update it soon.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21815
**[Test build #93335 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93335/testReport)**
for PR 21815 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user zuotingbing commented on the issue:
https://github.com/apache/spark/pull/21789
@mgaido91 yes , update it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user httfighter opened a pull request:
https://github.com/apache/spark/pull/21826
[SPARK-24872] Remove the symbol â||â of the âORâ operation
## What changes were proposed in this pull request?
â||â will perform the function of STRING concat, and it is also the
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21820
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user woodthom2 opened a pull request:
https://github.com/apache/spark/pull/21828
Update regression.py
Correct typo impuriy -> impurity
(this would have stopped GBT working for some hyperparameter configurations)
## What changes were proposed in this pull request?
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21828
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/21049
@gatorsmile Sure.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20057
**[Test build #93322 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93322/testReport)**
for PR 20057 at commit
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21823
@cloud-fan Cast 'Key' to lower case is done by rule of ResolveReferences:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21813
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r203955095
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -2086,6 +2087,20 @@ class Analyzer(
}
Github user danielvdende commented on a diff in the pull request:
https://github.com/apache/spark/pull/20057#discussion_r203955129
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
---
@@ -102,7 +102,12 @@ object JdbcUtils extends
Github user danielvdende commented on the issue:
https://github.com/apache/spark/pull/20057
Just made the changes you mentioned @gatorsmile :-)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r203968939
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -2086,6 +2087,20 @@ class Analyzer(
}
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20861#discussion_r203968743
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1994,6 +1996,20 @@ class Analyzer(
}
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21815#discussion_r203979619
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/FileSourceScanExecSuite.scala
---
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21823#discussion_r203979598
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala
---
@@ -282,9 +282,9 @@ object QueryPlan extends
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21826
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21827
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user hejiefang opened a pull request:
https://github.com/apache/spark/pull/21827
[SPARK-24873]Increase switch to shielding frequent interaction reportâ¦
[https://issues.apache.org/jira/browse/SPARK-24873](url)
[SPARK-24873]Increase switch to shielding frequent
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21828#discussion_r203994108
--- Diff: python/pyspark/ml/regression.py ---
@@ -1116,7 +1116,7 @@ def setParams(self, featuresCol="features",
labelCol="label", predictionCol="pre
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21805#discussion_r203949905
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala ---
@@ -206,4 +206,19 @@ class DatasetCacheSuite extends QueryTest with
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21049
@dilipbiswal Can you take this over?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20057#discussion_r203949498
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
---
@@ -105,7 +105,12 @@ object JdbcUtils extends
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20057
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20057#discussion_r203948972
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala ---
@@ -120,11 +121,26 @@ abstract class JdbcDialect extends Serializable
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21813
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21732#discussion_r203959050
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala ---
@@ -183,6 +184,43 @@ case class OptionBooleanAggregator(colName:
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r203966689
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -85,14 +85,20 @@ case class ReusedExchangeExec(override val
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21815#discussion_r203979151
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/FileSourceScanExecSuite.scala
---
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21823#discussion_r203978990
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala
---
@@ -282,9 +282,9 @@ object QueryPlan extends
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21823#discussion_r203979413
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala
---
@@ -237,7 +237,7 @@ abstract class QueryPlan[PlanType <:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21826
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21826
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21821
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93323/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21821
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21827
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21827
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21821
**[Test build #93323 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93323/testReport)**
for PR 21821 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20761
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20761
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93339/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20761
**[Test build #93339 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93339/testReport)**
for PR 20761 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20761
**[Test build #93340 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93340/testReport)**
for PR 20761 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21824
**[Test build #93326 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93326/testReport)**
for PR 21824 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21824
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203959389
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1349,6 +1339,48 @@ class DAGScheduler(
s"longer
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21823
@cloud-fan fix this in dedupRight is Ok, but maybe there are other
operations like dedupRight to change the case of the word.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203959637
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -274,7 +274,9 @@ private[spark] class TaskSchedulerImpl(
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21823
@cloud-fan why not fix this in doCanonicalize? I think it is better to fix
it in doCanonicalize, but I'm not very sure.
---
-
GitHub user 10110346 opened a pull request:
https://github.com/apache/spark/pull/21825
[SPARK-18188][DOC][FOLLOW-UP]Add `spark.broadcast.checksum` to configuration
## What changes were proposed in this pull request?
This pr add `spark.broadcast.checksum` to configuration.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21824
**[Test build #93326 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93326/testReport)**
for PR 21824 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21824
**[Test build #93330 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93330/testReport)**
for PR 21824 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21774
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21774
**[Test build #93331 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93331/testReport)**
for PR 21774 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21774
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r203972003
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -85,14 +85,20 @@ case class ReusedExchangeExec(override val
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21802#discussion_r203974038
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -1184,6 +1186,137 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21823
**[Test build #93332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93332/testReport)**
for PR 21823 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21823
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21823
**[Test build #9 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/9/testReport)**
for PR 21823 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21815
**[Test build #93334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93334/testReport)**
for PR 21815 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21828
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user woodthom2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21828#discussion_r203994440
--- Diff: python/pyspark/ml/regression.py ---
@@ -1116,7 +1116,7 @@ def setParams(self, featuresCol="features",
labelCol="label", predictionCol="pre
1 - 100 of 606 matches
Mail list logo
