Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22337#discussion_r215853362
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/ExchangeCoordinatorSuite.scala
---
@@ -31,6 +31,7 @@ class ExchangeCoordinatorSuite
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22355
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22355
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22347
Thank you for your update.
Is it better to add test case to confirm the state of the internal
structures is as you expected? @maropu
---
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/22324
If I find the reason why the numbers are different, I'll make pr in a new
jira.
https://github.com/apache/spark/pull/22324#discussion_r215461695
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22262
Thank you, @seancxmao .
Also, I made a PR to you, https://github.com/seancxmao/spark/pull/1 , to
simply the logic.
Could you review and merge that if you think that's okay?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22355
**[Test build #95781 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95781/testReport)**
for PR 22355 at commit
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/22270
cc @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22357
**[Test build #95780 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95780/testReport)**
for PR 22357 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22357
cc @dbtsai
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/22357
[SPARK-25363][SQL] Fix schema pruning in where clause by ignoring
unnecessary root fields
## What changes were proposed in this pull request?
Schema pruning doesn't work if nested
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22138
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22138
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95777/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22138
**[Test build #95777 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95777/testReport)**
for PR 22138 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95776/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user seancxmao commented on the issue:
https://github.com/apache/spark/pull/22262
I updated the PR description. Thank you for pointing that PR description
should stay focused. I also think it's more clear.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21221
**[Test build #95776 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95776/testReport)**
for PR 21221 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22262
Sorry, but I'm still feeling that this PR is losing focus. How about
mentioning what you do in this PR like the following?
```
Apache Spark doesn't create Hive table with
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22324
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22356
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22232
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22324
Merged to master/2.4
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22327
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22356
Merged to master/2.4
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22327
Merged to master/2.4/2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/17899#discussion_r215843736
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -726,14 +726,36 @@ object CollapseRepartition
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22282
**[Test build #95779 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95779/testReport)**
for PR 22282 at commit
Github user dongjinleekr commented on the issue:
https://github.com/apache/spark/pull/22282
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user LantaoJin closed the pull request at:
https://github.com/apache/spark/pull/20876
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22349#discussion_r215840879
--- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala
---
@@ -35,6 +35,8 @@ import org.apache.spark.sql.types._
*/
Github user phegstrom commented on the issue:
https://github.com/apache/spark/pull/7
hey @HyukjinKwon , the SparkR test now failing is
```
Duplicated \argument entries in documentation object
'column_string_functions':
'pattern'
Functions with \usage
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22354
cc @jerryshao
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22327
From further discussion on the JIRA, looks like there is not an obvious
immediate resolution, and we are about to release 2.3.2 and 2.4, and have a
nontrivial problem vs a theoretical set of bug
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/20999
you're not wrong, but I just meant you don't need to describe "Credit for
that should be given to him." in the PR description.
---
Github user cloud-fan closed the pull request at:
https://github.com/apache/spark/pull/22354
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22354
thanks, merging to 2.3!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22311
**[Test build #95778 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95778/testReport)**
for PR 22311 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22311
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22311
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22311
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22329
Thanks guys :-)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18756
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22352
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22352
thanks, merging to master/2.4 (since it's a followup)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22326
Gental ping @mgaido91 @HyukjinKwon @dilipbiswal, great thanks for advice,
please have a look when you have time.
---
-
To
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22140
Thanks @BryanCutler @HyukjinKwon !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22162
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95775/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22162
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22162
**[Test build #95775 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95775/testReport)**
for PR 22162 at commit
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21320
Thanks @mallman for schema pruning work which will be a big win in our
pattern of accessing our data.
I'm testing this new feature, and find `where clause` on the selected
nested column can
Github user 10110346 closed the pull request at:
https://github.com/apache/spark/pull/22350
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user 10110346 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22350#discussion_r215819785
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -123,6 +123,9 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22138
**[Test build #95777 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95777/testReport)**
for PR 22138 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/7
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95774/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/7
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/7
**[Test build #95774 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95774/testReport)**
for PR 7 at commit
Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/22138#discussion_r215818860
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/FetchedPoolSuite.scala
---
@@ -0,0 +1,299 @@
+/*
+ * Licensed
Github user SongYadong commented on the issue:
https://github.com/apache/spark/pull/22348
In my test, total executing time of 4885 spark applications:
origin: 447213 seconds
after : 444584 seconds
time saved : about 0.6%
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21221
**[Test build #95776 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95776/testReport)**
for PR 21221 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22350#discussion_r215812113
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -123,6 +123,9 @@ class
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/22318
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tigerquoll commented on the issue:
https://github.com/apache/spark/pull/21308
@rdblue I think our debate is whether we should expose an API to represent
direct operations on partitions in the new datasource api.
---
Github user NiharS commented on the issue:
https://github.com/apache/spark/pull/22192
I tested @vanzin's suggestion of storing the classloader, changing it to
replClassLoader, and changing back after init (and then changing again for
shutdown). It's working well (and this time I made
Github user tigerquoll commented on the issue:
https://github.com/apache/spark/pull/21308
@rdblue Actually: https://issues.apache.org/jira/browse/SPARK-22389.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22219
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22323
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user bomeng commented on the issue:
https://github.com/apache/spark/pull/22356
Thanks for taking my codes. Looks good.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22215
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22323
I'm going to merge this, for Spark 3.0 we should look at
https://github.com/apache/spark/pull/22323#discussion_r215799370 though.
---
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22323#discussion_r215806032
--- Diff: docs/running-on-kubernetes.md ---
@@ -215,6 +215,19 @@
spark.kubernetes.driver.volumes.persistentVolumeClaim.checkpointpvc.options.clai
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22215
Yup this can merge now, thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22356
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95771/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22356
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22356
**[Test build #95771 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95771/testReport)**
for PR 22356 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22298
Yeah this looks ok to me, would like a +1 from @felixcheung and @holdenk.
---
-
To unsubscribe, e-mail:
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21308
@tigerquoll, there is currently no support to expose partitions through the
v2 API. That would be a different operation. If you wanted to implement
partition operations through this API, then you
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22356
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95769/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22356
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22356
**[Test build #95769 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95769/testReport)**
for PR 22356 at commit
Github user tigerquoll commented on the issue:
https://github.com/apache/spark/pull/21308
@rdblue what about those data sources that support record deletion and
partition dropping as two semantically different operations - Kudu and Hbase
being two examples.
All systems
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21899
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95773/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21899
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21899
**[Test build #95773 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95773/testReport)**
for PR 21899 at commit
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/22323#discussion_r215799370
--- Diff: docs/running-on-kubernetes.md ---
@@ -215,6 +215,19 @@
spark.kubernetes.driver.volumes.persistentVolumeClaim.checkpointpvc.options.clai
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22354
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95770/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22354
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22354
**[Test build #95770 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95770/testReport)**
for PR 22354 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21221
@edwinalu - this can merge now that Spark 2.4's release branch has been
cut, but there's conflicting files now. Can we clear the conflicts and then we
can merge this?
---
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22146
@mccheah @erikerlandson given that banch-2.4 has already been cut, we have
more flexibility in terms of timing of getting this in, as well as more space
for thoughts to get this right. I don't
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95768/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22010
**[Test build #95768 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95768/testReport)**
for PR 22010 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22010
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95767/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22010
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22010
**[Test build #95767 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95767/testReport)**
for PR 22010 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22352
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95766/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22352
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
1 - 100 of 451 matches
Mail list logo
