Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/13593
@rxin @liancheng I see. Since the existing Dataset API
`sparkSession.catalog.uncacheTable("non-cachedTable")` issues an error if
uncaching non-cached tables. Thus, to ensure both SQL statements
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13137
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13137
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60336/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13137
**[Test build #60336 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60336/consoleFull)**
for PR 13137 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13444
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60335/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60335 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60335/consoleFull)**
for PR 13444 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/13572#discussion_r66701399
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/cache.scala ---
@@ -17,30 +17,30 @@
package
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60333/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13571
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60330/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13613
**[Test build #60333 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60333/consoleFull)**
for PR 13613 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13571
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13571
**[Test build #60330 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60330/consoleFull)**
for PR 13571 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13616
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60334/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13616
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13616
**[Test build #60334 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60334/consoleFull)**
for PR 13616 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13596
**[Test build #60337 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60337/consoleFull)**
for PR 13596 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13572
**[Test build #60338 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60338/consoleFull)**
for PR 13572 at commit
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/13596
@cloud-fan I modified the test.
Please take a look at it again.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13596#discussion_r66700916
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ---
@@ -321,7 +321,8 @@ class CachedTableSuite extends QueryTest with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13595
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60329/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13595
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13595
**[Test build #60329 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60329/consoleFull)**
for PR 13595 at commit
Github user sameeragarwal commented on the issue:
https://github.com/apache/spark/pull/13419
I ended up creating a small design doc describing the problem and
presenting 2 possible solutions at
Github user sameeragarwal closed the pull request at:
https://github.com/apache/spark/pull/13419
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12938
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user WeichenXu123 commented on a diff in the pull request:
https://github.com/apache/spark/pull/13381#discussion_r66700697
--- Diff:
examples/src/main/scala/org/apache/spark/examples/ml/IsotonicRegressionExample.scala
---
@@ -0,0 +1,62 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12938
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60332/
Test FAILed.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/13415
Thank you! @andrewor14
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/12938
**[Test build #60332 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60332/consoleFull)**
for PR 12938 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13381
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13381
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60331/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13381
**[Test build #60331 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60331/consoleFull)**
for PR 13381 at commit
Github user mhmoudr commented on the issue:
https://github.com/apache/spark/pull/13588
This PR contains exactly the same fix but targeting version 1.6 as if there
is a plan to release 1.6.2 in the future, if that was not the case let me know
to close it.
---
If your project is set
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13501
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user davies commented on the issue:
https://github.com/apache/spark/pull/13501
Merging this into master and 2.0, thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13137
**[Test build #60336 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60336/consoleFull)**
for PR 13137 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/13444
@yhuai okay, fixed. I also fixed #13137 in the same way.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13444
**[Test build #60335 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60335/consoleFull)**
for PR 13444 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/13371
@liancheng Got it.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13596#discussion_r66700295
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ---
@@ -321,7 +321,8 @@ class CachedTableSuite extends QueryTest with
Github user WeichenXu123 commented on a diff in the pull request:
https://github.com/apache/spark/pull/13592#discussion_r66700281
--- Diff: docs/sql-programming-guide.md ---
@@ -517,24 +517,26 @@ types such as Sequences or Arrays. This RDD can be
implicitly converted to a Dat
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/13592#discussion_r66700277
--- Diff: docs/sql-programming-guide.md ---
@@ -1607,13 +1600,13 @@ a regular multi-line JSON file will most often fail.
{% highlight r %}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13616
**[Test build #60334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60334/consoleFull)**
for PR 13616 at commit
Github user liancheng commented on the issue:
https://github.com/apache/spark/pull/13371
Reverted from master and branch-2.0.
@viirya For the benchmark, there are two things:
1. The benchmark also counts Parquet file writing into it, so the real
number should be much
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13566
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13596#discussion_r66700211
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala ---
@@ -321,7 +321,8 @@ class CachedTableSuite extends QueryTest with
GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/13616
[SPARK-15585][SQL] Add doc for turning off quotations
## What changes were proposed in this pull request?
This pr is to add doc for turning off quotations because this behavior is
different
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13613
**[Test build #60333 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60333/consoleFull)**
for PR 13613 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13596#discussion_r66700185
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -105,7 +105,7 @@ private[sql] class CacheManager extends
Github user davies commented on the issue:
https://github.com/apache/spark/pull/13566
LGTM,
Merging this into master and 2.0, thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/12938
**[Test build #60332 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60332/consoleFull)**
for PR 12938 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13381
**[Test build #60331 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60331/consoleFull)**
for PR 13381 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13571
**[Test build #60330 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60330/consoleFull)**
for PR 13571 at commit
Github user ioana-delaney commented on the issue:
https://github.com/apache/spark/pull/13570
@hvanhovell The EXISTS/NOT EXISTS predicates will have an empty condition.
e.g.
select c1 from t1 where EXISTS (select c2 from t2)
== Optimized Logical Plan ==
Project
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/13371
@rxin One thing needs to be explain is, because we just have one
configuration to control filter push down, it affects row-based filter push
down and this row-group filter push down.
The
Github user zjffdu commented on the issue:
https://github.com/apache/spark/pull/13557
@jkbradley Could you help review it ? Thanks
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12313
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60327/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/12313
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/12313
**[Test build #60327 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60327/consoleFull)**
for PR 12313 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13595
**[Test build #60329 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60329/consoleFull)**
for PR 13595 at commit
Github user WeichenXu123 commented on a diff in the pull request:
https://github.com/apache/spark/pull/13592#discussion_r66699400
--- Diff: docs/sql-programming-guide.md ---
@@ -1607,13 +1600,13 @@ a regular multi-line JSON file will most often fail.
{% highlight r %}
Github user WeichenXu123 commented on the issue:
https://github.com/apache/spark/pull/13544
@liancheng OK, no problem !
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60328/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13613
**[Test build #60328 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60328/consoleFull)**
for PR 13613 at commit
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/13606
@srowen , the [[streaming programming guide] -
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60326/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13613
**[Test build #60326 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60326/consoleFull)**
for PR 13613 at commit
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/13147
@marmbrus Thank you for merging this!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13612
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13612
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60325/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13612
**[Test build #60325 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60325/consoleFull)**
for PR 13612 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/13371
And once we have more data, it might make sense to merge this in 2.0!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/13371
To be more clear, please write a proper benchmark that reads data when
filter push down is not useful to compare whether this regress performance for
the non-push-down case. Also make sure the
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/13371
I just talked to @liancheng offline. I don't think we should've merged this
until we have verified there is no performance regression, and we definitely
shouldn't have merged this in 2.0.
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/13596
@cloud-fan Thank you for your review.
That's right, so we can't unregister the `batchStats` accumulator here yet.
---
If your project is set up for it, you can reply to this email and have your
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13381
**[Test build #3079 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3079/consoleFull)**
for PR 13381 at commit
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13596#discussion_r66698444
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ---
@@ -105,7 +105,7 @@ private[sql] class CacheManager extends Logging {
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13393
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user liancheng commented on the issue:
https://github.com/apache/spark/pull/13544
Ah, too bad... I wasn't aware of this PR when I was doing #13592. Will
review this one to see whether I missed something in #13592. Thanks for working
on this!
---
If your project is set up for
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/13381#discussion_r66698378
--- Diff:
examples/src/main/java/org/apache/spark/examples/mllib/JavaIsotonicRegressionExample.java
---
@@ -35,14 +37,15 @@ public static void
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/13381#discussion_r66698376
--- Diff: docs/ml-classification-regression.md ---
@@ -685,6 +685,76 @@ The implementation matches the result from R's
survival function
Github user jkbradley commented on a diff in the pull request:
https://github.com/apache/spark/pull/13381#discussion_r66698380
--- Diff:
examples/src/main/scala/org/apache/spark/examples/ml/IsotonicRegressionExample.scala
---
@@ -0,0 +1,62 @@
+/*
+ * Licensed to the
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13371
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user liancheng commented on the issue:
https://github.com/apache/spark/pull/13371
@yhuai We used to support row group level filter push-down before
refactoring `HadoopFsRelation` into `FileFormat`, but lost it (by accident I
guess) after the refactoring. So now we only have
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13613
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60324/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13613
**[Test build #60324 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60324/consoleFull)**
for PR 13613 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13612
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60323/
Test PASSed.
---
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/13595
@zsxwing @tdas, sure, this can wait. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13612
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13612
**[Test build #60323 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60323/consoleFull)**
for PR 13612 at commit
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/13570
@ioana-delaney no worries. I think the approach you have taken is the
correct one. I have left one smallish comment.
---
If your project is set up for it, you can reply to this email and have
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/13570#discussion_r66697830
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1715,31 +1715,52 @@ object
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/13570#discussion_r66697790
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1715,31 +1715,52 @@ object
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13596
My suggestion is: in `InMemoryRelation.uncache`, we set `batchStats` to
null at the end, when this `InMemoryRelation` get executed again, it will
regenerate the accumulator and register it.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13381
**[Test build #3079 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3079/consoleFull)**
for PR 13381 at commit
1 - 100 of 618 matches
Mail list logo
