Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r70432140
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +394,84 @@ case class
Github user yanboliang commented on the issue:
https://github.com/apache/spark/pull/14150
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r70431713
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +394,84 @@ case class
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r70431411
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +394,84 @@ case class
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/13873
ping @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13990
**[Test build #62166 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62166/consoleFull)**
for PR 13990 at commit
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14140#discussion_r70429952
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala
---
@@ -408,8 +409,12 @@ class IsotonicRegression private (private
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62159/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14150
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62160/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14150
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62160 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62160/consoleFull)**
for PR 14150 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13704
**[Test build #62159 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62159/consoleFull)**
for PR 13704 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14151
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14151
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62158/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14151
**[Test build #62158 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62158/consoleFull)**
for PR 14151 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/13701
ping @liancheng @yhuai again. Can you take a look? Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14132#discussion_r70426742
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -86,6 +86,7 @@ class Analyzer(
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14132#discussion_r70426735
--- Diff:
sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ---
@@ -945,8 +955,12 @@ SIMPLE_COMMENT
: '--' ~[\r\n]*
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14132#discussion_r70426683
--- Diff:
sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ---
@@ -347,6 +347,15 @@ querySpecification
windows?)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14153
**[Test build #62165 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62165/consoleFull)**
for PR 14153 at commit
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14132#discussion_r70425722
--- Diff:
sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ---
@@ -347,6 +347,15 @@ querySpecification
windows?)
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/14153
[SPARK-16440] [MLLIB] Undeleted broadcast variables in Word2Vec causing OoM
for long runs
## What changes were proposed in this pull request?
Unpersist broadcasted vars in Word2Vec.fit for
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14122
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14122
Merged to master, and 2.0 on the grounds that it's just an added
informative warning
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14152
**[Test build #62164 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62164/consoleFull)**
for PR 14152 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14152
CC @tdas
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/14152
[SPARK-16395] [STREAMING] Fail if too many CheckpointWriteHandlers are
queued up in the fixed thread pool
## What changes were proposed in this pull request?
Begin failing if checkpoint
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/11293#discussion_r70422619
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -127,33 +166,30 @@ abstract class Catalog {
*
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13494
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13494
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62156/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14142
**[Test build #62163 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62163/consoleFull)**
for PR 14142 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13494
**[Test build #62156 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62156/consoleFull)**
for PR 13494 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14104
@phalodi no need to ping. We don't merge things immediately, especially
when non-essential. It gives more time for review.
---
If your project is set up for it, you can reply to this email and have
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14142
Jenkins test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14142
Jenkins add to whitelist
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62155/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13704
**[Test build #62155 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62155/consoleFull)**
for PR 13704 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14132
**[Test build #62162 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62162/consoleFull)**
for PR 14132 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14151
**[Test build #62161 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62161/consoleFull)**
for PR 14151 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70418445
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62160 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62160/consoleFull)**
for PR 14150 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14151
**[Test build #62158 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62158/consoleFull)**
for PR 14151 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13704
**[Test build #62159 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62159/consoleFull)**
for PR 13704 at commit
GitHub user ScrapCodes opened a pull request:
https://github.com/apache/spark/pull/14151
[SPARK-16496][SQL] Add wholetext as data source for SQL.
## What changes were proposed in this pull request?
In multiple text analysis, problems it is not often desirable for the rows
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/13704
Thanks again for your kindly reviews. I addresses both comments.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user yanboliang commented on the issue:
https://github.com/apache/spark/pull/14150
@hvanhovell Yes, I updated the dependency manifests manually. I will change
to use the scripts you provided. Thanks for your kindly remind!
---
If your project is set up for it, you can reply
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14014#discussion_r70415596
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaConverter.scala
---
@@ -260,7 +260,7 @@
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14149
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62153/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14149
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14149
**[Test build #62153 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62153/consoleFull)**
for PR 14149 at commit
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14150
Hmmm it is also pulling in shapeless... did you manually update the
manifests?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13704
LGTM, one last comment:
https://github.com/apache/spark/pull/13704/files#r70381491
BTW can you also update the PR description? e.g. we don't need to show the
difference of generated code
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14150
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62157/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62157 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62157/consoleFull)**
for PR 14150 at commit
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14150
NVM...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14150
@yanboliang you need to update the dependency manifests. Run:
`./dev/test-dependencies.sh --replace-manifest`
---
If your project is set up for it, you can reply to this email and have your
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62157 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62157/consoleFull)**
for PR 14150 at commit
Github user yanboliang commented on the issue:
https://github.com/apache/spark/pull/14150
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13494
**[Test build #62156 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62156/consoleFull)**
for PR 13494 at commit
Github user lianhuiwang commented on the issue:
https://github.com/apache/spark/pull/13494
@cloud-fan I have addressed your latest comments. thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user maver1ck commented on the issue:
https://github.com/apache/spark/pull/14142
Can we test this ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/13890
@cloud-fan Thank you for merging this!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13704
**[Test build #62155 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62155/consoleFull)**
for PR 13704 at commit
Github user maver1ck commented on the issue:
https://github.com/apache/spark/pull/12913
Up ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user phalodi commented on the issue:
https://github.com/apache/spark/pull/14104
@srowen Is this is correct if it is then please merge it otherwise give
comment if needed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70404870
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to the
Github user lianhuiwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r70404513
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuerySuite.scala
---
@@ -0,0 +1,122 @@
+/*
+ * Licensed to
Github user lianhuiwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r70404475
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlyQuery.scala
---
@@ -0,0 +1,162 @@
+/*
+ * Licensed to the
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13890
merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/13890
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70402730
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62154 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62154/consoleFull)**
for PR 14150 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14150
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62154/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14150
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14150
**[Test build #62154 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62154/consoleFull)**
for PR 14150 at commit
GitHub user yanboliang opened a pull request:
https://github.com/apache/spark/pull/14150
[SPARK-16494] [ML] Upgrade breeze version to 0.12
## What changes were proposed in this pull request?
breeze 0.12 has been released for more than half a year, and it brings lots
of new
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62152/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13704
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13704
**[Test build #62152 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62152/consoleFull)**
for PR 13704 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14145
I think you're right. `doCheckpoint` gets called with
`clearCheckpointDataLater = false` when it means "do a checkpoint, but, the
batch isn't actually done yet". In those cases, yes you don't mark
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13890
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62150/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13890
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13778
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62151/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13778
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13890
**[Test build #62150 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62150/consoleFull)**
for PR 13890 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13778
**[Test build #62151 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62151/consoleFull)**
for PR 13778 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14065
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62149/
Test PASSed.
---
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70398569
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14065
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14065
**[Test build #62149 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62149/consoleFull)**
for PR 14065 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70397586
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14149
**[Test build #62153 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62153/consoleFull)**
for PR 14149 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14137
Yes, elsewhere in graphx I remember trying this and it was tricky because
you had to hold a reference to the old RDD, evaluate and persist the next one
that depends on it, and _then_ unpersist the
GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/14149
[SPARK-16435][YARN][MINOR] Add warning log if initialExecutors is less than
minExecutors
## What changes were proposed in this pull request?
Currently if
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14121
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user wesolowskim commented on the issue:
https://github.com/apache/spark/pull/14137
Great we're on the same page finally. I can try to add unpersists however
it is indeed tricky and at first try I wasn't able to unpersist every RDD and
at the return had few RDD still in cache.
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14121
Merged to master/2.0
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/13704#discussion_r70395547
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala
---
@@ -0,0 +1,120 @@
+/*
+ * Licensed to the
401 - 500 of 545 matches
Mail list logo
