Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/20285#discussion_r162223829
--- Diff: examples/src/main/python/ml/vector_size_hint_example.py ---
@@ -0,0 +1,57 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/20302
cc @hvanhovell @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user brkyvz opened a pull request:
https://github.com/apache/spark/pull/20302
[SPARK-23094] Fix invalid character handling in JsonDataSource
## What changes were proposed in this pull request?
There were two related fixes regarding `from_json`, `get_json_object` and
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/20243
LGTM, assuming tests pass.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/20226#discussion_r162224065
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -45,7 +46,12 @@ trait CodegenSupport extends
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19247
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20255
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20286
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20255
Merging to master and 2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20286
LGTM. Merging to master and 2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20285
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86302/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20255
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86303/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20285
**[Test build #86302 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86302/testReport)**
for PR 20285 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20285
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20255
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20255
**[Test build #86303 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86303/testReport)**
for PR 20255 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18906
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18906
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86293/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18906
**[Test build #86293 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86293/testReport)**
for PR 18906 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20286
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20286
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86292/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20286
**[Test build #86292 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86292/testReport)**
for PR 20286 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20255
**[Test build #86303 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86303/testReport)**
for PR 20255 at commit
Github user MrBago commented on the issue:
https://github.com/apache/spark/pull/20285
Thanks for the review @BryanCutler, I've added a java example & uploaded 2
screenshots.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20285
**[Test build #86302 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86302/testReport)**
for PR 20285 at commit
Github user MrBago commented on the issue:
https://github.com/apache/spark/pull/20285
https://user-images.githubusercontent.com/223219/35074422-9c192bf6-fba2-11e7-8be1-35279db1df49.png;>
---
-
To unsubscribe,
Github user MrBago commented on the issue:
https://github.com/apache/spark/pull/20285
https://user-images.githubusercontent.com/223219/35074406-90b074ea-fba2-11e7-853b-45e3c447fe68.png;>
---
-
To unsubscribe,
Github user merlintang commented on the issue:
https://github.com/apache/spark/pull/19885
@jerryshao can you backport this to branch 2.2 as well.
thanks
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20297
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86289/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20299
**[Test build #86301 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86301/testReport)**
for PR 20299 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20297
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20299
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20297
**[Test build #86289 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86289/testReport)**
for PR 20297 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20299
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86291/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20299
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20299
**[Test build #86291 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86291/testReport)**
for PR 20299 at commit
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20255#discussion_r162199330
--- Diff: docs/structured-streaming-programming-guide.md ---
@@ -1089,6 +1101,300 @@ streamingDf.join(staticDf, "type", "right_join") #
right outer join
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/20255#discussion_r162212307
--- Diff: docs/structured-streaming-programming-guide.md ---
@@ -1089,6 +1101,300 @@ streamingDf.join(staticDf, "type", "right_join") #
right outer join
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20226
**[Test build #86300 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86300/testReport)**
for PR 20226 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/20275
Unless someone like @jkbradley or @MLnick objects, I think this doesn't
hurt and actually makes things a little more consistent.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20226
**[Test build #86299 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86299/testReport)**
for PR 20226 at commit
Github user tejasapatil commented on the issue:
https://github.com/apache/spark/pull/20226
Jenkins retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20269
**[Test build #4058 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4058/testReport)**
for PR 20269 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20300
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/20300
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19247
Thanks! Merging to master and 2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19247
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86288/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19247
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19247
**[Test build #86288 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86288/testReport)**
for PR 19247 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20243
**[Test build #86298 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86298/testReport)**
for PR 20243 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20300
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20300
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86294/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20300
**[Test build #86294 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86294/testReport)**
for PR 20300 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20301
**[Test build #86297 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86297/testReport)**
for PR 20301 at commit
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/20301
[SPARK-23131][CORE][WIP] Stackoverflow using ML and Kryo serializer
## What changes were proposed in this pull request?
Update chill to 0.9.2, Kryo to 4.0.x, to get bug fixes and
Github user icexelloss commented on the issue:
https://github.com/apache/spark/pull/20239
Thanks for everyone for review!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20294
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20294
Merged to master and branch-2.3.
Thanks for reviewing this, @srowen, @imatiach-msft, @MrBago and
@BryanCutler.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/20300
Thanks @srowen, I honestly tried to look for more and was surprised this
was all I could find!
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86290/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20295
**[Test build #86290 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86290/testReport)**
for PR 20295 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20239
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20243
**[Test build #86296 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86296/testReport)**
for PR 20243 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20239
Merged to master and branch-2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20288#discussion_r162198033
--- Diff: python/pyspark/sql/catalog.py ---
@@ -224,92 +224,20 @@ def dropGlobalTempView(self, viewName):
"""
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20282
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20282
LGTM. Merging to master and 2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20225
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20282
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20282
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86285/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20282
**[Test build #86285 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86285/testReport)**
for PR 20282 at commit
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/20225
LGTM. Merging this to master and 2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20243
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20243
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86284/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20243
**[Test build #86284 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86284/testReport)**
for PR 20243 at commit
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/20284
Ah, thanks for the explanation!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20284
It is actually. Before, negative values (empty metrics all have value "-1")
would show up when starting iteration from 0, and now they don't.
```
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/20284
@vanzin The unit test fix is not related to the sorting issue right? Also
it's totally fine to include it in this PR since it's minor.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20284
**[Test build #86295 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86295/testReport)**
for PR 20284 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20300
**[Test build #86294 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86294/testReport)**
for PR 20300 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20225
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86283/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20225
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20225
**[Test build #86283 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86283/testReport)**
for PR 20225 at commit
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/20300
ping @holdenk @MLnick
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/20300
[MINOR] Fix typos in ML scaladocs
## What changes were proposed in this pull request?
Fixed some typos found in ML scaladocs
## How was this patch tested?
NA
You can
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/20284
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18906
**[Test build #86293 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86293/testReport)**
for PR 18906 at commit
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/20243#discussion_r162182456
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/ConsoleWriter.scala
---
@@ -0,0 +1,57 @@
+/*
+ * Licensed to the
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20045#discussion_r162182000
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ExpressionParserSuite.scala
---
@@ -246,13 +246,24 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20286
**[Test build #86292 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86292/testReport)**
for PR 20286 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20299
**[Test build #86291 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86291/testReport)**
for PR 20299 at commit
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/20299
[SPARK-23135][ui] Fix rendering of accumulators in the stage page.
This follows the behavior of 2.2: only named accumulators with a
value are rendered.
Screenshot:
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20284#discussion_r162168466
--- Diff:
common/kvstore/src/test/java/org/apache/spark/util/kvstore/DBIteratorSuite.java
---
@@ -112,7 +114,8 @@ public void setup() throws Exception {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20298
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user smurakozi commented on the issue:
https://github.com/apache/spark/pull/20045
@gatorsmile @hvanhovell @jiangxb1987, could you have a look, please?
---
-
To unsubscribe, e-mail:
Github user RussellSpitzer commented on the issue:
https://github.com/apache/spark/pull/20190
@jerryshao https://github.com/apache/spark/pull/20298
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user RussellSpitzer opened a pull request:
https://github.com/apache/spark/pull/20298
[SPARK-22976][Core]: Cluster mode driver dir removed while running
## What changes were proposed in this pull request?
The clean up logic on the worker perviously determined the
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20284#discussion_r162166090
--- Diff:
common/kvstore/src/test/java/org/apache/spark/util/kvstore/DBIteratorSuite.java
---
@@ -112,7 +114,8 @@ public void setup() throws Exception {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19872
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86280/
Test PASSed.
---
201 - 300 of 628 matches
Mail list logo