Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16857
**[Test build #72934 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72934/testReport)**
for PR 16857 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16857
**[Test build #72934 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72934/testReport)**
for PR 16857 at commit
Github user vitillo commented on the issue:
https://github.com/apache/spark/pull/16857
@zsxwing I updated the PR as per proposal
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/16920
Why is this necessary? It seems like an extra step needed and doesn't
provide any real information.
I suggest you use this:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16939
**[Test build #72933 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72933/testReport)**
for PR 16939 at commit
GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/16939
[SPARK-16475][SQL] broadcast hint for SQL queries - follow up
## What changes were proposed in this pull request?
A small update to https://github.com/apache/spark/pull/16925
1. Rename
Github user heuermh commented on a diff in the pull request:
https://github.com/apache/spark/pull/16856#discussion_r101275550
--- Diff: docs/programming-guide.md ---
@@ -153,13 +149,12 @@ JavaSparkContext sc = new JavaSparkContext(conf);
-The first thing a
Github user heuermh commented on a diff in the pull request:
https://github.com/apache/spark/pull/16856#discussion_r101275374
--- Diff: docs/programming-guide.md ---
@@ -125,15 +124,12 @@ $ PYSPARK_PYTHON=/opt/pypy-2.5/bin/pypy
bin/spark-submit examples/src/main/pytho
Github user Krimit commented on the issue:
https://github.com/apache/spark/pull/16811
@jkbradley - updated
Added an explicit new test as requested, although the existing test already
covers it (by virtue of the existing methods calling the new methods)
---
If your project
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16938
**[Test build #72932 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72932/testReport)**
for PR 16938 at commit
GitHub user windpiger opened a pull request:
https://github.com/apache/spark/pull/16938
[SPARK-19583][SQL]CTAS for data source table with a created location should
succeed
## What changes were proposed in this pull request?
```
spark.sql(
s"""
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16937
**[Test build #72931 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72931/testReport)**
for PR 16937 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16937
Please yell at me if any author of the PRs is active. I will definitely
take it out.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16937
cc @srowen.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/16937
[BUILD] Close stale PRs
## What changes were proposed in this pull request?
This PR proposes to close stale PRs.
What I mean by "stale" here, there are some review comments by
Github user philipphoffmann commented on the issue:
https://github.com/apache/spark/pull/16755
Created a Jira and linked it
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/13072
Ideally all processes we have should handle thread termination correctly,
same applies to MesosClusterDispatcher. Btw I think the call in Executor.scala
should be done in static code, for example in
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14830
Thanks @Stibbons. FWIW, I won't stay against but am just neutral. Let me
please defer to @holdenk and @srowen.
---
If your project is set up for it, you can reply to this email and have your
Github user Stibbons commented on the issue:
https://github.com/apache/spark/pull/14830
Hello. This is actually the execution of the pylint/autopep8 config
proposed in #14963. I can minimize a little bit more this PR by ignoring indeed
more rules.
---
If your project is set up for
Github user Stibbons commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101263394
--- Diff: examples/src/main/python/mllib/naive_bayes_example.py ---
@@ -24,16 +24,17 @@
from __future__ import print_function
+#
Github user Stibbons commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101263279
--- Diff:
examples/src/main/python/mllib/streaming_linear_regression_example.py ---
@@ -25,13 +25,14 @@
# $example off$
from pyspark
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101263268
--- Diff: examples/src/main/python/mllib/naive_bayes_example.py ---
@@ -24,16 +24,17 @@
from __future__ import print_function
+#
Github user Stibbons commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101263182
--- Diff: examples/src/main/python/streaming/network_wordjoinsentiments.py
---
@@ -54,22 +54,25 @@ def print_happiest_words(rdd):
# Read in
Github user Stibbons commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101262948
--- Diff:
examples/src/main/python/ml/decision_tree_classification_example.py ---
@@ -65,8 +67,9 @@
predictions.select("prediction",
Github user Stibbons commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101262606
--- Diff: examples/src/main/python/ml/count_vectorizer_example.py ---
@@ -17,23 +17,26 @@
from __future__ import print_function
-from
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14830
@Stibbons are there maybe some options in autopep8 to minimise the changes?
(just in case I believe we ignore some rules such as E402,E731,E241,W503 and
E226 in Spark).
---
If your project is
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101255529
--- Diff: docs/streaming-programming-guide.md ---
@@ -1626,10 +1626,10 @@ See the full [source
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101256136
--- Diff: examples/src/main/python/ml/count_vectorizer_example.py ---
@@ -17,23 +17,26 @@
from __future__ import print_function
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101257317
--- Diff: examples/src/main/python/streaming/network_wordjoinsentiments.py
---
@@ -54,22 +54,25 @@ def print_happiest_words(rdd):
# Read
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101256694
--- Diff:
examples/src/main/python/ml/decision_tree_classification_example.py ---
@@ -65,8 +67,9 @@
predictions.select("prediction",
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101259038
--- Diff:
examples/src/main/python/mllib/linear_regression_with_sgd_example.py ---
@@ -22,9 +22,11 @@
from pyspark import SparkContext
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101258928
--- Diff: examples/src/main/python/mllib/naive_bayes_example.py ---
@@ -24,16 +24,17 @@
from __future__ import print_function
+#
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101258974
--- Diff:
examples/src/main/python/mllib/logistic_regression_with_lbfgs_example.py ---
@@ -22,9 +22,11 @@
from pyspark import SparkContext
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101258832
--- Diff:
examples/src/main/python/mllib/power_iteration_clustering_example.py ---
@@ -19,7 +19,9 @@
from pyspark import SparkContext
#
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101258524
--- Diff:
examples/src/main/python/mllib/streaming_linear_regression_example.py ---
@@ -25,13 +25,14 @@
# $example off$
from pyspark
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14830#discussion_r101245188
--- Diff: examples/src/main/python/ml/cross_validator.py ---
@@ -42,20 +42,22 @@
# $example on$
# Prepare training documents,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16750
**[Test build #72930 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72930/testReport)**
for PR 16750 at commit
Github user zhaiyuyong commented on the issue:
https://github.com/apache/spark/pull/11045
how do this in spark with version 2.1.0ã
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16936
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72928/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16936
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16936
**[Test build #72928 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72928/testReport)**
for PR 16936 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16739
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72929/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16739
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16739
**[Test build #72929 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72929/testReport)**
for PR 16739 at commit
Github user agsachin commented on the issue:
https://github.com/apache/spark/pull/14601
@lresendecan we go ahead with key.startsWith("fs."). so that we don't need
to check so many conditions.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user agsachin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14601#discussion_r101252433
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
---
@@ -102,11 +102,20 @@ class SparkHadoopUtil extends Logging {
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/13072
@devaraj-kavali Which threads/Executor you are referring to in
MesosClusterDispatcher?
Could you provide some pointers?
---
If your project is set up for it, you can reply to this email and
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/16755
Please fix the title for the PR and include the related jira issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72927/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15918
**[Test build #72927 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72927/testReport)**
for PR 15918 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16800
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16800
merged to master. could you open a JIRA on programming guide, example,
vignettes changes please. Thanks
---
If your project is set up for it, you can reply to this email and have your
reply
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16677
ping @cloud-fan Any suggestions on this? Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16933#discussion_r101219684
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseRepartitionSuite.scala
---
@@ -43,15 +55,44 @@ class
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16933#discussion_r101218700
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/dsl/package.scala ---
@@ -374,6 +374,9 @@ package object dsl {
case
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16933#discussion_r101218852
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -563,23 +563,27 @@ object CollapseProject extends
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16933#discussion_r101219386
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/CollapseRepartitionSuite.scala
---
@@ -32,6 +32,18 @@ class
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16898
nit: typo in pr title `advoid`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16931
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user uncleGen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16936#discussion_r101223265
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala
---
@@ -437,6 +438,74 @@ class ReceiverTracker(ssc:
Github user uncleGen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16936#discussion_r101223862
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/config.scala
---
@@ -215,10 +215,6 @@ package object config {
Github user uncleGen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16936#discussion_r101223957
--- Diff:
streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala
---
@@ -938,7 +958,7 @@ object SlowTestReceiver {
/**
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16936
**[Test build #72928 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72928/testReport)**
for PR 16936 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16739
**[Test build #72929 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72929/testReport)**
for PR 16739 at commit
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16739
Jenkins, retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16925
A late LGTM. : )
Normally, we do not encourage users to define hints inside a view. Users
can add a BROADCAST hint when they define a persistent view. That will be
stored in the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15918
**[Test build #72927 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72927/testReport)**
for PR 15918 at commit
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16630#discussion_r101220747
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala
---
@@ -1104,6 +1103,83 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16936
**[Test build #72926 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72926/testReport)**
for PR 16936 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16936
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16936
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72926/
Test FAILed.
---
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16630#discussion_r101220572
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala
---
@@ -915,6 +917,22 @@ class
Github user windpiger commented on the issue:
https://github.com/apache/spark/pull/15918
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16909
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16715
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72922/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16715
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72923/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16739
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72925/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16909
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72920/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16739
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72924/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15918
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16656
@zsxwing Could you please take a review?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16936
**[Test build #72926 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72926/testReport)**
for PR 16936 at commit
GitHub user uncleGen opened a pull request:
https://github.com/apache/spark/pull/16936
[SPARK-19605][DStream] Fail it if existing resource is not enough to run
streaming job
## What changes were proposed in this pull request?
For more detailed discussion, please review:
501 - 587 of 587 matches
Mail list logo
