Github user NarineK commented on a diff in the pull request:
https://github.com/apache/spark/pull/14431#discussion_r72916310
--- Diff: docs/sparkr.md ---
@@ -398,23 +398,25 @@ and Spark.
{% highlight r %}
# Determine six waiting times with the largest eruption time i
Github user NarineK commented on a diff in the pull request:
https://github.com/apache/spark/pull/14431#discussion_r72916339
--- Diff: docs/sparkr.md ---
@@ -429,19 +431,19 @@ result <- gapplyCollect(
df,
"waiting",
function(key, x) {
-y <- dat
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63061 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63061/consoleFull)**
for PR 14431 at commit
[`8db1d08`](https://github.com/apache/spark/commit/8
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/11105
Kafka failure seems unlikely to be related, jenkins retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14419
**[Test build #63062 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63062/consoleFull)**
for PR 14419 at commit
[`2067b63`](https://github.com/apache/spark/commit/2
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11105
**[Test build #63063 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63063/consoleFull)**
for PR 11105 at commit
[`76d2468`](https://github.com/apache/spark/commit/7
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/12896#discussion_r72916851
--- Diff: python/pyspark/ml/recommendation.py ---
@@ -332,6 +338,20 @@ def getFinalStorageLevel(self):
"""
return self.getOrDefault(
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/12896
This looks good to me pending since annotation bump in Python. Personally I
think a docs update could be a good follow up - but since were tagging it as an
expert param for now I think this makes se
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63064 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63064/consoleFull)**
for PR 14431 at commit
[`f235227`](https://github.com/apache/spark/commit/f
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63065 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63065/consoleFull)**
for PR 14431 at commit
[`44ee864`](https://github.com/apache/spark/commit/4
Github user zzcclp commented on the issue:
https://github.com/apache/spark/pull/14420
@srowen will this pr be meged into branch-2.0?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this featu
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14397
Thank you for review, @hvanhovell .
For the recursive CTE queries, traditional DBMS supports optional
`RECURSIVE` keyword which computing **closures**, i.e., it iterates the
subquery
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14355#discussion_r72917596
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -280,6 +267,32 @@ trait CheckAnalysis extends
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14363
> Do we know which hive type strings cannot be parsed by spark?
`varchar(length)` and `char(length)`. see
https://github.com/apache/spark/pull/14363#discussion_r72735867 for what we
break
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14355
**[Test build #63066 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63066/consoleFull)**
for PR 14355 at commit
[`6b20ffb`](https://github.com/apache/spark/commit/6
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/11209#discussion_r72918850
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/HashBenchmark.scala ---
@@ -119,11 +146,12 @@ object HashBenchmark {
.add("map", mapO
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63059 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63059/consoleFull)**
for PR 14431 at commit
[`575fcf8`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63059/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11105
**[Test build #63060 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63060/consoleFull)**
for PR 11105 at commit
[`76d2468`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11105
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11105
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63060/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14430
**[Test build #63067 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63067/consoleFull)**
for PR 14430 at commit
[`7b64edc`](https://github.com/apache/spark/commit/7
Github user yhuai commented on the issue:
https://github.com/apache/spark/pull/14363
Thanks. But, what are specific cases are not supported? If there is any
case, we should make change to support that, right?
---
If your project is set up for it, you can reply to this email and have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14065
**[Test build #63068 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63068/consoleFull)**
for PR 14065 at commit
[`ac0062c`](https://github.com/apache/spark/commit/a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14419
**[Test build #63062 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63062/consoleFull)**
for PR 14419 at commit
[`2067b63`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14419
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14419
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63062/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63064 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63064/consoleFull)**
for PR 14431 at commit
[`f235227`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63064/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11105
**[Test build #63063 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63063/consoleFull)**
for PR 11105 at commit
[`76d2468`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63065 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63065/consoleFull)**
for PR 14431 at commit
[`44ee864`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11105
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11105
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63063/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63065/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14431
**[Test build #63061 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63061/consoleFull)**
for PR 14431 at commit
[`8db1d08`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14431
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63061/
Test PASSed.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14363
for a hive table(created by hive) with `varchar(length)` column, we can
describe it but can't read data from it before this PR. Now we can't describe
it. Do you think we should fix it? BTW there i
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14355
**[Test build #63066 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63066/consoleFull)**
for PR 14355 at commit
[`6b20ffb`](https://github.com/apache/spark/commit/
Github user yhuai commented on the issue:
https://github.com/apache/spark/pull/14368
@liancheng after second thought, I think it makes sense to also merge it to
branch 2.0 to avoid potential conflicts on doc fixes.
---
If your project is set up for it, you can reply to this email an
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14355
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14355
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63066/
Test PASSed.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14368#discussion_r72923711
--- Diff: examples/src/main/r/RSparkSQLExample.R ---
@@ -18,31 +18,43 @@
library(SparkR)
# $example on:init_session$
-sparkR.session(app
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14430
**[Test build #63067 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63067/consoleFull)**
for PR 14430 at commit
[`7b64edc`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14430
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63067/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14430
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14363
```SCALA
TestHive.sessionState.metadataHive.runSqlHive("CREATE TABLE test (id
varchar(50))")
TestHive.sessionState.metadataHive.runSqlHive("INSERT INTO TABLE test
VALUES ('4')")
spark
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14363
Oh sorry I misread our parser rules. `varchar(length)` is supported but the
`length` is ignored. I checked with hive again, looks like the only unsupported
data type is `UNIONTYPE`
---
If your p
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14065
**[Test build #63068 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63068/consoleFull)**
for PR 14065 at commit
[`ac0062c`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14065
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14065
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63068/
Test PASSed.
---
GitHub user manishatGit opened a pull request:
https://github.com/apache/spark/pull/14432
[SPARK-16765] [Example] Added example for k-means to predict with
categorical features
## What changes were proposed in this pull request?
Added example for K-Means as Pipeline API
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14432
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user cloud-fan closed the pull request at:
https://github.com/apache/spark/pull/11673
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user cloud-fan reopened a pull request:
https://github.com/apache/spark/pull/11673
[SPARK-13853][SQL] QueryPlan sub-classes should override producedAttributes
to fix missingInput
## What changes were proposed in this pull request?
Some operators will produce new attr
GitHub user wangmiao1981 opened a pull request:
https://github.com/apache/spark/pull/14433
[SPARK-16829][SparkR]:sparkR sc.setLogLevel doesn't work
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
./bin/sparkR
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14433
**[Test build #63069 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63069/consoleFull)**
for PR 14433 at commit
[`9d3d8e5`](https://github.com/apache/spark/commit/9
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11673
**[Test build #63070 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63070/consoleFull)**
for PR 11673 at commit
[`ce0b9fe`](https://github.com/apache/spark/commit/c
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11673
**[Test build #63071 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63071/consoleFull)**
for PR 11673 at commit
[`af6a0bf`](https://github.com/apache/spark/commit/a
GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/14434
[SPARK-16828][SQL] remove MaxOf and MinOf
## What changes were proposed in this pull request?
These 2 expressions are not needed anymore after we have `Greatest` and
`Least`. This PR rem
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14434
cc @yhuai @liancheng
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes s
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11673
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63071/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11673
Build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11673
**[Test build #63071 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63071/consoleFull)**
for PR 11673 at commit
[`af6a0bf`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14434
**[Test build #63072 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63072/consoleFull)**
for PR 14434 at commit
[`ce0b9fe`](https://github.com/apache/spark/commit/c
Github user wangmiao1981 commented on the issue:
https://github.com/apache/spark/pull/14182
@junyangq Yanbo has pointed me an example of adding weightcol. I will
update this PR tomorrow.
Thanks!
---
If your project is set up for it, you can reply to this email and have your
Github user sethah commented on the issue:
https://github.com/apache/spark/pull/12896
LGTM pending since tags. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14433
**[Test build #63069 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63069/consoleFull)**
for PR 14433 at commit
[`9d3d8e5`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14433
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63069/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14433
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/13701
@yhuai As 2.0 is released now, do you have time to check this? Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/14391
ping @cloud-fan Please take a look this. Thank you.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r72930383
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
---
@@ -359,40 +357,6 @@ class DDLSuite extends QueryTest with Sha
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14155
**[Test build #63073 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63073/consoleFull)**
for PR 14155 at commit
[`9ae7a71`](https://github.com/apache/spark/commit/9
101 - 177 of 177 matches
Mail list logo
