[GitHub] spark issue #17816: [SPARK-20192][SPARKR] SparkR migration guide to 2.2.0

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76341/ Test PASSed. ---

[GitHub] spark issue #17816: [SPARK-20192][SPARKR] SparkR migration guide to 2.2.0

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17816 **[Test build #76341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76341/testReport)** for PR 17816 at commit

[GitHub] spark issue #17816: [SPARK-20192][SPARKR] SparkR migration guide to 2.2.0

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17816 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17816: [SPARK-20192][SPARKR] SparkR migration guide to 2.2.0

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17816 **[Test build #76341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76341/testReport)** for PR 17816 at commit

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17807 let's just say, happy to discuss :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17815: [SPARK-20541][SPARKR][SS] support awaitTerminatio...

2017-04-30 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17815#discussion_r114100263 --- Diff: R/pkg/inst/tests/testthat/test_streaming.R --- @@ -61,6 +61,7 @@ test_that("read.stream, write.stream, awaitTermination, stopQuery", {

[GitHub] spark pull request #17816: [SPARK-20192][SPARKR] SparkR migration guide to 2...

2017-04-30 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/17816 [SPARK-20192][SPARKR] SparkR migration guide to 2.2.0 ## What changes were proposed in this pull request? Updating R Programming Guide ## How was this patch tested?

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114100085 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -24,13 +24,13 @@ import

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17807 **[Test build #76340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76340/testReport)** for PR 17807 at commit

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17783 Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17814: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Struc...

2017-04-30 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17814 cc @tdas @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17815 LGTM. Minor comment --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17815: [SPARK-20541][SPARKR][SS] support awaitTerminatio...

2017-04-30 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/17815#discussion_r114099455 --- Diff: R/pkg/inst/tests/testthat/test_streaming.R --- @@ -61,6 +61,7 @@ test_that("read.stream, write.stream, awaitTermination, stopQuery", {

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17807 Don't take away my hope :) i think that `grouping_bit`is OK. It is descriptive, doesn't introduce generic `_col` and we can avoid masking. I'll resolve the conflicts and update PR in a

[GitHub] spark pull request #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSa...

2017-04-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17783 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17807 I'm not sure there is one rule for this - we would need to look at it on a case-by-case basis. Generally we should try to avoid conflict, because it is inconvenient and breaks any existing code

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76339/ Test PASSed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76339 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76339/testReport)** for PR 17605 at commit

[GitHub] spark issue #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type for re...

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17688 merged to master/2.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17688: [MINOR][DOCS][PYTHON] Adding missing boolean type...

2017-04-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76339/testReport)** for PR 17605 at commit

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76338 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76338/testReport)** for PR 17605 at commit

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76338/ Test FAILed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76338/testReport)** for PR 17605 at commit

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17605 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76337/ Test FAILed. ---

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76337 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76337/testReport)** for PR 17605 at commit

[GitHub] spark issue #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wrapper fo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17605 **[Test build #76337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76337/testReport)** for PR 17605 at commit

[GitHub] spark issue #17698: [SPARK-20403][SQL][Documentation]Modify the instructions...

2017-04-30 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/17698 @srowen, can you review it again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wra...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17605#discussion_r114096515 --- Diff: python/pyspark/sql/column.py --- @@ -171,6 +171,58 @@ def __init__(self, jc): __ge__ = _bin_op("geq") __gt__ = _bin_op("gt")

[GitHub] spark pull request #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wra...

2017-04-30 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17605#discussion_r114096454 --- Diff: python/pyspark/sql/column.py --- @@ -171,6 +171,58 @@ def __init__(self, jc): __ge__ = _bin_op("geq") __gt__ = _bin_op("gt")

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12646 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76334/ Test PASSed. ---

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12646 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12646 **[Test build #76334 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76334/testReport)** for PR 12646 at commit

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17807 What I like about masking is that is relatively explicit: > library(SparkR) Attaching package: ‘SparkR’ The following objects are masked from

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17807 > strange error with AppVeyor.. Indeed strange. `tempfile` conflict is not likely, is it? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17815 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17815 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76336/ Test PASSed. ---

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17815 **[Test build #76336 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76336/testReport)** for PR 17815 at commit

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-04-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17770 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17813: [SPARK-20540][CORE] Fix unstable executor requests.

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17813 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76332/ Test PASSed. ---

[GitHub] spark issue #17813: [SPARK-20540][CORE] Fix unstable executor requests.

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17813 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17813: [SPARK-20540][CORE] Fix unstable executor requests.

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17813 **[Test build #76332 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76332/testReport)** for PR 17813 at commit

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17815 **[Test build #76336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76336/testReport)** for PR 17815 at commit

[GitHub] spark pull request #17714: [SPARK-20428][Core]REST interface about 'v1/submi...

2017-04-30 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/17714#discussion_r114089418 --- Diff: core/src/main/scala/org/apache/spark/deploy/rest/RestSubmissionServer.scala --- @@ -214,15 +214,15 @@ private[rest] abstract class

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17815 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76335/ Test FAILed. ---

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17815 **[Test build #76335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76335/testReport)** for PR 17815 at commit

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17815 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17807 strange error with AppVeyor.. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17807 yea, I agree it's not ideal and I'm not in favor of dispatch hacking either. I think the latest you have is reasonable... but as you say, perhaps this isn't worthwhile to iterate that

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114089154 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +461,267 @@ case class

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114089104 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +461,267 @@ case class

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114089091 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +461,267 @@ case class

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114088961 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -24,13 +24,13 @@ import

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114088733 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1086,10 +1106,22 @@ class AstBuilder extends

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r114088698 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1086,10 +1106,22 @@ class AstBuilder extends

[GitHub] spark issue #17815: [SPARK-20541][SPARKR][SS] support awaitTermination witho...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17815 **[Test build #76335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76335/testReport)** for PR 17815 at commit

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/12646 I guess you can directly ask the jenkins to retest like above too, @kevinyu98. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17815: [SPARK-20541][SPARKR][SS] support awaitTerminatio...

2017-04-30 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/17815 [SPARK-20541][SPARKR][SS] support awaitTermination without timeout ## What changes were proposed in this pull request? Add without param for timeout - will need this to submit a job

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17540 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76331/ Test PASSed. ---

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #76331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76331/testReport)** for PR 17540 at commit

[GitHub] spark pull request #17605: [SPARK-20290][MINOR][PYTHON][SQL] Add PySpark wra...

2017-04-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17605#discussion_r114088222 --- Diff: python/pyspark/sql/column.py --- @@ -171,6 +171,58 @@ def __init__(self, jc): __ge__ = _bin_op("geq") __gt__ = _bin_op("gt")

[GitHub] spark issue #17814: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Struc...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17814 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17814: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Struc...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17814 **[Test build #76333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76333/testReport)** for PR 17814 at commit

[GitHub] spark issue #17814: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Struc...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17814 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76333/ Test PASSed. ---

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12646 **[Test build #76334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76334/testReport)** for PR 12646 at commit

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/12646 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17814: [SPARK-20015][SPARKR][SS][DOC][EXAMPLE] Document R Struc...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17814 **[Test build #76333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76333/testReport)** for PR 17814 at commit

[GitHub] spark pull request #17814: [SPARK-20015][SPARKR][DOC][EXAMPLE] Document R St...

2017-04-30 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/17814 [SPARK-20015][SPARKR][DOC][EXAMPLE] Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide, R example ## What changes were proposed in this pull request?

[GitHub] spark issue #17813: [SPARK-20540][CORE] Fix unstable executor requests.

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17813 **[Test build #76332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76332/testReport)** for PR 17813 at commit

[GitHub] spark issue #17813: [SPARK-20540][CORE] Fix unstable executor requests.

2017-04-30 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17813 @vanzin, can you take a look at this? It is a dynamic allocation bug. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #17813: [SPARK-20540][CORE] Fix unstable executor request...

2017-04-30 Thread rdblue
GitHub user rdblue opened a pull request: https://github.com/apache/spark/pull/17813 [SPARK-20540][CORE] Fix unstable executor requests. There are two problems fixed in this commit. First, the ExecutorAllocationManager sets a timeout to avoid requesting executors too often.

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17807 To keep this option open https://github.com/zero323/spark/commit/a67c77e7bdf40ea40807e9d984975c04738d327d --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #76331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76331/testReport)** for PR 17540 at commit

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-30 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17540 @cloud-fan, I've removed the metrics work-around so this is ready to go. I'm all for getting this in and fixing the broken query plans. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76330/ Test PASSed. ---

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17807 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17807 **[Test build #76330 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76330/testReport)** for PR 17807 at commit

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-30 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/17723 @vanzin Since hadoop 1 is no longer maintained, I was referring to hadoop security as yarn security - you are right, they are not the same : though in what I described, replacing one with another,

[GitHub] spark pull request #17812: [WIP][SPARK-][SS] Batch queries with 'Dataset/Dat...

2017-04-30 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/17812 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17807 **[Test build #76330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76330/testReport)** for PR 17807 at commit

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17783 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76329/ Test PASSed. ---

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17783 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17783 **[Test build #76329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76329/testReport)** for PR 17783 at commit

[GitHub] spark issue #17783: [SPARK-20490][SPARKR] Add R wrappers for eqNullSafe and ...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17783 **[Test build #76329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76329/testReport)** for PR 17783 at commit

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread kevinyu98
Github user kevinyu98 commented on the issue: https://github.com/apache/spark/pull/12646 The failing test case is : build/sbt "test-only org.apache.spark.deploy.master", I can run successful locally. build/sbt "test-only org.apache.spark.deploy.master" Total time: 16 s,

[GitHub] spark issue #17809: [SPARK-20535][SPARKR] R wrappers for explode_outer and p...

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17809 Thanks @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17807 I thought about it before, but there are two or three problems: - `base::grouping` has `...` signature so it is not possible without changing behavior or adding nullary variant. - It

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12646 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12646 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76328/ Test FAILed. ---

[GitHub] spark issue #12646: [SPARK-14878][SQL] Trim characters string function suppo...

2017-04-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12646 **[Test build #76328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76328/testReport)** for PR 12646 at commit

[GitHub] spark pull request #17809: [SPARK-20535][SPARKR] R wrappers for explode_oute...

2017-04-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17809 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17809: [SPARK-20535][SPARKR] R wrappers for explode_outer and p...

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17809 merged to master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17723: [SPARK-20434][YARN][CORE] Move kerberos delegation token...

2017-04-30 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17723 No YARN API is being exposed in core. There are hadoop security APIs being exposed in the current patch (`Credentials`). It's different. Michael's patch is not exposing YARN's way of using

[GitHub] spark issue #17807: [SPARK-20532][SPARKR] Implement grouping and grouping_id

2017-04-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17807 I understanding what you are saying and for frequent R users this might not really be a big issue, so far we are taking the view of avoiding masking any inconvenience, if we if at all could.

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-04-30 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/17087 ping @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

  1   2   >