[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63023/ Test PASSed. ---

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #63023 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63023/consoleFull)** for PR 14116 at commit [`0fc02f6`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14398: [SPARK-16774][SQL] Fix use of deprecated timestam...

2016-07-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14398#discussion_r72877149 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -875,11 +877,11 @@ object DateTimeUtils { v

[GitHub] spark pull request #14398: [SPARK-16774][SQL] Fix use of deprecated timestam...

2016-07-29 Thread ckadner
Github user ckadner commented on a diff in the pull request: https://github.com/apache/spark/pull/14398#discussion_r72876907 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala --- @@ -875,11 +877,11 @@ object DateTimeUtils { v

[GitHub] spark issue #14346: [SPARK-16710] [SparkR] [ML] spark.glm should support wei...

2016-07-29 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/14346 cc: @junyangq --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14355 **[Test build #63022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63022/consoleFull)** for PR 14355 at commit [`2b2d59e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14355 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63022/ Test PASSed. ---

[GitHub] spark issue #14415: [SPARK-16810] Refactor registerSinks with multiple const...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14415 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14413: [SPARK-16805][SQL] Log timezone when query result does n...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14413 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14415: [SPARK-16810] Refactor registerSinks with multipl...

2016-07-29 Thread lovexi
GitHub user lovexi opened a pull request: https://github.com/apache/spark/pull/14415 [SPARK-16810] Refactor registerSinks with multiple constructos ## What changes were proposed in this pull request? For some metrics, it may require some **app detailed information** from `S

[GitHub] spark issue #14413: [SPARK-16805][SQL] Log timezone when query result does n...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14413 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63020/ Test PASSed. ---

[GitHub] spark issue #14413: [SPARK-16805][SQL] Log timezone when query result does n...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14413 **[Test build #63020 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63020/consoleFull)** for PR 14413 at commit [`0abbd91`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14414: [SPARK-16809] enable history server links in dispatcher ...

2016-07-29 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/14414 cc @skonto. This somewhat relates to your work on https://issues.apache.org/jira/browse/SPARK-13401, but it seems to be disjoint. --- If your project is set up for it, you can reply to

[GitHub] spark issue #14414: [SPARK-16809] enable history server links in dispatcher ...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14414 **[Test build #63027 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63027/consoleFull)** for PR 14414 at commit [`6e97ec1`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14414: [SPARK-16809] enable history server links in disp...

2016-07-29 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14414 [SPARK-16809] enable history server links in dispatcher UI ## What changes were proposed in this pull request? Links the Spark Mesos Dispatcher UI to the history server UI - adds

[GitHub] spark issue #40: Initialized the regVal for first iteration in SGD optimizer

2016-07-29 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/40 **[Test build #83 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/83/consoleFull)** for PR 40 at commit [`fb4eee1`](https://github.com/apache/spark/commit/fb

[GitHub] spark issue #14332: [SPARK-16694] [CORE] Use for/foreach rather than map for...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14332 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14332: [SPARK-16694] [CORE] Use for/foreach rather than map for...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14332 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63018/ Test PASSed. ---

[GitHub] spark issue #14332: [SPARK-16694] [CORE] Use for/foreach rather than map for...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14332 **[Test build #63018 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63018/consoleFull)** for PR 14332 at commit [`3a5c5a6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14407 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63026/ Test FAILed. ---

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14407 **[Test build #63026 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63026/consoleFull)** for PR 14407 at commit [`4dbd5fa`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14407 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14389: [SPARK-16714][SQL] Refactor type widening for consistenc...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14389 **[Test build #3196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3196/consoleFull)** for PR 14389 at commit [`b9f94fe`](https://github.com/apache/spark/commit

[GitHub] spark issue #14110: [SPARK-16455] Add a new hook in CoarseGrainedSchedulerBa...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14110 **[Test build #3197 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3197/consoleFull)** for PR 14110 at commit [`97b6fcc`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14410 **[Test build #63025 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63025/consoleFull)** for PR 14410 at commit [`f4f383c`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14407 **[Test build #63026 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63026/consoleFull)** for PR 14407 at commit [`4dbd5fa`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14411 It sounds great to me! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #14396: [SPARK-16787] SparkContext.addFile() should not throw if...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14396 **[Test build #63024 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63024/consoleFull)** for PR 14396 at commit [`9aa32b3`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-07-29 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r72871806 --- Diff: mllib/src/main/scala/org/apache/spark/ml/r/IsotonicRegressionWrapper.scala --- @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software F

[GitHub] spark issue #14396: [SPARK-16787] SparkContext.addFile() should not throw if...

2016-07-29 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14396 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #37: [HOTFIX] Patching maven build after #6 (SPARK-1121).

2016-07-29 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/37 **[Test build #82 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/82/consoleFull)** for PR 37 at commit [`da20b37`](https://github.com/apache/spark/commit/da

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14410 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14410 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63019/ Test FAILed. ---

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14410 **[Test build #63019 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63019/consoleFull)** for PR 14410 at commit [`724fcf8`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose pote...

2016-07-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/13571#discussion_r72871316 --- Diff: python/pyspark/sql/functions.py --- @@ -1731,13 +1749,115 @@ def sort_array(col, asc=True): # User Defined F

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14411 Two good cases, which return the same result set, with and without this proposed fix: sql("select c1 from t1 where exists (select 1 from t2 where t1.c1=t2.c2) and exists (select 1 from t2 LIM

[GitHub] spark pull request #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose pote...

2016-07-29 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/13571#discussion_r72870886 --- Diff: python/pyspark/sql/functions.py --- @@ -1731,13 +1749,115 @@ def sort_array(col, asc=True): # User Defined

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14411 @gatorsmile: thanks. I will add them in SubquerySuite. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14411 I think the positive cases can move here. `sql/core/src/test/scala/org/apache/spark/sql/SubquerySuite.scala` --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/14411 I include two examples of "good" case in the JIRA to show that this fix only blocks cases where Spark will produce incorrect results. I need to find a place to host those "good" cases. Don't think Ana

[GitHub] spark issue #14398: [SPARK-16774][SQL] Fix use of deprecated timestamp const...

2016-07-29 Thread ckadner
Github user ckadner commented on the issue: https://github.com/apache/spark/pull/14398 @holdenk @davies I agree that date, time, and timezone handling is best left to the experts and leveraging [JSR-310](http://www.threeten.org/threetenbp/) ([SPARK-16788](https://issues.apache.org

[GitHub] spark pull request #14182: [SPARK-16444][SparkR]: Isotonic Regression wrappe...

2016-07-29 Thread junyangq
Github user junyangq commented on a diff in the pull request: https://github.com/apache/spark/pull/14182#discussion_r72870009 --- Diff: R/pkg/R/mllib.R --- @@ -292,6 +299,77 @@ setMethod("summary", signature(object = "NaiveBayesModel"), return(list(apriori = aprior

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r72869004 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Lo

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r72868911 --- Diff: core/src/test/scala/org/apache/spark/StatusTrackerSuite.scala --- @@ -61,29 +60,29 @@ class StatusTrackerSuite extends SparkFunSuite with Matchers

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r72868695 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/lib/PageRank.scala --- @@ -109,7 +108,7 @@ object PageRank extends Logging { require(resetPro

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r72868538 --- Diff: core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala --- @@ -113,7 +112,7 @@ private object FaultToleranceTest extends App with Log

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14407#discussion_r72868588 --- Diff: core/src/test/scala/org/apache/spark/StatusTrackerSuite.scala --- @@ -61,29 +60,29 @@ class StatusTrackerSuite extends SparkFunSuite with Matchers w

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14355 **[Test build #63022 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63022/consoleFull)** for PR 14355 at commit [`2b2d59e`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #63023 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63023/consoleFull)** for PR 14116 at commit [`0fc02f6`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14407 **[Test build #63021 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63021/consoleFull)** for PR 14407 at commit [`b264f2d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14407 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63021/ Test FAILed. ---

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14407 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve `Union/Intersect/Except` erro...

2016-07-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14355 Rebased. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14407 **[Test build #63021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63021/consoleFull)** for PR 14407 at commit [`b264f2d`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14407 Did a first pass audit, leaving XML parsing alone for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark issue #14413: [SPARK-16805][SQL] Log timezone when query result does n...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14413 **[Test build #63020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63020/consoleFull)** for PR 14413 at commit [`0abbd91`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14413: [SPARK-16805][SQL] Log timezone when query result...

2016-07-29 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/14413 [SPARK-16805][SQL] Log timezone when query result does not match ## What changes were proposed in this pull request? It is useful to log the timezone when query result does not match, especially o

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14411 We also need more test cases to prove it work as expected. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14412: [SPARK-15355] [CORE] [WIP] Proactive block replication

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14412 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14411 @nsyca Could you update the PR description? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] [WIP] Proactive block replic...

2016-07-29 Thread shubhamchopra
GitHub user shubhamchopra opened a pull request: https://github.com/apache/spark/pull/14412 [SPARK-15355] [CORE] [WIP] Proactive block replication ## What changes were proposed in this pull request? We are proposing addition of pro-active block replication in case of execut

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14411 cc @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing LIMI...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14411 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14411: [SPARK-16804][SQL] Correlated subqueries containi...

2016-07-29 Thread nsyca
GitHub user nsyca opened a pull request: https://github.com/apache/spark/pull/14411 [SPARK-16804][SQL] Correlated subqueries containing LIMIT return incorrect results ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix)

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14410 **[Test build #63019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63019/consoleFull)** for PR 14410 at commit [`724fcf8`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14410: [SPARK-16803] [SQL] SaveAsTable does not work when sourc...

2016-07-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14410 cc @yhuai @rxin @liancheng @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14410: [SPARK-16803] [SQL] SaveAsTable does not work whe...

2016-07-29 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/14410 [SPARK-16803] [SQL] SaveAsTable does not work when source DataFrame is built on a Hive Table ### What changes were proposed in this pull request? In Spark 2.0, `SaveAsTable` does not work wh

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14406 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63017/ Test FAILed. ---

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14406 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14406 **[Test build #63017 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63017/consoleFull)** for PR 14406 at commit [`f6771fa`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14408: [SPARK-16772] [Python] [Docs] Restore "datatype s...

2016-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14408 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14389: [SPARK-16714][SQL] Refactor type widening for consistenc...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14389 **[Test build #3196 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3196/consoleFull)** for PR 14389 at commit [`b9f94fe`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14408: [SPARK-16772] [Python] [Docs] Restore "datatype string" ...

2016-07-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14408 Merging in master/2.0. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14406 **[Test build #63017 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63017/consoleFull)** for PR 14406 at commit [`f6771fa`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14332: [SPARK-16694] [CORE] Use for/foreach rather than map for...

2016-07-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14332 **[Test build #63018 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63018/consoleFull)** for PR 14332 at commit [`3a5c5a6`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14402#discussion_r72859935 --- Diff: core/src/main/java/org/apache/spark/api/java/JavaSparkContextVarargsWorkaround.java --- @@ -52,11 +46,16 @@ public JavaDoubleRDD union(JavaDoubleRD

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14406 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14389: [SPARK-16714][SQL] Refactor type widening for consistenc...

2016-07-29 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14389 I ran the Python tests locally and they passed. It looks like the failure was caused by the Jenkins shutdown. --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark issue #14232: [SPARK-16587] [CORE] The annotation for the abstract Cla...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14232 Hm, not sure what to do here. Unless we can get an informed double-check on the correctness of this, I think I'd just not do it. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #14409: [SPARK-16796] [Web UI] Visible passwords on Spark enviro...

2016-07-29 Thread Devian-ua
Github user Devian-ua commented on the issue: https://github.com/apache/spark/pull/14409 @ajbozarth What if some property will be be intoruduced containing "password" in its name, but not having password in its value? @dongjoon-hyun I can change it to Set. --- If your projec

[GitHub] spark issue #14409: [SPARK-16796] [Web UI] Visible passwords on Spark enviro...

2016-07-29 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14409 All in all I think this looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #14373: [SPARK-16740][SQL] Fix Long overflow in LongToUnsafeRowM...

2016-07-29 Thread sylvinus
Github user sylvinus commented on the issue: https://github.com/apache/spark/pull/14373 For reference, I have found another similar issue: https://issues.apache.org/jira/browse/SPARK-16802 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14409: [SPARK-16796] [Web UI] Visible passwords on Spark enviro...

2016-07-29 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14409 I'd say that that a property like that was poorly named, but it is still a valid possibility so leaving it as you have it is probably better --- If your project is set up for it, you can reply to

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14407 I'm totally down with removing the others - I'll go through and remove the whitelisting in the places where it doesn't add much. --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request #14308: [SPARK-16421][EXAMPLES][ML] Improve ML Example Ou...

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14308#discussion_r72857036 --- Diff: examples/src/main/java/org/apache/spark/examples/ml/JavaWord2VecExample.java --- @@ -55,10 +56,14 @@ public static void main(String[] args) {

[GitHub] spark pull request #14409: [SPARK-16796] [Web UI] Visible passwords on Spark...

2016-07-29 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/14409#discussion_r72856642 --- Diff: core/src/main/scala/org/apache/spark/ui/env/EnvironmentPage.scala --- @@ -25,12 +25,20 @@ import org.apache.spark.ui.{UIUtils, WebUIPage}

[GitHub] spark issue #14405: [SPARK-16800][EXAMPLES][ML] Fix Java examples that fail ...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14405 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14407 Oh, I thought the idea here was to un-whitelist most or all other occurrences. They're "whitelisted" just because they existed and were causing warnings, but most are probably not really good usages

[GitHub] spark pull request #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warni...

2016-07-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14406#discussion_r72855603 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -28,7 +28,7 @@ class SQLConfSuite extends QueryTest with SharedSQLC

[GitHub] spark pull request #14409: [SPARK-16796] [Web UI] Visible passwords on Spark...

2016-07-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14409#discussion_r72855418 --- Diff: core/src/main/scala/org/apache/spark/ui/env/EnvironmentPage.scala --- @@ -25,12 +25,20 @@ import org.apache.spark.ui.{UIUtils, WebUIPage}

[GitHub] spark issue #14404: [SPARK-16664][SQL] Fix persist call on Data frames with ...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14404 You can close this PR now; we can't auto-close it and neither can the bot in this situation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14404: [SPARK-16664][SQL] Fix persist call on Data frames with ...

2016-07-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14404 Great, thank you @breakdawn . It looks good as a re-submit of the original PR, and passes, so I'm merging. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark issue #14409: [SPARK-16796] [Web UI] Visible passwords on Spark enviro...

2016-07-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14409 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14396: [SPARK-16787] SparkContext.addFile() should not t...

2016-07-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14396#discussion_r72854729 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1430,14 +1430,10 @@ class SparkContext(config: SparkConf) extends Logging with Ex

[GitHub] spark pull request #14409: [SPARK-16796] [Web UI] Visible passwords on Spark...

2016-07-29 Thread Devian-ua
GitHub user Devian-ua opened a pull request: https://github.com/apache/spark/pull/14409 [SPARK-16796] [Web UI] Visible passwords on Spark environment page ## What changes were proposed in this pull request? Mask spark.ssl.keyPassword, spark.ssl.keyStorePassword, spark.ssl.t

[GitHub] spark issue #14408: [SPARK-16772] Restore "datatype string" to Python API do...

2016-07-29 Thread nchammas
Github user nchammas commented on the issue: https://github.com/apache/spark/pull/14408 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14393: [SPARK-16772] Correct API doc references to PySpa...

2016-07-29 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/14393#discussion_r72853914 --- Diff: python/pyspark/sql/context.py --- @@ -226,28 +226,34 @@ def createDataFrame(self, data, schema=None, samplingRatio=None): from ``data

[GitHub] spark pull request #14408: [SPARK-16772] Restore "datatype string" to Python...

2016-07-29 Thread nchammas
GitHub user nchammas opened a pull request: https://github.com/apache/spark/pull/14408 [SPARK-16772] Restore "datatype string" to Python API docstrings ## What changes were proposed in this pull request? This PR corrects [an error made in an earlier PR](https://github.com/a

[GitHub] spark pull request #14407: [SPARK-16779][TRIVIAL][WIP] Avoid using postfix o...

2016-07-29 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/14407 [SPARK-16779][TRIVIAL][WIP] Avoid using postfix operator for command execution in SQLQuerySuite ## What changes were proposed in this pull request? Avoid using postfix operation for comman

<    1   2   3   4   >