[GitHub] spark issue #15027: [SPARK-17475] [STREAMING] Delete CRC files if the filesy...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15027 **[Test build #67931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67931/consoleFull)** for PR 15027 at commit [`9ff89c0`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15027: [SPARK-17475] [STREAMING] Delete CRC files if the filesy...

2016-11-01 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15027 It turns out there is a bug in Hadoop's FileContext that doesn't rename the checksum file. LGTM pending tests. --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark issue #15722: [SPARK-18208] [Shuffle] Executor OOM due to a memory lea...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15722 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67921/ Test PASSed. ---

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15704 **[Test build #67921 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67921/consoleFull)** for PR 15704 at commit [`72084a0`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15722: [SPARK-18208] [Shuffle] Executor OOM due to a mem...

2016-11-01 Thread jiexiong
GitHub user jiexiong opened a pull request: https://github.com/apache/spark/pull/15722 [SPARK-18208] [Shuffle] Executor OOM due to a memory leak in BytesToBytesMap ## What changes were proposed in this pull request? Fixed the OOM problem in BytesToBytesMap. ## How w

[GitHub] spark issue #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedImperativ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15703 **[Test build #67930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67930/consoleFull)** for PR 15703 at commit [`6f28688`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15718: [SPARK-16839][SQL] Simplify Struct creation code path

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15718 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15718: [SPARK-16839][SQL] Simplify Struct creation code path

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15718 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67918/ Test PASSed. ---

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13617 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67929/ Test FAILed. ---

[GitHub] spark issue #13617: [SPARK-10409] [ML] Add Multilayer Perceptron Regression ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13617 **[Test build #67929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67929/consoleFull)** for PR 13617 at commit [`a5d9972`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15718: [SPARK-16839][SQL] Simplify Struct creation code path

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15718 **[Test build #67918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67918/consoleFull)** for PR 15718 at commit [`29ccf4e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67919/ Test PASSed. ---

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15704 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15704 **[Test build #67919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67919/consoleFull)** for PR 15704 at commit [`05c83fa`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15697 Ah, yes actually that's a problem now unfortunately. It seems even comitters can't retrigger. Actually, that's why I ran this via another account and left the comment above. I am trying to find

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15697 No, I just launched Jenkins test. I don't know how to manually trigger the AppVeyor test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-11-01 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15673 @ericl I can do that, yes. I'm current tied down. I will push a new commit later today or tonight. --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark issue #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedImperativ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15703 **[Test build #67927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67927/consoleFull)** for PR 15703 at commit [`3af4f21`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15618: [WIP][SPARK-14914][CORE] Fix Resource not closed after u...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15618 **[Test build #67928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67928/consoleFull)** for PR 15618 at commit [`1521572`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15618 Oh wait, it seems the failed test is related. Will take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #15703: [SPARK-18186] Migrate HiveUDAFFunction to TypedImperativ...

2016-11-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15703 It turned out that I didn't initialize Hive UDAF evaluators properly. Quoted from commit message of my previous commit: > Hive UDAFs are sensitive to aggregation mode, and must be

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon closed the pull request at: https://github.com/apache/spark/pull/15618 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-11-01 Thread HyukjinKwon
GitHub user HyukjinKwon reopened a pull request: https://github.com/apache/spark/pull/15618 [SPARK-14914][CORE] Fix Resource not closed after using, mostly for unit tests ## What changes were proposed in this pull request? Close `FileStreams`, `ZipFiles` etc to release the

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15618 Ll --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15618 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15697 Oh, AppVeyor test is not triggered again with the Jebkins one. Or, do you mean you launched another build via another account and manually tested it? --- If your project is set up for it, y

[GitHub] spark issue #15553: [SPARK-18008] [build] Add support for -Dmaven.test.skip=...

2016-11-01 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15553 Closing PR given pushback to commit'ing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15553: [SPARK-18008] [build] Add support for -Dmaven.tes...

2016-11-01 Thread mridulm
Github user mridulm closed the pull request at: https://github.com/apache/spark/pull/15553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #15698: [SPARK-18182] Expose ReplayListenerBus.read() overload w...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15698 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67917/ Test PASSed. ---

[GitHub] spark issue #15698: [SPARK-18182] Expose ReplayListenerBus.read() overload w...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15698 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-01 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 I think we should try and get so that it can be a part of the 2.1 release so we can have publishing to PyPI added in 2.1.1 or 2.2. We've been looking at making PySpark installable with pip since Apr

[GitHub] spark issue #15354: [SPARK-17764][SQL] Add `to_json` supporting to convert n...

2016-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15354 Thank you for merging this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #67926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67926/consoleFull)** for PR 15659 at commit [`1cdcf61`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67923/ Test PASSed. ---

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67923/consoleFull)** for PR 15647 at commit [`7d3c74c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15718: [SPARK-16839][SQL] Simplify Struct creation code path

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15718 **[Test build #67925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67925/consoleFull)** for PR 15718 at commit [`c0263d7`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15721 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67922/ Test PASSed. ---

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15721 **[Test build #67922 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67922/consoleFull)** for PR 15721 at commit [`e10be45`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15719: [SPARK-18114][HOTFIX] Fix line-too-long style error from...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15719 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67914/ Test PASSed. ---

[GitHub] spark issue #15719: [SPARK-18114][HOTFIX] Fix line-too-long style error from...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15719 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15719: [SPARK-18114][HOTFIX] Fix line-too-long style error from...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15719 **[Test build #67914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67914/consoleFull)** for PR 15719 at commit [`c56011e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14435: [SPARK-16756][SQL][WIP] Add `sql` function to LogicalPla...

2016-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14435 I close this PR since the issue is closed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request #14435: [SPARK-16756][SQL][WIP] Add `sql` function to Log...

2016-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/14435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15637: [SPARK-18000] [SQL] Aggregation function for computing e...

2016-11-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15637 BTW, please follow the PR https://github.com/apache/spark/issues/15677 to rewrite your function description. Add an example for the new function if possible. --- If your project is set up for

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-11-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r86031611 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,332 @@ +/* + * Licens

[GitHub] spark pull request #15675: [SPARK-18144][SQL] logging StreamingQueryListener...

2016-11-01 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15675#discussion_r86030559 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -290,7 +290,10 @@ class StreamingQuerySuite extends Stream

[GitHub] spark pull request #15675: [SPARK-18144][SQL] logging StreamingQueryListener...

2016-11-01 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15675#discussion_r86030545 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -50,7 +52,14 @@ class StreamingQueryListen

[GitHub] spark issue #15671: [SPARK-14567][ML]Add instrumentation logs to ML training...

2016-11-01 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15671 So, if we consistently use `instr.logParams(params: _*)` (even in cases where it's acceptable) then we run the risk of adding some param in the future that could "overload" the logs (like initialMode

[GitHub] spark pull request #15637: [SPARK-18000] [SQL] Aggregation function for comp...

2016-11-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15637#discussion_r86030388 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/MapAggregate.scala --- @@ -0,0 +1,332 @@ +/* + * Licens

[GitHub] spark issue #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos client mo...

2016-11-01 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/15700 @srowen LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #13880: SPARK-16178: Remove unnecessary Hive partition ch...

2016-11-01 Thread rdblue
Github user rdblue closed the pull request at: https://github.com/apache/spark/pull/13880 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14906: [SPARK-17350][SQL] Disable default use of KryoSerializer...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14906 **[Test build #3390 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3390/consoleFull)** for PR 14906 at commit [`aa18bb6`](https://github.com/apache/spark/commit

[GitHub] spark issue #15088: SPARK-17532: Add lock debugging info to thread dumps.

2016-11-01 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/15088 @srowen, if you have a chance, could you look at this again? I think it will be helpful for tracking down live-lock issues. Thanks! --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos client mo...

2016-11-01 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/15700 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark pull request #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos cl...

2016-11-01 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/15700#discussion_r86029381 --- Diff: core/src/main/scala/org/apache/spark/api/r/RUtils.scala --- @@ -84,7 +84,7 @@ private[spark] object RUtils { } } else {

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-11-01 Thread vlad17
Github user vlad17 commented on the issue: https://github.com/apache/spark/pull/14547 @jkbradley There seems to be more issues with deprecating impurity: [error] [warn] /home/jenkins/workspace/SparkPullRequestBuilder/mllib/src/main/scala/org/apache/spark/ml/classification/

[GitHub] spark issue #15720: [SPARK-18167] Disable flaky SQLQuerySuite test

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15720 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15720: [SPARK-18167] Disable flaky SQLQuerySuite test

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15720 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67916/ Test PASSed. ---

[GitHub] spark issue #15720: [SPARK-18167] Disable flaky SQLQuerySuite test

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15720 **[Test build #67916 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67916/consoleFull)** for PR 15720 at commit [`c1469b9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15697 @HyukjinKwon It seems that windows test still fails with the same error --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15541 **[Test build #67924 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67924/consoleFull)** for PR 15541 at commit [`b06de5e`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15710 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67912/ Test PASSed. ---

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67912/consoleFull)** for PR 15710 at commit [`0742318`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15710: [SPARK-18025] Use commit protocol API in structured stre...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15710 **[Test build #67913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67913/consoleFull)** for PR 15710 at commit [`a2ea180`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15673: [SPARK-17992][SQL] Return all partitions from HiveShim w...

2016-11-01 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15673 @mallman shall we go ahead and revert that in this PR? It didn't help with debugging the flaky test much. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67923 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67923/consoleFull)** for PR 15647 at commit [`7d3c74c`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15546 Ah, I see. It's feature freeze. Thank you for informing me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15546 Not rc, but the branch cut. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15567 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67907/ Test FAILed. ---

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15697 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15697 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67920/ Test PASSed. ---

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15647 Any more comments, or shall I merge this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-11-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15647 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #15697: [SparkR][Test]:remove unnecessary suppressWarnings

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15697 **[Test build #67920 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67920/consoleFull)** for PR 15697 at commit [`a292ae8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15567: [SPARK-14393][SQL] values generated by non-deterministic...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15567 **[Test build #67907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67907/consoleFull)** for PR 15567 at commit [`9dcb249`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15705: [SPARK-18183] [SPARK-18184] Fix INSERT [INTO|OVERWRITE] ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15705 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67911/ Test PASSed. ---

[GitHub] spark issue #15705: [SPARK-18183] [SPARK-18184] Fix INSERT [INTO|OVERWRITE] ...

2016-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15705 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15705: [SPARK-18183] [SPARK-18184] Fix INSERT [INTO|OVERWRITE] ...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15705 **[Test build #67911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67911/consoleFull)** for PR 15705 at commit [`ca31f35`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15546 Oh, 2.1-rc1 today? I see. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15688 Could we add all the positive and negative cases in `ExternalCatalogSuite`, like the other APIs. Then, we can easily know whether the behaviors of `InMemoryCatalog` and `HiveExternalCatalog` are

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15546 @dongjoon-hyun we are going to cut the release branch today (or tomorrow) so it would be good to get this in asap. --- If your project is set up for it, you can reply to this email and have your repl

[GitHub] spark pull request #15688: [SPARK-18173][SQL] data source tables should supp...

2016-11-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15688#discussion_r86023753 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala --- @@ -471,11 +471,30 @@ class InMemoryCatalog(

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-11-01 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15721 This issue also brings up a more general point of how sample weights should be tested. It seems there are some common rules that all algorithms that incorporate sample weights are thought to follow (

[GitHub] spark issue #15721: [SPARK-17772][ML][TEST] Add test functions for ML sample...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15721 **[Test build #67922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67922/consoleFull)** for PR 15721 at commit [`e10be45`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15546 Sorry for delay, @rxin . I'm still working on, and will update in a few days. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request #15721: [SPARK-17772][ML][TEST] Add test functions for ML...

2016-11-01 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/15721 [SPARK-17772][ML][TEST] Add test functions for ML sample weights ## What changes were proposed in this pull request? More and more ML algos are accepting sample weights, and they have been

[GitHub] spark issue #14906: [SPARK-17350][SQL] Disable default use of KryoSerializer...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14906 **[Test build #3390 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3390/consoleFull)** for PR 14906 at commit [`aa18bb6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14906: [SPARK-17350][SQL] Disable default use of KryoSerializer...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14906 LGTM if tests pass again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15546: [SPARK-17982][SQL][WIP] SQLBuilder should wrap the gener...

2016-11-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15546 @dongjoon-hyun any update on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #15567: [SPARK-14393][SQL] values generated by non-determ...

2016-11-01 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/15567#discussion_r86019635 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -264,23 +264,43 @@ trait NonSQLExpression extends Exp

[GitHub] spark pull request #15567: [SPARK-14393][SQL] values generated by non-determ...

2016-11-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15567#discussion_r86018687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -264,23 +264,43 @@ trait NonSQLExpression extends Expre

[GitHub] spark issue #15704: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION should sup...

2016-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15704 **[Test build #67921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67921/consoleFull)** for PR 15704 at commit [`72084a0`](https://github.com/apache/spark/commit/7

<    1   2   3   4   5   6   7   8   >