[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15618 I don't mean putting the finally here on this line since we do use it in the success case. But try {} catch e { handleStuff(); throw e; } is just try {} finally {}. I think there are

[GitHub] spark issue #13982: [SPARK-16304] LinkageError should not crash Spark execut...

2016-10-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13982 No objection. On Wednesday, October 26, 2016, Shixiong Zhu wrote: > @rxin any objection to merge this one into 2.0? > I noticed sometimes spark-shell

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #67585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67585/consoleFull)** for PR 13557 at commit [`c11b6a0`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13557 jenkins test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15413 @sethah I did some performance tests actually, and found this change can improve by 1.5x ~ 2x according to different dimensions and number of clusters. I will post the test result soon. Thanks.

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15621 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67582/ Test PASSed. ---

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15621 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15621 **[Test build #67582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67582/consoleFull)** for PR 15621 at commit [`4b76649`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15645 **[Test build #67584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67584/consoleFull)** for PR 15645 at commit [`9f5bb11`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #15645: [DO-NOT-MERGE] complex type creator should always...

2016-10-26 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15645 [DO-NOT-MERGE] complex type creator should always output unsafe format ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How wa

[GitHub] spark issue #10739: Changes to support KMeans with large feature space

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10739 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15319: [SPARK-17733][SQL] InferFiltersFromConstraints ru...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15319 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15597 **[Test build #67583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67583/consoleFull)** for PR 15597 at commit [`3f07493`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15597 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-26 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15319 Merging to master! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67579/ Test PASSed. ---

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67579 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67579/consoleFull)** for PR 15612 at commit [`63425ff`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85140639 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15538: [SPARK-17993][SQL] Fix Parquet log output redirec...

2016-10-26 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15538#discussion_r85142206 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -718,7 +722,9 @@ object ParquetFileForma

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67580/ Test FAILed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67580/consoleFull)** for PR 15515 at commit [`58f1aba`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15538: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-10-26 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15538 I'm still seeing the torrent of `CorruptStatistics` errors in the Jenkins build log, even though I don't see them running the tests locally with sbt. Maybe it's a maven versus sbt build issue.

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85137296 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15621 **[Test build #67582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67582/consoleFull)** for PR 15621 at commit [`4b76649`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85134771 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #13891: [SPARK-6685][MLLIB]Use DSYRK to compute AtA in ALS

2016-10-26 Thread hqzizania
Github user hqzizania commented on the issue: https://github.com/apache/spark/pull/13891 @srowen I am not familiar with MiMa really, so what should I do now? Or just go back to [the previous commit](a6b5a16cd78e4efe99fda40f92592c9712b04146), and create a JIRA for the issue? --- If

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85133777 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-26 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15627 @kishorvpatil please look at the test failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-10-26 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r85125936 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +331,211 @@ class TaskSchedulerImplSuite extends SparkFunS

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67581/consoleFull)** for PR 15644 at commit [`63bfb0c`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/15644 [SPARK-18117][CORE] Add test for TaskSetBlacklist ## What changes were proposed in this pull request? This adds tests to verify the interaction between TaskSetBlacklist and TaskScheduler

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15515 LGTM, I added a new commit to make `partitionProviderIsHive` a field and put it in table properties in `HiveExternalCatalog`, to simplify the code a little bit. Feel free to revert it if it breaks

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67580/consoleFull)** for PR 15515 at commit [`58f1aba`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15513 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67578/ Test PASSed. ---

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67578/consoleFull)** for PR 15513 at commit [`ad7b71d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67579/consoleFull)** for PR 15612 at commit [`63425ff`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85111739 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -25,7 +25,11 @@ import org.apache.spark.sql.type

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15612 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15642 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67577/ Test PASSed. ---

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15642 **[Test build #67577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67577/consoleFull)** for PR 15642 at commit [`5ea4b95`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15377 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13891: [SPARK-6685][MLLIB]Use DSYRK to compute AtA in ALS

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13891 @hqzizania OK thanks for checking that. That may be an issue for this change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15377 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15556 Hm, usually it's more for important or small fixes. This is a moderate performance improvement, in a place it's important. I don't think it changes behavior. I'd be OK back-porting it. Anyone else?

[GitHub] spark pull request #15441: [SPARK-4411] [Web UI] Add "kill" link for jobs in...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15441 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15441: [SPARK-4411] [Web UI] Add "kill" link for jobs in the UI

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15441 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM...

2016-10-26 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/15598 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15598: [SPARK-18027][YARN] .sparkStaging not clean on RM Applic...

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15598 Merged to master. I'm not against merging to 2.0 but wasn't sure how essential this is as a fix. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15618#discussion_r85109184 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -239,7 +239,14 @@ private[spark] object ReliableCheckpointRDD exten

[GitHub] spark pull request #15599: [SPARK-18022][SQL] java.lang.NullPointerException...

2016-10-26 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/15599 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15599: [SPARK-18022][SQL] java.lang.NullPointerException instea...

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15599 Merged to master, and to 2.0 as a small clear fix. If there is a follow-on problem involving whatever exception this suppressed, I think that's separate. --- If your project is set up for it, you ca

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-10-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15618#discussion_r85107727 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -239,7 +239,14 @@ private[spark] object ReliableCheckpointRDD extends L

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67576/ Test FAILed. ---

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67576 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67576/consoleFull)** for PR 15612 at commit [`63425ff`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15597 Just to be extra safe, it'd be great to re-run the test suite on this once https://github.com/apache/spark/pull/15319 is merged. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-26 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15319 LGTM, Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15597 LGTM, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15618#discussion_r85104721 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -239,7 +239,14 @@ private[spark] object ReliableCheckpointRDD exten

[GitHub] spark pull request #15618: [SPARK-14914][CORE] Fix Resource not closed after...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15618#discussion_r85104561 --- Diff: core/src/main/scala/org/apache/spark/rdd/ReliableCheckpointRDD.scala --- @@ -239,7 +239,14 @@ private[spark] object ReliableCheckpointRDD exten

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15641 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15641 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67574/ Test PASSed. ---

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15641 **[Test build #67574 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67574/consoleFull)** for PR 15641 at commit [`de1fdd5`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67573/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67573 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67573/consoleFull)** for PR 15024 at commit [`9a09b18`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15643: [SPARK-18114][MESOS] fix mesos cluster scheduler generag...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15643 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #15643: [SPARK-18114][MESOS] fix mesos cluster scheduler ...

2016-10-26 Thread LeightonWong
GitHub user LeightonWong opened a pull request: https://github.com/apache/spark/pull/15643 [SPARK-18114][MESOS] fix mesos cluster scheduler generage command option error ## What changes were proposed in this pull request? Enclose --conf option value with "" to support multi

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #67575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67575/consoleFull)** for PR 1 at commit [`946ee73`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/1 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/1 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67575/ Test PASSed. ---

[GitHub] spark issue #15513: [SPARK-17963][SQL][Documentation] Add examples (extend) ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15513 **[Test build #67578 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67578/consoleFull)** for PR 15513 at commit [`ad7b71d`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67568/ Test PASSed. ---

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15024 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15618 Thank you for a good reference and explanation @mridulm . I will try to handle it. (It seems I misunderstood the comments.) --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67568/consoleFull)** for PR 15024 at commit [`8682d94`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15642: [SPARK-18009][SQL] Fix ClassCastException while calling ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15642 **[Test build #67577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67577/consoleFull)** for PR 15642 at commit [`5ea4b95`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #15642: [SPARK-18009][SQL] Fix ClassCastException while c...

2016-10-26 Thread dilipbiswal
GitHub user dilipbiswal opened a pull request: https://github.com/apache/spark/pull/15642 [SPARK-18009][SQL] Fix ClassCastException while calling toLocalIterator() on dataframe produced by RunnableCommand ## What changes were proposed in this pull request? A short code snippet t

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67576/consoleFull)** for PR 15612 at commit [`63425ff`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15612 cc @rxin @mridulm Several updates, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67571/ Test FAILed. ---

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15596 **[Test build #67571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67571/consoleFull)** for PR 15596 at commit [`86b4e42`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15618 It makes sense to use the Utils methods where possible, sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67569/ Test FAILed. ---

[GitHub] spark issue #15596: [SPARK-18089][SQL] Remove CollectLimitExec

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15596 **[Test build #67569 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67569/consoleFull)** for PR 15596 at commit [`360752c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #67575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67575/consoleFull)** for PR 1 at commit [`946ee73`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15641: [SPARK-18111] [SQL] Wrong ApproximatePercentile answer w...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15641 **[Test build #67574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67574/consoleFull)** for PR 15641 at commit [`de1fdd5`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15639: [Spark-Core]add defensive check for zipWithIndex

2016-10-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15639 LGTM. thanks~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #15515: [SPARK-17970][SQL] store partition spec in metast...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15515#discussion_r85080739 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -217,8 +218,24 @@ case class CatalogTable( out

[GitHub] spark issue #15024: [SPARK-17470][SQL] unify path for data source table and ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15024 **[Test build #67573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67573/consoleFull)** for PR 15024 at commit [`9a09b18`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r85079470 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -62,6 +62,7 @@ case class CreateDataSourceTab

[GitHub] spark issue #15608: [SPARK-17838][SparkR] Check named arguments for options ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15608 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67570/ Test PASSed. ---

[GitHub] spark issue #15608: [SPARK-17838][SparkR] Check named arguments for options ...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15608 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15608: [SPARK-17838][SparkR] Check named arguments for options ...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15608 **[Test build #67570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67570/consoleFull)** for PR 15608 at commit [`2336dd9`](https://github.com/apache/spark/commit/

<    1   2   3   4   5   6   >