[GitHub] spark issue #15630: [SPARK-18104][DOC]Don't build KafkaSource doc

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15630 Discussed with @tdas offline. I'm going to merge to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #15597: [SPARK-18063][SQL] Failed to infer constraints ov...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15597 Merging this in master/branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85184978 --- Diff: core/src/main/scala/org/apache/spark/rdd/ZippedPartitionsRDD.scala --- @@ -45,7 +45,8 @@ private[spark] class ZippedPartitionsPartition(

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184948 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -68,11 +76,21 @@ case class XPathBoolean(xml:

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184825 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -120,9 +168,19 @@ case class XPathFloat(xml:

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184742 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -107,9 +145,19 @@ case class XPathLong(xml:

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85184643 --- Diff: core/src/main/scala/org/apache/spark/util/ZipPartitionsRDDUtils.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184264 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -94,9 +122,19 @@ case class XPathInt(xml:

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85183882 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -56,8 +56,16 @@ abstract class XPathExtract

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67590/consoleFull)** for PR 15647 at commit

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15590: [SPARK-17949][SQL] A JVM object based aggregate operator

2016-10-26 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15590 @hvanhovell That's a great point. This is actually one of my pain points while writing this new operator. These problems are: 1. `HashAggregateExec` and `SortAggregateExec` have

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67590/ Test FAILed. ---

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 There are conflicts with 2.0. #15646 is the backport for 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67590/consoleFull)** for PR 15647 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67592/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15646: [SPARK-13747][SQL] Fix concurrent executions in ForkJoin...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15646 **[Test build #67591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67591/consoleFull)** for PR 15646 at commit

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15647 CC: @mpjlu @srowen @yanboliang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/15647 [SPARK-18088][ML] Various ChiSqSelector cleanups ## What changes were proposed in this pull request? * Renamed kbest to numTopFeatures * Renamed alpha to fpr * Added missing

[GitHub] spark pull request #15646: [SPARK-13747][SQL] Fix concurrent executions in F...

2016-10-26 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/15646 [SPARK-13747][SQL] Fix concurrent executions in ForkJoinPool for SQL (branch 2.0) ## What changes were proposed in this pull request? Backport #15520 to 2.0. ## How was this

[GitHub] spark pull request #15520: [SPARK-13747][SQL]Fix concurrent executions in Fo...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15520 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 Thanks! Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15520 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67583/ Test PASSed. ---

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15645 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15645 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67584/ Test FAILed. ---

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15597 **[Test build #67583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67583/consoleFull)** for PR 15597 at commit

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15645 **[Test build #67584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67584/consoleFull)** for PR 15645 at commit

[GitHub] spark issue #13982: [SPARK-16304] LinkageError should not crash Spark execut...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13982 thanks! Merging to 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15644 @kayousterhout here are the tests that should have been in SPARK-17675. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67586/ Test FAILed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67586/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/15632 Thanks to @viirya, this is a false alarm, I will continue to looking for the real cause. @srowen The reason we have a fork here is that the upstream does not support concated stream, we

[GitHub] spark pull request #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies closed the pull request at: https://github.com/apache/spark/pull/15632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15631: [Spark-Core][Test][Minor]: Fix the wrong comment in test

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15631 **[Test build #67589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67589/consoleFull)** for PR 15631 at commit

[GitHub] spark issue #15634: [SPARK-18103] [SQL] Rename *FileCatalog to *FileProvider

2016-10-26 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15634 This is okay, but note that "Provider" is equally overloaded in the Data Source API. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/15632#discussion_r85173398 --- Diff: core/src/main/java/org/apache/spark/io/LZ4BlockInputStream.java --- @@ -197,7 +197,7 @@ private void refill() throws IOException {

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85168358 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15640 Hi, @srinathshankar . For the test suite, I'll update again if you give more opinion. So far, I didn't update that because I'm not sure. --- If your project is set up for it, you can

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67588/consoleFull)** for PR 15640 at commit

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67587/consoleFull)** for PR 15640 at commit

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85168739 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85167755 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85166515 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15621 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85164920 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67581/ Test PASSed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15621 I'll merge it into master. Thanks for reviewing! @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67581/consoleFull)** for PR 15644 at commit

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread srinathshankar
Github user srinathshankar commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85163515 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread srinathshankar
Github user srinathshankar commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85163883 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85163715 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85161018 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15623: [SPARK-18093][SQL] Fix default value test in SQLC...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15623 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15623: [SPARK-18093][SQL] Fix default value test in SQLConfSuit...

2016-10-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15623 Merging to master / 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15556 If it's a clean backport I'm ok with it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67585/ Test PASSed. ---

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #67585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67585/consoleFull)** for PR 13557 at commit

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85154993 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15516 To clarify, we have the method name in the @rdname tag. In this case it should be @rdname storageLevel And not storageLevel-methods --- If your project is set up for it,

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67586/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15618: [SPARK-14914][CORE] Fix Resource not closed after using,...

2016-10-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15618 I don't mean putting the finally here on this line since we do use it in the success case. But try {} catch e { handleStuff(); throw e; } is just try {} finally {}. I think there

[GitHub] spark issue #13982: [SPARK-16304] LinkageError should not crash Spark execut...

2016-10-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13982 No objection. On Wednesday, October 26, 2016, Shixiong Zhu wrote: > @rxin any objection to merge this one into 2.0? > I

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #67585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67585/consoleFull)** for PR 13557 at commit

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/13557 jenkins test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15413 @sethah I did some performance tests actually, and found this change can improve by 1.5x ~ 2x according to different dimensions and number of clusters. I will post the test result soon. Thanks.

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15621 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67582/ Test PASSed. ---

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15621 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15621 **[Test build #67582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67582/consoleFull)** for PR 15621 at commit

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15645 **[Test build #67584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67584/consoleFull)** for PR 15645 at commit

[GitHub] spark pull request #15645: [DO-NOT-MERGE] complex type creator should always...

2016-10-26 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15645 [DO-NOT-MERGE] complex type creator should always output unsafe format ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

[GitHub] spark issue #10739: Changes to support KMeans with large feature space

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10739 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15319: [SPARK-17733][SQL] InferFiltersFromConstraints ru...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15319 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15597 **[Test build #67583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67583/consoleFull)** for PR 15597 at commit

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15597 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15319: [SPARK-17733][SQL] InferFiltersFromConstraints rule neve...

2016-10-26 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15319 Merging to master! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15612 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67579/ Test PASSed. ---

[GitHub] spark issue #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocation fun...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15612 **[Test build #67579 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67579/consoleFull)** for PR 15612 at commit

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85140639 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15538: [SPARK-17993][SQL] Fix Parquet log output redirec...

2016-10-26 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15538#discussion_r85142206 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -718,7 +722,9 @@ object

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67580/ Test FAILed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67580/consoleFull)** for PR 15515 at commit

[GitHub] spark issue #15538: [SPARK-17993][SQL] Fix Parquet log output redirection

2016-10-26 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15538 I'm still seeing the torrent of `CorruptStatistics` errors in the Jenkins build log, even though I don't see them running the tests locally with sbt. Maybe it's a maven versus sbt build issue.

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85137296 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15621 **[Test build #67582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67582/consoleFull)** for PR 15621 at commit

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85134771 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #13891: [SPARK-6685][MLLIB]Use DSYRK to compute AtA in ALS

2016-10-26 Thread hqzizania
Github user hqzizania commented on the issue: https://github.com/apache/spark/pull/13891 @srowen I am not familiar with MiMa really, so what should I do now? Or just go back to [the previous commit](a6b5a16cd78e4efe99fda40f92592c9712b04146), and create a JIRA for the issue? ---

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85133777 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,61 +133,68 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15627: [SPARK-18099][YARN] Fail if same files added to distribu...

2016-10-26 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15627 @kishorvpatil please look at the test failure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-10-26 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r85125936 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +331,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67581/consoleFull)** for PR 15644 at commit

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/15644 [SPARK-18117][CORE] Add test for TaskSetBlacklist ## What changes were proposed in this pull request? This adds tests to verify the interaction between TaskSetBlacklist and

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15515 LGTM, I added a new commit to make `partitionProviderIsHive` a field and put it in table properties in `HiveExternalCatalog`, to simplify the code a little bit. Feel free to revert it if it

<    1   2   3   4   5   6   >