[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid too many co...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12038#issuecomment-203277020 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid too many co...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12038#issuecomment-203277019 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid too many co...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12038#issuecomment-203276599 **[Test build #54492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54492/consoleFull)** for PR 12038 at commit [`1eacf55`](https://g

[GitHub] spark pull request: [SPARK-14191][SQL] Fix Expand operator constra...

2016-03-29 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11995#issuecomment-203276142 @marmbrus I've updated this and tests passed. Please take a look. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-14191][SQL] Fix Expand operator constra...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11995#issuecomment-203275434 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14191][SQL] Fix Expand operator constra...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11995#issuecomment-203275437 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14191][SQL] Fix Expand operator constra...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11995#issuecomment-203274702 **[Test build #54495 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54495/consoleFull)** for PR 11995 at commit [`23d6b37`](https://g

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203272766 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203272770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203272570 **[Test build #54494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54494/consoleFull)** for PR 12055 at commit [`20a932f`](https://g

[GitHub] spark pull request: [SPARK-14184][SQL] Support native execution of...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11991#issuecomment-203272610 **[Test build #54500 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54500/consoleFull)** for PR 11991 at commit [`034af13`](https://gi

[GitHub] spark pull request: [SPARK-14184][SQL] Support native execution of...

2016-03-29 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/11991#discussion_r57841828 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/ParserUtils.scala --- @@ -24,6 +24,7 @@ import org.apache.spark.sql.catal

[GitHub] spark pull request: [SPARK-14160] Time Windowing functions for Dat...

2016-03-29 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/12008#discussion_r57840903 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala --- @@ -0,0 +1,137 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request: [SPARK-14160] Time Windowing functions for Dat...

2016-03-29 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/12008#discussion_r57840817 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala --- @@ -0,0 +1,137 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request: [SPARK-14160] Time Windowing functions for Dat...

2016-03-29 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/12008#discussion_r57840756 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala --- @@ -0,0 +1,137 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request: [SPARK-14176][SQL]Add DataFrameWriter.trigger ...

2016-03-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11976#issuecomment-203265348 I updated the PR to add `Trigger` and `ProcessingTime` and it supports to add other triggers in future. --- If your project is set up for it, you can reply to this ema

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11603#issuecomment-203261005 **[Test build #54499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54499/consoleFull)** for PR 11603 at commit [`7feae6e`](https://gi

[GitHub] spark pull request: [SPARK-14176][SQL]Add DataFrameWriter.trigger ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11976#issuecomment-203261008 **[Test build #54498 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54498/consoleFull)** for PR 11976 at commit [`92d204c`](https://gi

[GitHub] spark pull request: [SPARK-12857][STREAMING] Standardize "records"...

2016-03-29 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/12032#issuecomment-203259640 @zsxwing please be aware of the changes we made here :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203258597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203258596 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203257996 **[Test build #54490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54490/consoleFull)** for PR 12036 at commit [`314c4db`](https://g

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-03-29 Thread zhonghaihua
Github user zhonghaihua commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r57838823 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,8 +82,20 @@ private[yarn] class YarnAllocator( new Con

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-203256050 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-203256047 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-203255912 **[Test build #54491 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54491/consoleFull)** for PR 11934 at commit [`ef77e70`](https://g

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-03-29 Thread zhonghaihua
Github user zhonghaihua commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r57838667 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,8 +82,20 @@ private[yarn] class YarnAllocator( new Con

[GitHub] spark pull request: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not p...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11211#issuecomment-203254077 **[Test build #54497 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54497/consoleFull)** for PR 11211 at commit [`e68899c`](https://gi

[GitHub] spark pull request: [SPARK-13330][PYSPARK] PYTHONHASHSEED is not p...

2016-03-29 Thread zjffdu
Github user zjffdu commented on the pull request: https://github.com/apache/spark/pull/11211#issuecomment-203253200 Update the patch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-13904][Scheduler]Add support for plugga...

2016-03-29 Thread tejasapatil
Github user tejasapatil commented on the pull request: https://github.com/apache/spark/pull/11723#issuecomment-203252858 sure. @rxin can you please review the PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12864][YARN] initialize executorIdCount...

2016-03-29 Thread zhonghaihua
Github user zhonghaihua commented on a diff in the pull request: https://github.com/apache/spark/pull/10794#discussion_r57837944 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedClusterMessage.scala --- @@ -30,6 +30,8 @@ private[spark] object CoarseGra

[GitHub] spark pull request: [SPARK-14264][PYSPARK][ML] Add feature importa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12056#issuecomment-203252624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14264][PYSPARK][ML] Add feature importa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12056#issuecomment-203252623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14264][PYSPARK][ML] Add feature importa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12056#issuecomment-203252561 **[Test build #54496 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54496/consoleFull)** for PR 12056 at commit [`892d301`](https://g

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-03-29 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r57837880 --- Diff: python/pyspark/ml/clustering.py --- @@ -292,6 +293,376 @@ def _create_model(self, java_model): return BisectingKMeansModel(java_model)

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203250531 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203250532 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203250405 **[Test build #54487 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54487/consoleFull)** for PR 12036 at commit [`e05b108`](https://g

[GitHub] spark pull request: [SPARK-14264][PYSPARK][ML] Add feature importa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12056#issuecomment-203249760 **[Test build #54496 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54496/consoleFull)** for PR 12056 at commit [`892d301`](https://gi

[GitHub] spark pull request: [SPARK-14264][PYSPARK][ML] Add feature importa...

2016-03-29 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/12056 [SPARK-14264][PYSPARK][ML] Add feature importance for GBTs in pyspark ## What changes were proposed in this pull request? Feature importances are exposed in the python API for GBTs.

[GitHub] spark pull request: [SPARK-14191][SQL] Fix Expand operator constra...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11995#issuecomment-203248636 **[Test build #54495 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54495/consoleFull)** for PR 11995 at commit [`23d6b37`](https://gi

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203248630 **[Test build #54494 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54494/consoleFull)** for PR 12055 at commit [`20a932f`](https://gi

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203248160 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203248162 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203248157 **[Test build #54493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54493/consoleFull)** for PR 12055 at commit [`7fd7d70`](https://g

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203248086 **[Test build #54493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54493/consoleFull)** for PR 12055 at commit [`7fd7d70`](https://gi

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/12055 [SPARK-14263][SQL] Benchmark Vectorized HashMap for GroupBy Aggregates ## What changes were proposed in this pull request? This PR proposes a new data-structure called based on a vect

[GitHub] spark pull request: [SPARK-14263][SQL] Benchmark Vectorized HashMa...

2016-03-29 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/12055#issuecomment-203247691 cc @nongli --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-14255] [SQL] Streaming Aggregation

2016-03-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/12048#issuecomment-203247192 Test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid using compo...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12038#issuecomment-203243837 **[Test build #54492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54492/consoleFull)** for PR 12038 at commit [`1eacf55`](https://gi

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203242726 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203242724 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203242329 **[Test build #54486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54486/consoleFull)** for PR 12036 at commit [`6b76980`](https://g

[GitHub] spark pull request: [SPARK-14181] TrainValidationSplit should have...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11985#issuecomment-203241574 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14181] TrainValidationSplit should have...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11985#issuecomment-203241416 **[Test build #54489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54489/consoleFull)** for PR 11985 at commit [`5c14acb`](https://g

[GitHub] spark pull request: [SPARK-14181] TrainValidationSplit should have...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11985#issuecomment-203241572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12857][STREAMING] Standardize "records"...

2016-03-29 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/12032#discussion_r57835381 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala --- @@ -241,24 +241,24 @@ private[ui] class StreamingPage(parent: Streami

[GitHub] spark pull request: [SPARK-14254][Core]Add logs to help investigat...

2016-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12046 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14254][Core]Add logs to help investigat...

2016-03-29 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/12046#issuecomment-203238377 Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-203238196 **[Test build #54491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54491/consoleFull)** for PR 11934 at commit [`ef77e70`](https://gi

[GitHub] spark pull request: [SPARK-14262] correct appStatus after master l...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12054#issuecomment-203238171 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-14262] correct appStatus after master l...

2016-03-29 Thread GavinGavinNo1
GitHub user GavinGavinNo1 opened a pull request: https://github.com/apache/spark/pull/12054 [SPARK-14262] correct appStatus after master leader changed ## What changes were proposed in this pull request? Suppose master leadership changes, even if recovery is completed, those

[GitHub] spark pull request: [SPARK-11892][ML] Model export/import for spar...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-203236422 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5

[GitHub] spark pull request: [SPARK-11892][ML] Model export/import for spar...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-203236420 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11892][ML] Model export/import for spar...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-203236348 **[Test build #54488 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54488/consoleFull)** for PR 9934 at commit [`e6b16a8`](https://git

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203236224 **[Test build #54490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54490/consoleFull)** for PR 12036 at commit [`314c4db`](https://gi

[GitHub] spark pull request: [SPARK-14255] [SQL] Streaming Aggregation

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12048#issuecomment-203235005 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14255] [SQL] Streaming Aggregation

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12048#issuecomment-203235006 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14255] [SQL] Streaming Aggregation

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12048#issuecomment-203234921 **[Test build #54485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54485/consoleFull)** for PR 12048 at commit [`6aeb27a`](https://g

[GitHub] spark pull request: [SPARK-11940][PYSPARK] Python API for ml.clust...

2016-03-29 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/10242#discussion_r57834098 --- Diff: python/pyspark/ml/clustering.py --- @@ -292,6 +293,376 @@ def _create_model(self, java_model): return BisectingKMeansModel(java_model)

[GitHub] spark pull request: [SPARK-14181] TrainValidationSplit should have...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11985#issuecomment-203231374 **[Test build #54489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54489/consoleFull)** for PR 11985 at commit [`5c14acb`](https://gi

[GitHub] spark pull request: [SPARK-14181] TrainValidationSplit should have...

2016-03-29 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/11985#issuecomment-203231189 @jkbradley Add seed into tests including test with linear/logistic regression and save/load. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2016-03-29 Thread ted-yu
Github user ted-yu closed the pull request at: https://github.com/apache/spark/pull/10181 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203228945 One small correction: I believe Mridul was in favor of dropping Scala 2.10 support, so the expressed opinions of PMC members were mixed. --- If your project is se

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203228465 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203228466 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203228341 **[Test build #54482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54482/consoleFull)** for PR 11542 at commit [`d726f9a`](https://g

[GitHub] spark pull request: [SPARK-11892][ML] Model export/import for spar...

2016-03-29 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-203228185 @jkbradley I merged with master, it seems good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203228057 **[Test build #54487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54487/consoleFull)** for PR 12036 at commit [`e05b108`](https://gi

[GitHub] spark pull request: [SPARK-11892][ML] Model export/import for spar...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-203228059 **[Test build #54488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54488/consoleFull)** for PR 9934 at commit [`e6b16a8`](https://gith

[GitHub] spark pull request: [SPARK-14184][SQL] Support native execution of...

2016-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11991#discussion_r57832569 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ng/ParserUtils.scala --- @@ -24,6 +24,7 @@ import org.apache.spark.sql.catalyst.p

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203227472 Thanks. Before the 2.0.0 release we will need to make final decisions on both Java 7 and Scala 2.10. It's not really difficult to remove support for either

[GitHub] spark pull request: [SPARK-14253][SQL] Refactor HiveFunctionRegist...

2016-03-29 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12051#issuecomment-203227039 LGTM, I can rebase #12036 against current change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread lresende
Github user lresende closed the pull request at: https://github.com/apache/spark/pull/11542 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203224103 There was no consensus reached in that discussion thread. Reynold opened the thread to get a sense of how the Spark community feels about dropping Java 7 for Java

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12036#discussion_r57831326 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -86,13 +87,50 @@ case class DescribeDatabase( extended: Boo

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203215691 @andrewor14 I go through #12051 again. Your main change is in `HiveFunctionRegistry`. I compare our changes in this place and they are nearly doing the same thing, excep

[GitHub] spark pull request: [SPARK-14253][SQL] Refactor HiveFunctionRegist...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12051#issuecomment-203215370 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14253][SQL] Refactor HiveFunctionRegist...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12051#issuecomment-203215374 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14253][SQL] Refactor HiveFunctionRegist...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12051#issuecomment-203214758 **[Test build #54479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54479/consoleFull)** for PR 12051 at commit [`8cd5708`](https://g

[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid using compo...

2016-03-29 Thread liyezhang556520
Github user liyezhang556520 commented on the pull request: https://github.com/apache/spark/pull/12038#issuecomment-203213286 @vanzin , I think @zsxwing 's idea of using `CompositeByteBuf.addComponents` is a better choice, which will only introduce exactly one copy if the small buffer

[GitHub] spark pull request: [SPARK-14242][CORE][Network] avoid using compo...

2016-03-29 Thread liyezhang556520
Github user liyezhang556520 commented on a diff in the pull request: https://github.com/apache/spark/pull/12038#discussion_r57830669 --- Diff: common/network-common/src/main/java/org/apache/spark/network/util/TransportFrameDecoder.java --- @@ -139,14 +139,18 @@ private ByteBuf dec

[GitHub] spark pull request: [SPARK-14123][SQL] Implement function related ...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12036#issuecomment-203210735 **[Test build #54486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54486/consoleFull)** for PR 12036 at commit [`6b76980`](https://gi

[GitHub] spark pull request: [SPARK-13703][BUILD] Remove obsolete scala-2.1...

2016-03-29 Thread lresende
Github user lresende commented on the pull request: https://github.com/apache/spark/pull/11542#issuecomment-203206216 @markhamstra The discussion seems to be getting consensus, so it's not that I am jumping the gun and creating something completely new, but reopening something that se

[GitHub] spark pull request: [SPARK-14231][SQL] JSON data source infers flo...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12030#issuecomment-203203789 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14231][SQL] JSON data source infers flo...

2016-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12030#issuecomment-203203798 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14231][SQL] JSON data source infers flo...

2016-03-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12030#issuecomment-203202449 **[Test build #54480 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54480/consoleFull)** for PR 12030 at commit [`7828d7a`](https://g

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11934#discussion_r57829895 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/DefaultSource.scala --- @@ -125,6 +126,33 @@ class DefaultSource extends

[GitHub] spark pull request: SPARK-14139 Dataset loses nullability in opera...

2016-03-29 Thread koertkuipers
Github user koertkuipers commented on a diff in the pull request: https://github.com/apache/spark/pull/11980#discussion_r57829829 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala --- @@ -120,17 +120,19 @@ object RowEncoder {

[GitHub] spark pull request: SPARK-14139 Dataset loses nullability in opera...

2016-03-29 Thread koertkuipers
Github user koertkuipers commented on a diff in the pull request: https://github.com/apache/spark/pull/11980#discussion_r57829840 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala --- @@ -680,3 +680,54 @@ case class AssertNotNull(child:

  1   2   3   4   5   6   7   >