[GitHub] spark pull request #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Stat...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15054#discussion_r78900278 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -360,6 +360,7 @@ trait CheckAnalysis extends Predi

[GitHub] spark pull request #14444: [SPARK-16839] [SQL] redundant aliases after clean...

2016-09-15 Thread eyalfa
Github user eyalfa commented on a diff in the pull request: https://github.com/apache/spark/pull/1#discussion_r78900571 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -174,59 +174,32 @@ case class CreateMap(child

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14659 **[Test build #65427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65427/consoleFull)** for PR 14659 at commit [`748e7a9`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #65429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65429/consoleFull)** for PR 14638 at commit [`eac4037`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14623 **[Test build #65430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65430/consoleFull)** for PR 14623 at commit [`4545837`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15054 **[Test build #65428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65428/consoleFull)** for PR 15054 at commit [`333497a`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #65431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65431/consoleFull)** for PR 14116 at commit [`2296c0e`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #15105: [SPARK-17548] [MLlib] Word2VecModel.findSynonyms ...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15105#discussion_r78905531 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala --- @@ -566,8 +582,8 @@ class Word2VecModel private[spark] ( wordList.zi

[GitHub] spark pull request #15105: [SPARK-17548] [MLlib] Word2VecModel.findSynonyms ...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15105#discussion_r78905623 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala --- @@ -68,6 +69,21 @@ class Word2VecSuite extends SparkFunSuite with MLlib

[GitHub] spark issue #15096: [SPARK-17537] [SQL] Reading parquet schema from driver d...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15096 Yes please close this as a duplicate --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15096: [SPARK-17537] [SQL] Reading parquet schema from driver d...

2016-09-15 Thread yangw1234
Github user yangw1234 commented on the issue: https://github.com/apache/spark/pull/15096 Yes, this is a duplicate, closing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request #15096: [SPARK-17537] [SQL] Reading parquet schema from d...

2016-09-15 Thread yangw1234
Github user yangw1234 closed the pull request at: https://github.com/apache/spark/pull/15096 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14426 Rebased to resolve conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15108: [SPARK-17543] [Missing log4j config file for tests in co...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15108 OK, this is just a copy of another config file? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #15094: [SPARK-17534] [TESTS] Increase timeouts for DirectKafkaS...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15094 I don't feel strongly about it, but you could write these times in units of seconds now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as wel

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #65432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65432/consoleFull)** for PR 14426 at commit [`b1f314c`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #15106: [SPARK-16439] [SQL] bring back the separator in SQL UI

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15106 The question isn't the language of the UI, but of the host OS. I think this just causes the previous problem again, and that seems more important. I don't think we can make this change as is. --- I

[GitHub] spark pull request #14762: [SPARK-16962][CORE][SQL] Fix misaligned record ac...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14762#discussion_r78908926 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/array/ByteArrayMethods.java --- @@ -47,13 +47,20 @@ public static int roundNumberOfBytesToNeare

[GitHub] spark pull request #14762: [SPARK-16962][CORE][SQL] Fix misaligned record ac...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14762#discussion_r78909063 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/compression/CompressibleColumnBuilder.scala --- @@ -46,6 +47,7 @@ private[columnar]

[GitHub] spark pull request #14762: [SPARK-16962][CORE][SQL] Fix misaligned record ac...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14762#discussion_r78909202 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -699,9 +703,10 @@ public boolean append(Object kbase, long koff, int kle

[GitHub] spark issue #15108: [SPARK-17543] [Missing log4j config file for tests in co...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15108 **[Test build #65423 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65423/consoleFull)** for PR 15108 at commit [`f476755`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15108: [SPARK-17543] [Missing log4j config file for tests in co...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65423/ Test PASSed. ---

[GitHub] spark issue #15108: [SPARK-17543] [Missing log4j config file for tests in co...

2016-09-15 Thread jagadeesanas2
Github user jagadeesanas2 commented on the issue: https://github.com/apache/spark/pull/15108 yes, its some what similar to ```common/network-shuffle``` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15108: [SPARK-17543] [Missing log4j config file for tests in co...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15108 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r78911748 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -171,14 +166,48 @@ object ChiSqSelectorModel extends Loader[ChiSqSel

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r78910882 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/ChiSqSelector.scala --- @@ -171,14 +166,48 @@ object ChiSqSelectorModel extends Loader[ChiSqSel

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r78910792 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/ChiSqSelector.scala --- @@ -68,8 +99,23 @@ final class ChiSqSelector @Since("1.6.0") (@Since("1.6.

[GitHub] spark pull request #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14597#discussion_r78911482 --- Diff: python/pyspark/mllib/feature.py --- @@ -271,28 +271,75 @@ def transform(self, vector): return JavaVectorTransformer.transform(self, vect

[GitHub] spark issue #15060: [SPARK-17507][ML][MLLib] check weight vector size in ANN

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15060 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #15101: [SPARK-17114][SQL] Fix aggregates grouped by lite...

2016-09-15 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15101#discussion_r78913008 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1098,9 +1098,16 @@ object ReplaceExceptWithAntiJoin

[GitHub] spark issue #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' predict...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14643 Ping @zhengruifeng are you in a position to keep working on this or should I take it over? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request #15060: [SPARK-17507][ML][MLLib] check weight vector size...

2016-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15060 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14118#discussion_r78913621 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -232,66 +232,62 @@ private[csv] object CSVTypeCa

[GitHub] spark pull request #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14118#discussion_r78913816 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -232,66 +232,62 @@ private[csv] object CSVTypeCa

[GitHub] spark pull request #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make...

2016-09-15 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14118#discussion_r78913432 --- Diff: python/pyspark/sql/readwriter.py --- @@ -329,7 +329,8 @@ def csv(self, path, schema=None, sep=None, encoding=None, quote=None, escape=Non

[GitHub] spark issue #15079: [SPARK-17524] [TESTS] Use specified spark.buffer.pageSiz...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15079 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #15077: [SPARK-17521]Error when I use sparkContext.makeRDD(Seq()...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15077 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15077: [SPARK-17521]Error when I use sparkContext.makeRD...

2016-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #15079: [SPARK-17524] [TESTS] Use specified spark.buffer....

2016-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15079 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #15082: [SPARK-17528][SQL] MutableProjection should not c...

2016-09-15 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15082#discussion_r78915332 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/RowTest.scala --- @@ -121,10 +121,6 @@ class RowTest extends FunSpec with Matchers {

[GitHub] spark issue #15107: [SPARK-17551][SQL] complete the NULL ordering support in...

2016-09-15 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15107 @rxin any opinion about this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/12601 I don't see that any docs were added? I mean in the user facing documentation under docs/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark issue #14961: [SPARK-17379] [BUILD] Upgrade netty-all to 4.0.41 final ...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14961 OK, I think this is a good change. Maybe to be conservative we'll only put this in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #14969: [SPARK-17406][WEB UI] limit timeline executor events

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14969 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #14969: [SPARK-17406][WEB UI] limit timeline executor eve...

2016-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15098: [SPARK-17536] [SQL] Minor performance improvement to JDB...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15098 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15054 **[Test build #65428 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65428/consoleFull)** for PR 15054 at commit [`333497a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15054 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65428/ Test FAILed. ---

[GitHub] spark pull request #15098: [SPARK-17536] [SQL] Minor performance improvement...

2016-09-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15098 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15054 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15053: [Doc] improve python API docstrings

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15053 @HyukjinKwon I think you'd know better than I. I tend to agree it would make the examples more self-contained and readable. It would lead to some more duplication of code I guess, but if you judge it

[GitHub] spark issue #14975: Correct fetchsize property name in docs

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14975 @darabos do you want to close this out or should I do the update? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15084 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15084 **[Test build #3267 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3267/consoleFull)** for PR 15084 at commit [`b3c7127`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15058: [SPARK-17505][MLLIB]Add setBins for BinaryClassification...

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15058 I feel strongly enough about it that I'd request we close this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14623 **[Test build #65430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65430/consoleFull)** for PR 14623 at commit [`4545837`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14623 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65430/ Test FAILed. ---

[GitHub] spark issue #14623: [SPARK-17044][SQL] Make test files for window functions ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14623 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14638 **[Test build #65429 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65429/consoleFull)** for PR 14638 at commit [`eac4037`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14638 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65429/ Test PASSed. ---

[GitHub] spark issue #14851: [SPARK-17281][ML][MLLib] Add treeAggregateDepth paramete...

2016-09-15 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14851 cc @srowen thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14659 **[Test build #65427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65427/consoleFull)** for PR 14659 at commit [`748e7a9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65427/ Test FAILed. ---

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15054 **[Test build #65426 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65426/consoleFull)** for PR 15054 at commit [`a01f6b3`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15054 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65426/ Test PASSed. ---

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15084 **[Test build #3267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3267/consoleFull)** for PR 15084 at commit [`b3c7127`](https://github.com/apache/spark/commit

[GitHub] spark pull request #15109: [SPARK-17501][CORE] Record executor heartbeat tim...

2016-09-15 Thread cenyuhai
GitHub user cenyuhai opened a pull request: https://github.com/apache/spark/pull/15109 [SPARK-17501][CORE] Record executor heartbeat timestamp when received heartbeat event. ## What changes were proposed in this pull request? Record executor's latest heartbeat timestamp when re

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15084 **[Test build #3268 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3268/consoleFull)** for PR 15084 at commit [`b3c7127`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15109: [SPARK-17501][CORE] Record executor heartbeat timestamp ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15109 **[Test build #65433 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65433/consoleFull)** for PR 15109 at commit [`9839193`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15101 **[Test build #65434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65434/consoleFull)** for PR 15101 at commit [`e6c4b9c`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #15074: [SPARK-17520] Implement a better __eq__ for Spars...

2016-09-15 Thread gglanzani
Github user gglanzani commented on a diff in the pull request: https://github.com/apache/spark/pull/15074#discussion_r78923979 --- Diff: python/pyspark/mllib/linalg/__init__.py --- @@ -1296,9 +1296,19 @@ def asML(self): return newlinalg.SparseMatrix(self.numRows, self.n

[GitHub] spark pull request #14527: [SPARK-16938][SQL] `drop/dropDuplicate` should ha...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14527#discussion_r78924274 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1827,7 +1827,7 @@ class Dataset[T] private[sql]( val resolver = sparkS

[GitHub] spark issue #14527: [SPARK-16938][SQL] `drop/dropDuplicate` should handle th...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14527 Sorry I was quite busy these days. It looks to me that a better approach is adding new API, instead of fixing the one with string parameter. cc @liancheng @yhuai what do you think? --- If your p

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15084 **[Test build #3268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3268/consoleFull)** for PR 15084 at commit [`b3c7127`](https://github.com/apache/spark/commit

[GitHub] spark pull request #15058: [SPARK-17505][MLLIB]Add setBins for BinaryClassif...

2016-09-15 Thread mpjlu
Github user mpjlu closed the pull request at: https://github.com/apache/spark/pull/15058 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark issue #15058: [SPARK-17505][MLLIB]Add setBins for BinaryClassification...

2016-09-15 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/15058 sure, I close it now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15101 **[Test build #65434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65434/consoleFull)** for PR 15101 at commit [`e6c4b9c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15101 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15101 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65434/ Test FAILed. ---

[GitHub] spark issue #15109: [SPARK-17501][CORE] Record executor heartbeat timestamp ...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15109 **[Test build #65433 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65433/consoleFull)** for PR 15109 at commit [`9839193`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15109: [SPARK-17501][CORE] Record executor heartbeat timestamp ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15109 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65433/ Test FAILed. ---

[GitHub] spark issue #15109: [SPARK-17501][CORE] Record executor heartbeat timestamp ...

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15109 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14597: [SPARK-17017][MLLIB][ML] add a chiSquare Selector based ...

2016-09-15 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/14597 Thanks very much, I am in holiday now, will update the code this Sunday. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #65431 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65431/consoleFull)** for PR 14116 at commit [`2296c0e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15101 LGTM, pending jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65431/ Test PASSed. ---

[GitHub] spark pull request #15082: [SPARK-17528][SQL] MutableProjection should not c...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15082#discussion_r78927126 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/RowTest.scala --- @@ -121,10 +121,6 @@ class RowTest extends FunSpec with Matchers { e

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #65432 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65432/consoleFull)** for PR 14426 at commit [`b1f314c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65432/ Test FAILed. ---

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-09-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14969: [SPARK-17406][WEB UI] limit timeline executor events

2016-09-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14969 Ah, hm, though this passed the PR builder, for some reason it fails to build because of MiMa checks: ```[error] * method executorToTotalCores()scala.collection.mutable.HashMap in class org.

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15101 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark pull request #14444: [SPARK-16839] [SQL] redundant aliases after clean...

2016-09-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/1#discussion_r78928177 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala --- @@ -174,59 +174,32 @@ case class CreateMap(ch

[GitHub] spark issue #15101: [SPARK-17114][SQL] Fix aggregates grouped by literals wi...

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15101 **[Test build #65435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65435/consoleFull)** for PR 15101 at commit [`e6c4b9c`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #15110: [SPARK-17406] [BUILD] [HOTFIX] MiMa excludes fix

2016-09-15 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/15110 [SPARK-17406] [BUILD] [HOTFIX] MiMa excludes fix ## What changes were proposed in this pull request? Following https://github.com/apache/spark/pull/14969 for some reason the MiMa excludes w

[GitHub] spark issue #15110: [SPARK-17406] [BUILD] [HOTFIX] MiMa excludes fix

2016-09-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15110 **[Test build #65436 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65436/consoleFull)** for PR 15110 at commit [`2f65b79`](https://github.com/apache/spark/commit/2

  1   2   3   4   5   >