[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16436 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16436 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70725/ Test PASSed. ---

[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16436 **[Test build #70725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70725/testReport)** for PR 16436 at commit [`9693ef1`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16438: [SPARK-19029] [SQL] Remove databaseName from SimpleCatal...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16438 **[Test build #70727 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70727/testReport)** for PR 16438 at commit [`b38c53c`](https://github.com/apache/spark/commit/b3

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16437 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16437 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70724/ Test PASSed. ---

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16437 **[Test build #70724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70724/testReport)** for PR 16437 at commit [`722a0e2`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #16438: [SPARK-19029] [SQL] Remove databaseName from Simp...

2016-12-29 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16438 [SPARK-19029] [SQL] Remove databaseName from SimpleCatalogRelation ### What changes were proposed in this pull request? Remove useless `databaseName ` from `SimpleCatalogRelation`.

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15664 Hi, @gatorsmile . I have no objections on your patch! So, I merged that into this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15664 **[Test build #70726 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70726/testReport)** for PR 15664 at commit [`2cc738a`](https://github.com/apache/spark/commit/2c

[GitHub] spark pull request #15664: [SPARK-18123][SQL] Use db column names instead of...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15664#discussion_r94177466 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -211,6 +211,55 @@ object JdbcUtils extends Lo

[GitHub] spark pull request #15664: [SPARK-18123][SQL] Use db column names instead of...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15664#discussion_r94177293 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -211,6 +211,55 @@ object JdbcUtils extends Lo

[GitHub] spark issue #16427: [SPARK-19012][SQL] Fix `createTempViewCommand` to throw ...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16427 Thank you always, @hvanhovel ! Happy new year! :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request #16427: [SPARK-19012][SQL] Fix `createTempViewCommand` to...

2016-12-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-29 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 Thanks, Wenchen, I have backport the code of #16339 to here, I have tested it locally. Can you review and verify? On Sun, Dec 25, 2016 at 11:04 PM, Wenchen Fan wrote: > #

[GitHub] spark issue #16427: [SPARK-19012][SQL] Fix `createTempViewCommand` to throw ...

2016-12-29 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16427 LGTM. Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor chang...

2016-12-29 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16434 Also, could you please change the PR description to be self-contained (rather than just referencing another PR)? The description becomes the commit message. --- If your project is set up for it

[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16436 **[Test build #70725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70725/testReport)** for PR 16436 at commit [`9693ef1`](https://github.com/apache/spark/commit/96

[GitHub] spark pull request #15664: [SPARK-18123][SQL] Use db column names instead of...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15664#discussion_r94175664 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -568,10 +617,9 @@ object JdbcUtils extends Lo

[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16436 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16436: [SPARK-18698][ML] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16436#discussion_r94175562 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala --- @@ -219,6 +219,16 @@ class StringIndexerSuite testDefa

[GitHub] spark pull request #16436: [SPARK-18698][ML] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16436#discussion_r94175568 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala --- @@ -219,6 +219,16 @@ class StringIndexerSuite testDefa

[GitHub] spark pull request #16436: [SPARK-18698][ML] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16436#discussion_r94175547 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala --- @@ -219,6 +219,16 @@ class StringIndexerSuite testDefa

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15664 Thank you for deep review again, @viirya and @gatorsmile . I'll update the PR soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16400 Hi, @gatorsmile . Could you review this `CREATE TABLE ... LOCATION` document issue when you have sometime? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16427: [SPARK-19012][SQL] Fix `createTempViewCommand` to throw ...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16427 Hi, @hvanhovell . Could you review this `createTempViewCommand` PR again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16320: [SPARK-18877][SQL] `CSVInferSchema.inferField` on Decima...

2016-12-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16320 Could you review this `CSVInferSchema` issue again, @gatorsmile ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request #16436: [SPARK-18698][ML] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on a diff in the pull request: https://github.com/apache/spark/pull/16436#discussion_r94174966 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala --- @@ -219,6 +219,16 @@ class StringIndexerSuite testDefa

[GitHub] spark issue #16436: [SPARK-18698][ML] Adding public constructor that takes u...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16436 done! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark pull request #16433: [SPARK-19022][TESTS] Fix tests dependent on OS du...

2016-12-29 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16433#discussion_r94174880 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -30,10 +30,16 @@ import org.apache.spark

[GitHub] spark pull request #16436: [SPARK-18698][ML][MLLIB] Adding public constructo...

2016-12-29 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16436#discussion_r94174586 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala --- @@ -219,6 +219,16 @@ class StringIndexerSuite testDefaultR

[GitHub] spark issue #16374: [SPARK-18925][STREAMING] Reduce memory usage of mapWithS...

2016-12-29 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16374 Some operators (e.g., window) may still need to use these RDD, dropping them will slow your application. That's why `DStream` uses `rememberDuration` to filter RDDs. You can [tune the memor

[GitHub] spark pull request #16424: [SPARK-19016][SQL][DOC] Document scalable partiti...

2016-12-29 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16424#discussion_r94170967 --- Diff: docs/sql-programming-guide.md --- @@ -526,11 +526,18 @@ By default `saveAsTable` will create a "managed table", meaning that the locatio be cont

[GitHub] spark pull request #16424: [SPARK-19016][SQL][DOC] Document scalable partiti...

2016-12-29 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16424#discussion_r94170820 --- Diff: docs/sql-programming-guide.md --- @@ -526,11 +526,18 @@ By default `saveAsTable` will create a "managed table", meaning that the locatio be cont

[GitHub] spark pull request #16424: [SPARK-19016][SQL][DOC] Document scalable partiti...

2016-12-29 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16424#discussion_r94170722 --- Diff: docs/sql-programming-guide.md --- @@ -515,7 +515,7 @@ new data. ### Saving to Persistent Tables `DataFrames` can also be saved as pers

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-29 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16389 Can we just not reset `numRunningTasks` to 0? I think it should include speculative tasks and we can add a comment about it. --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16436 @mengxr @jkbradley @MLnick @HyukjinKwon @holdenk would you be able to take a look at the changes - it looks like you have previously modified StringIndexer.scala file. --- If your project is

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16437 **[Test build #70724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70724/testReport)** for PR 16437 at commit [`722a0e2`](https://github.com/apache/spark/commit/72

[GitHub] spark pull request #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document mino...

2016-12-29 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/16434#discussion_r94165525 --- Diff: python/pyspark/ml/feature.py --- @@ -2629,6 +2629,8 @@ class ChiSqSelector(JavaEstimator, HasFeaturesCol, HasOutputCol, HasLabelCol, Ja

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16437 A related PR: https://github.com/apache/spark/pull/12915 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark issue #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functions used...

2016-12-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16437 cc @zsxwing @cloud-fan @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request #16437: [SPARK-19028] [SQL] Fixed non-thread-safe functio...

2016-12-29 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/16437 [SPARK-19028] [SQL] Fixed non-thread-safe functions used in SessionCatalog ### What changes were proposed in this pull request? Fixed non-thread-safe functions used in SessionCatalog: - r

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-12-29 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15212 Will do! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2016-12-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16233 > Note this is compatible with the views defined by older versions of Spark(before 2.2), which have empty defaultDatabase and all the relations in viewText have database part defined. We

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2016-12-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16233 > 4. Add `AnalysisContext` to enable us to still support a view created with CTE/Windows query. What is the `AnalysisContext `? --- If your project is set up for it, you can reply to th

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16436 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70723/ Test PASSed. ---

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16436 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16436 **[Test build #70723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70723/testReport)** for PR 16436 at commit [`fb9acb2`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-12-29 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15212 @mpjlu Thanks for the follow-up PR. @jkbradley Please feel free to shepherd that PR, since I'm on travel these days. Thanks. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor chang...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16434 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor chang...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16434 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70721/ Test PASSed. ---

[GitHub] spark issue #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor chang...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16434 **[Test build #70721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70721/testReport)** for PR 16434 at commit [`17a7288`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16436 **[Test build #70723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70723/testReport)** for PR 16436 at commit [`fb9acb2`](https://github.com/apache/spark/commit/fb

[GitHub] spark issue #16436: [SPARK-18698][ML][MLLIB] Adding public constructor that ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16436 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request #16436: [SPARK-18698][ML][MLLIB] Adding public constructo...

2016-12-29 Thread imatiach-msft
GitHub user imatiach-msft opened a pull request: https://github.com/apache/spark/pull/16436 [SPARK-18698][ML][MLLIB] Adding public constructor that takes uid for IndexToString ## What changes were proposed in this pull request? Based on SPARK-18698, this adds a public const

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70722/ Test FAILed. ---

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16435 **[Test build #70722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70722/testReport)** for PR 16435 at commit [`bd6a6d3`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16435 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16435 **[Test build #70722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70722/testReport)** for PR 16435 at commit [`bd6a6d3`](https://github.com/apache/spark/commit/bd

[GitHub] spark pull request #16435: [SPARK-19027][SQL] estimate size of object buffer...

2016-12-29 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/16435 [SPARK-19027][SQL] estimate size of object buffer for object hash aggregate ## What changes were proposed in this pull request? In object hash aggregate, we fall back to sort based aggreg

[GitHub] spark issue #16435: [SPARK-19027][SQL] estimate size of object buffer for ob...

2016-12-29 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16435 cc @yhuai @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-12-29 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/15212 hi @jkbradley @yanboliang , I have created a follow up PR for this PR. https://github.com/apache/spark/pull/16434 I have not added FDR test in ML Suite. The main reason is the current data set is

[GitHub] spark issue #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor chang...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16434 **[Test build #70721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70721/testReport)** for PR 16434 at commit [`17a7288`](https://github.com/apache/spark/commit/17

[GitHub] spark pull request #16434: [SPARK-17645][MLLIB][ML][FOLLOW-UP] document mino...

2016-12-29 Thread mpjlu
GitHub user mpjlu opened a pull request: https://github.com/apache/spark/pull/16434 [SPARK-17645][MLLIB][ML][FOLLOW-UP] document minor change ## What changes were proposed in this pull request? This is a follow-up pr for #15212 to address @jkbradley comments on Document change.

[GitHub] spark pull request #16371: [SPARK-18932][SQL] Support partial aggregation fo...

2016-12-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16371#discussion_r94141624 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -44,39 +44,78 @@ abstract class Collect extend

[GitHub] spark issue #16377: [SPARK-18036][ML][MLLIB] Fixing decision trees handling ...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16377 ping @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16355: [SPARK-16473][MLLIB] Fix BisectingKMeans Algorithm faili...

2016-12-29 Thread imatiach-msft
Github user imatiach-msft commented on the issue: https://github.com/apache/spark/pull/16355 @jkbradley @srowen any comments on the changes? Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16430 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70720/ Test PASSed. ---

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16430 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16430 **[Test build #70720 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70720/testReport)** for PR 16430 at commit [`d222020`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #16371: [SPARK-18932][SQL] Support partial aggregation fo...

2016-12-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16371#discussion_r94139716 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -44,39 +44,78 @@ abstract class Collect extend

[GitHub] spark issue #16422: [SPARK-17642] [SQL] support DESC EXTENDED/FORMATTED tabl...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16422 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70719/ Test PASSed. ---

[GitHub] spark issue #16422: [SPARK-17642] [SQL] support DESC EXTENDED/FORMATTED tabl...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16422 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16422: [SPARK-17642] [SQL] support DESC EXTENDED/FORMATTED tabl...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16422 **[Test build #70719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70719/testReport)** for PR 16422 at commit [`30cb1ae`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #16428: [SPARK-19018][SQL] ADD csv write charset param

2016-12-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16428 Do you mind if I ask wheather it writes the line separstor correctly as the encoding specified in the option? --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark issue #16425: [SPARK-18669][SS][DOC]Remove structured-streaming.pptx

2016-12-29 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16425 Yeah it contains the 'originals' of some graphics IIRC so we can leave it for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-12-29 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/15212 Thanks @jkbradley , I will send a follow-up PR for your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16430 **[Test build #70720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70720/testReport)** for PR 16430 at commit [`d222020`](https://github.com/apache/spark/commit/d2

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/16430 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16422: [SPARK-17642] [SQL] support DESC EXTENDED/FORMATTED tabl...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16422 **[Test build #70719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70719/testReport)** for PR 16422 at commit [`30cb1ae`](https://github.com/apache/spark/commit/30

[GitHub] spark issue #16433: [SPARK-19022][TESTS] Fix tests dependent on OS due to di...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16433 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70718/ Test PASSed. ---

[GitHub] spark issue #16433: [SPARK-19022][TESTS] Fix tests dependent on OS due to di...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16433 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16433: [SPARK-19022][TESTS] Fix tests dependent on OS due to di...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16433 **[Test build #70718 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70718/testReport)** for PR 16433 at commit [`15f821c`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16228: [SPARK-17076] [SQL] Cardinality estimation for join base...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16228 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16228: [SPARK-17076] [SQL] Cardinality estimation for join base...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16228 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70717/ Test PASSed. ---

[GitHub] spark issue #16228: [SPARK-17076] [SQL] Cardinality estimation for join base...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16228 **[Test build #70717 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70717/testReport)** for PR 16228 at commit [`df839f8`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16431: [SPARK-19020] [SQL] Cardinality estimation of aggregate ...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16431 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70714/ Test PASSed. ---

[GitHub] spark issue #16431: [SPARK-19020] [SQL] Cardinality estimation of aggregate ...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16431 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16431: [SPARK-19020] [SQL] Cardinality estimation of aggregate ...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16431 **[Test build #70714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70714/testReport)** for PR 16431 at commit [`c064595`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16371: [SPARK-18932][SQL] Support partial aggregation for colle...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16371 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16371: [SPARK-18932][SQL] Support partial aggregation for colle...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16371 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70713/ Test PASSed. ---

[GitHub] spark issue #16371: [SPARK-18932][SQL] Support partial aggregation for colle...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16371 **[Test build #70713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70713/testReport)** for PR 16371 at commit [`965a4a9`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16430 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16430 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70716/ Test FAILed. ---

[GitHub] spark issue #16430: [SPARK-17077] [SQL] Cardinality estimation for project o...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16430 **[Test build #70716 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70716/testReport)** for PR 16430 at commit [`d222020`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #16433: [SPARK-19022][TESTS] Fix tests dependent on OS due to di...

2016-12-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16433 Build started: [TESTS] `org.apache.spark.sql.streaming.StreamingQueryStatusAndProgressSuite` [![PR-16433](https://ci.appveyor.com/api/projects/status/github/spark-test/spark?branch=AE40452F-D970

[GitHub] spark issue #16433: [SPARK-19022][TESTS] Fix tests dependent on OS due to di...

2016-12-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16433 **[Test build #70718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70718/testReport)** for PR 16433 at commit [`15f821c`](https://github.com/apache/spark/commit/15

[GitHub] spark pull request #16433: [SPARK-19022][TESTS] Fix tests dependent on OS du...

2016-12-29 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16433 [SPARK-19022][TESTS] Fix tests dependent on OS due to different newline characters ## What changes were proposed in this pull request? There are two tests failing on Windows due to the

[GitHub] spark pull request #16371: [SPARK-18932][SQL] Support partial aggregation fo...

2016-12-29 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16371#discussion_r94114431 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala --- @@ -44,39 +44,78 @@ abstract class Collect ext

[GitHub] spark issue #16432: [SPARK-19021][YARN] Generailize HDFSCredentialProvider t...

2016-12-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16432 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70715/ Test PASSed. ---

<    1   2   3   >