[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061858 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalogSuite.scala --- @@ -465,6 +466,48 @@ class SessionCatalogSuite

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061656 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -125,11 +132,16 @@ private[hive] class HiveMetastoreCatalog

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061267 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -767,7 +857,45 @@ class Analyzer( } }

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061685 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -845,6 +846,7 @@ private[hive] class HiveClientImpl(

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95063136 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewBackwardCompatibilitySuite.scala --- @@ -0,0 +1,113 @@ +/* + * Licen

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95063718 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewBackwardCompatibilitySuite.scala --- @@ -0,0 +1,113 @@ +/* + * Licen

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95063071 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewBackwardCompatibilitySuite.scala --- @@ -0,0 +1,113 @@ +/* + * Licen

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061229 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -767,7 +857,45 @@ class Analyzer( } }

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061276 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -767,7 +857,45 @@ class Analyzer( } }

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95060659 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -510,32 +539,93 @@ class Analyzer( * Replaces

[GitHub] spark pull request #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16233#discussion_r95061636 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2476,4 +2476,17 @@ class SQLQuerySuite extends QueryTest with SharedSQ

[GitHub] spark issue #16491: [SPARK-19110][ML][MLLIB]:DistributedLDAModel returns dif...

2017-01-07 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16491 Yikes, thanks for fixing this! LGTM Merging with master I'll also try to merge it with branch-2.1, branch-2.0, branch-1.6 but will say if I run into issues. --- If your project is set

[GitHub] spark issue #16498: SPARK-9487][Tests] Begin the work of robustifying unit t...

2017-01-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16498 How does this relate to https://github.com/apache/spark/pull/15848 ? As I understand you already hit problems and were not able to debug them. What's different here? I was going to close the

[GitHub] spark issue #16498: SPARK-9487][Tests] Begin the work of robustifying unit t...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16498 **[Test build #71021 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71021/testReport)** for PR 16498 at commit [`b338ca9`](https://github.com/apache/spark/commit/b3

[GitHub] spark issue #16497: [SPARK-19118] [SQL] Percentile support for frequency dis...

2017-01-07 Thread tanejagagan
Github user tanejagagan commented on the issue: https://github.com/apache/spark/pull/16497 @hvanhovell Can you please review the changes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request #16498: SPARK-9487][Tests] Begin the work of robustifying...

2017-01-07 Thread skanjila
GitHub user skanjila opened a pull request: https://github.com/apache/spark/pull/16498 SPARK-9487][Tests] Begin the work of robustifying unit tests , start with ContextCleanerSuite …tests ## What changes were proposed in this pull request? This is a work in progress p

[GitHub] spark issue #16497: [SPARK-19118] [SQL] Percentile support for frequency dis...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16497 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16497: [SPARK-19118] [SQL] Percentile support for freque...

2017-01-07 Thread tanejagagan
GitHub user tanejagagan opened a pull request: https://github.com/apache/spark/pull/16497 [SPARK-19118] [SQL] Percentile support for frequency distribution table ## What changes were proposed in this pull request? I have a frequency distribution table with following entries

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15770 **[Test build #71020 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71020/testReport)** for PR 15770 at commit [`754112f`](https://github.com/apache/spark/commit/75

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16496 **[Test build #71019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71019/testReport)** for PR 16496 at commit [`943ebb7`](https://github.com/apache/spark/commit/94

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15505 It looks like you've added multi-threading for task serialization here, which I'm hesitant about for reasons @squito discussed in the JIRA (namely, I think reducing the size of the data serial

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16400 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71018/ Test PASSed. ---

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16400 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16400 **[Test build #71018 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71018/testReport)** for PR 16400 at commit [`e60ec43`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71017/ Test PASSed. ---

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15505 **[Test build #71017 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71017/testReport)** for PR 15505 at commit [`ccf3830`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16496 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16496 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71016/ Test PASSed. ---

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16496 **[Test build #71016 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71016/testReport)** for PR 16496 at commit [`b8d97f7`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16400 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16400 **[Test build #71018 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71018/testReport)** for PR 16400 at commit [`e60ec43`](https://github.com/apache/spark/commit/e6

[GitHub] spark issue #16400: [SPARK-18941][SQL][DOC] Add a new behavior document on `...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16400 Thank you, @gatorsmile . I updated the commit and description of this PR. You can see the new image from generated doc. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request #16400: [SPARK-18941][SQL][DOC] Add a new behavior docume...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16400#discussion_r95061882 --- Diff: docs/sql-programming-guide.md --- @@ -1362,6 +1362,13 @@ options. - Dataset and DataFrame API `explode` has been deprecated, alternative

[GitHub] spark pull request #16400: [SPARK-18941][SQL][DOC] Add a new behavior docume...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/16400#discussion_r95061877 --- Diff: docs/sql-programming-guide.md --- @@ -1362,6 +1362,13 @@ options. - Dataset and DataFrame API `explode` has been deprecated, alternative

[GitHub] spark issue #16493: [SPARK-19093][SQL] Cached tables are not used in Subquer...

2017-01-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16493 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71015/ Test PASSed. ---

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16487: [SPARK-19107][SQL] support creating hive table wi...

2017-01-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16487#discussion_r95061418 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -385,6 +380,8 @@ final class DataFrameWriter[T] private[sql](ds: Datas

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #71015 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71015/testReport)** for PR 16451 at commit [`f045d77`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #16487: [SPARK-19107][SQL] support creating hive table wi...

2017-01-07 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16487#discussion_r95061397 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1289,4 +1290,66 @@ class HiveDDLSuite }

[GitHub] spark pull request #16479: [SPARK-19085][SQL] cleanup OutputWriterFactory an...

2017-01-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16479 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16479: [SPARK-19085][SQL] cleanup OutputWriterFactory and Outpu...

2017-01-07 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16479 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16443: [SPARK-19042] spark executor can't download the jars whe...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16443 **[Test build #3523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3523/testReport)** for PR 16443 at commit [`aba53d9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16440: [SPARK-18857][SQL] Don't use `Iterator.duplicate` for `i...

2017-01-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16440 Thank you for approving, @srowen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060664 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -340,3 +341,91 @@ object CaseKeyWhen {

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060633 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -340,3 +341,91 @@ object CaseKeyWhen {

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060564 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class ConditionalE

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71012/ Test PASSed. ---

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15505 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060448 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class ConditionalE

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060436 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class ConditionalE

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15505 **[Test build #71012 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71012/testReport)** for PR 15505 at commit [`cd531d2`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060369 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class ConditionalE

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-01-07 Thread gczsjdy
Github user gczsjdy commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r95060307 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ConditionalExpressionSuite.scala --- @@ -137,4 +139,48 @@ class ConditionalE

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15413 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71014/ Test PASSed. ---

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15413 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15413 **[Test build #71014 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71014/testReport)** for PR 15413 at commit [`fa5b1ac`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15505 **[Test build #71017 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71017/testReport)** for PR 15505 at commit [`ccf3830`](https://github.com/apache/spark/commit/cc

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16496 **[Test build #71016 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71016/testReport)** for PR 16496 at commit [`b8d97f7`](https://github.com/apache/spark/commit/b8

[GitHub] spark issue #16496: [SPARK-16101][SQL] Refactoring CSV write path to be cons...

2017-01-07 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16496 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16496: [SPARK-16101][SQL] Refactoring CSV write path to ...

2017-01-07 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/16496 [SPARK-16101][SQL] Refactoring CSV write path to be consistent with JSON data source ## What changes were proposed in this pull request? This PR refactors CSV write path to be consiste

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16233 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71011/ Test FAILed. ---

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16233 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16233 **[Test build #71011 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71011/testReport)** for PR 16233 at commit [`5fbf1d7`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #16488: [MINOR] Bump R version to 2.2.0.

2017-01-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16488: [MINOR] Bump R version to 2.2.0.

2017-01-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16488 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R in...

2017-01-07 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16312#discussion_r95059202 --- Diff: R/pkg/R/mllib_utils.R --- @@ -80,9 +81,9 @@ predict_internal <- function(object, newData) { #' model <- read.ml(path) #' } #' @not

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16312 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16312 **[Test build #71013 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71013/testReport)** for PR 16312 at commit [`c81db86`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16312 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71013/ Test PASSed. ---

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Build started: [TESTS] `org.apache.spark.streaming.kafka010.DirectKafkaStreamSuite` [![PR-16451](https://ci.appveyor.com/api/projects/status/github/spark-test/spark?branch=B6F011A1-2E0F-4A58-AAA

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #71015 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71015/testReport)** for PR 16451 at commit [`f045d77`](https://github.com/apache/spark/commit/f0

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 Ah, thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2017-01-07 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r95058896 --- Diff: mllib/src/test/scala/org/apache/spark/ml/clustering/GaussianMixtureSuite.scala --- @@ -126,9 +143,104 @@ class GaussianMixtureSuite extends Spa

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15413 **[Test build #71014 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71014/testReport)** for PR 15413 at commit [`fa5b1ac`](https://github.com/apache/spark/commit/fa

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16451 Yeah, that's great. That narrows down the fix a bit. I bet there are other places in tests where we could use the same logic, to only ignore the error on Windows, but unless you know of obvious pl

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058504 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket connection. Bes

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058826 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala --- @@ -235,18 +236,97 @@ class InputStreamsSuite extends TestSuiteBase

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058534 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket connection. Bes

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058852 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -196,29 +191,29 @@ class FileInputDStream[K, V, F <: NewI

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058662 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket connection. Bes

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058521 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket connection. Bes

[GitHub] spark pull request #14731: [SPARK-17159] [streaming]: optimise check for new...

2017-01-07 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14731#discussion_r95058508 --- Diff: docs/streaming-programming-guide.md --- @@ -630,35 +630,106 @@ which creates a DStream from text data received over a TCP socket connection. Bes

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16451 I made a new function just simply because it repeats the same logics. Either way is fine with me. So.. do you mean something like the one as below? ```scala try { Util

[GitHub] spark issue #16312: [SPARK-18862][SPARKR][ML] Split SparkR mllib.R into mult...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16312 **[Test build #71013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71013/testReport)** for PR 16312 at commit [`c81db86`](https://github.com/apache/spark/commit/c8

[GitHub] spark issue #16443: [SPARK-19042] spark executor can't download the jars whe...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16443 **[Test build #3523 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3523/testReport)** for PR 16443 at commit [`aba53d9`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16443: [SPARK-19042] spark executor can't download the jars whe...

2017-01-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16443 @hustfxj please fix the description --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16490: [SPARK-19106][DOCS] Styling for the configuration docs i...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16490 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16490: [SPARK-19106][DOCS] Styling for the configuration docs i...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16490 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71010/ Test PASSed. ---

[GitHub] spark issue #16490: [SPARK-19106][DOCS] Styling for the configuration docs i...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16490 **[Test build #71010 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71010/testReport)** for PR 16490 at commit [`98b721e`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16443: [SPARK-19042] spark executor can't download the jars whe...

2017-01-07 Thread hustfxj
Github user hustfxj commented on the issue: https://github.com/apache/spark/pull/16443 @vanzin @srowen @dongjoon-hyun can you review again ? and help me review [SPARK-18959] and [SPARK-19052], thank you very much. --- If your project is set up for it, you can reply to this email an

[GitHub] spark issue #15505: [WIP][SPARK-18890][CORE] Multithreading serialization ta...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15505 **[Test build #71012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71012/testReport)** for PR 15505 at commit [`cd531d2`](https://github.com/apache/spark/commit/cd

[GitHub] spark issue #16233: [SPARK-18801][SQL] Support resolve a nested view

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16233 **[Test build #71011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71011/testReport)** for PR 16233 at commit [`5fbf1d7`](https://github.com/apache/spark/commit/5f

[GitHub] spark pull request #13771: [SPARK-13748][PYSPARK][DOC] Add the description f...

2017-01-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13771 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13771: [SPARK-13748][PYSPARK][DOC] Add the description for expl...

2017-01-07 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13771 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #16490: [SPARK-19106][DOCS] Styling for the configuration docs i...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16490 **[Test build #71010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71010/testReport)** for PR 16490 at commit [`98b721e`](https://github.com/apache/spark/commit/98

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71009/ Test FAILed. ---

[GitHub] spark issue #16451: [SPARK-18922][SQL][CORE][STREAMING][TESTS] Fix all ident...

2017-01-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16451 **[Test build #71009 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71009/testReport)** for PR 16451 at commit [`4e0b166`](https://github.com/apache/spark/commit/4

<    1   2   3   >