[GitHub] spark pull request #16141: [MINOR][DOC] Use SparkR `TRUE` value and add defa...

2016-12-04 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16141 [MINOR][DOC] Use SparkR `TRUE` value and add default values for `StructField` in SQL Guide. ## What changes were proposed in this pull request? In `SQL Programming Guide`, this PR

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69659/ Test PASSed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69659 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69659/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15664 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69658/ Test PASSed. ---

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15664 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15664 **[Test build #69658 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69658/consoleFull)** for PR 15664 at commit

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16135 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69660/ Test PASSed. ---

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16135 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16135 **[Test build #69660 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69660/consoleFull)** for PR 16135 at commit

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15664 Yes, right! Thank you, @gatorsmile ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16139 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16139 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69661/ Test PASSed. ---

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16139 **[Test build #69661 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69661/consoleFull)** for PR 16139 at commit

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15664 This is a bug fix, right? Will review this tomorrow. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16117: [SPARK-18686][SparkR][ML] Several cleanup and imp...

2016-12-04 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/16117#discussion_r90808362 --- Diff: R/pkg/R/mllib.R --- @@ -817,44 +804,29 @@ setMethod("predict", signature(object = "LogisticRegressionModel"), # Get the summary of an

[GitHub] spark issue #16140: [SPARK-18714][SQL] Add a simple time function to SparkSe...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16140 **[Test build #69662 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69662/consoleFull)** for PR 16140 at commit

[GitHub] spark issue #16140: [SPARK-18714][SQL] Add a simple time function to SparkSe...

2016-12-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16140 cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16140: [SPARK-18714][SQL] Add a simple time function to ...

2016-12-04 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/16140 [SPARK-18714][SQL] Add a simple time function to SparkSession ## What changes were proposed in this pull request? Many Spark developers often want to test the runtime of some function in

[GitHub] spark issue #16139: [SPARK-18705][ML][DOC] Update user guide to reflect one ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16139 **[Test build #69661 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69661/consoleFull)** for PR 16139 at commit

[GitHub] spark pull request #16133: [SPARK-18702][SQL] input_file_block_start and inp...

2016-12-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16133 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16139: [SPARK-18705][ML][DOC] Update user guide to refle...

2016-12-04 Thread sethah
GitHub user sethah opened a pull request: https://github.com/apache/spark/pull/16139 [SPARK-18705][ML][DOC] Update user guide to reflect one pass solver for L1 and elastic-net ## What changes were proposed in this pull request? WeightedLeastSquares now supports L1 and

[GitHub] spark issue #16133: [SPARK-18702][SQL] input_file_block_start and input_file...

2016-12-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16133 Thanks - going to merge this in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16135 **[Test build #69660 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69660/consoleFull)** for PR 16135 at commit

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69659/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2016-12-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14638 Hi, @rxin , @srowen , @yhuai . If there is something for me to do more for this issue, please let me know. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15664 **[Test build #69658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69658/consoleFull)** for PR 15664 at commit

[GitHub] spark issue #15664: [SPARK-18123][SQL] Use db column names instead of RDD co...

2016-12-04 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15664 Thank you for review, @viirya . I'll update like that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16014 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16014 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69655/ Test PASSed. ---

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16014 **[Test build #69655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69655/consoleFull)** for PR 16014 at commit

[GitHub] spark pull request #16077: [SPARK-18643][SPARKR] SparkR hangs at session sta...

2016-12-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16014 Ah got it - I didn't notice that. BTW the way @rxin handled this for pip is a bit different in https://github.com/apache/spark/commit/37e52f8793bff306a7ae5a9aecc16f28333b70e3 Might be

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16077 LGTM. Merging this to master, branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69656/ Test FAILed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69656 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69656/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16059 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69657/ Test PASSed. ---

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16059 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16059 **[Test build #69657 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69657/consoleFull)** for PR 16059 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 @cloud-fan this is related to this PR in the 2.0.x https://github.com/apache/spark/pull/12770 --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15998 @cloud-fan That's unfortunate if it's going to block this PR. How do we proceed? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15819 ok @merlintang can you find out which PR adds these codes to 2.0? Then other people can know what we are backporting in this PR --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15998 @mallman ah it's a mistake, check https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala#L228 , we need to move

[GitHub] spark pull request #15664: [SPARK-18123][SQL] Use db column names instead of...

2016-12-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15664#discussion_r90799712 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -112,7 +112,25 @@ object JdbcUtils extends Logging

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15994 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69653/ Test PASSed. ---

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15994 **[Test build #69653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69653/consoleFull)** for PR 15994 at commit

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16059 **[Test build #69657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69657/consoleFull)** for PR 16059 at commit

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/16059 @yanboliang Updated. Thanks for reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15987: [SPARK-17732][SQL] ALTER TABLE DROP PARTITION sho...

2016-12-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15987#discussion_r90797605 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -661,6 +661,36 @@ class Analyzer( // rule:

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16077 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16077 **[Test build #69654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69654/consoleFull)** for PR 16077 at commit

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16077 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69654/ Test PASSed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69656/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 Ok. On Sun, Dec 4, 2016 at 6:25 PM, Reynold Xin wrote: > We have stopped making new releases for 1.5 so it makes no sense to > backport. >

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15819 We have stopped making new releases for 1.5 so it makes no sense to backport. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 this bug is related to 1.5.x as well as 1.6.x. please backport to 1.5.x as well. On Sun, Dec 4, 2016 at 6:20 PM, Reynold Xin wrote: > If it is

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15819 If it is a bug fix and low risk, sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16030 okay, I'll do --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16014 **[Test build #69655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69655/consoleFull)** for PR 16014 at commit

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69652/ Test PASSed. ---

[GitHub] spark pull request #16133: [SPARK-18702][SQL] input_file_block_start and inp...

2016-12-04 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/16133#discussion_r90794591 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ColumnExpressionSuite.scala --- @@ -533,31 +533,54 @@ class ColumnExpressionSuite extends QueryTest

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15998 **[Test build #69652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69652/consoleFull)** for PR 15998 at commit

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16014 As for release-build.sh - I had the change in there but I've changed it to make it more clear. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16077 **[Test build #69654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69654/consoleFull)** for PR 16077 at commit

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-12-04 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16014 @shivaram yes, that is correct and what I've found [here](https://github.com/apache/spark/pull/16014#issuecomment-263505953) Basically I don't think it is the R source package process

[GitHub] spark issue #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss up orig...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15994 **[Test build #69653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69653/consoleFull)** for PR 15994 at commit

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16077 Right, I was just reviewing possible code paths for this in the last few days and I'm pretty confident that this change will not run install.spark in cluster modes (which would have Spark/JVM

[GitHub] spark pull request #16014: [SPARK-18590][SPARKR] build R source package when...

2016-12-04 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16014#discussion_r90792118 --- Diff: R/check-cran.sh --- @@ -82,4 +83,20 @@ else # This will run tests and/or build vignettes, and require SPARK_HOME

[GitHub] spark pull request #16014: [SPARK-18590][SPARKR] build R source package when...

2016-12-04 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16014#discussion_r90790181 --- Diff: dev/make-distribution.sh --- @@ -208,11 +212,24 @@ cp -r "$SPARK_HOME/data" "$DISTDIR" # Make pip package if [ "$MAKE_PIP" == "true" ];

[GitHub] spark pull request #16014: [SPARK-18590][SPARKR] build R source package when...

2016-12-04 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16014#discussion_r90792416 --- Diff: R/check-cran.sh --- @@ -82,4 +83,20 @@ else # This will run tests and/or build vignettes, and require SPARK_HOME

[GitHub] spark pull request #16014: [SPARK-18590][SPARKR] build R source package when...

2016-12-04 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16014#discussion_r90792485 --- Diff: dev/make-distribution.sh --- @@ -71,6 +72,9 @@ while (( "$#" )); do --pip) MAKE_PIP=true ;; +--r) +

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15998 > @mallman do you know which tests fail the partition spec checking? It looks to me that before we call partition related API in SessionCatalog, the partition column names should be normalized

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-04 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16030 @maropu There seems to be a merge conflict. Should be pretty trivial to resolve. Mind taking a look when you can? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15998 @mallman do you know which tests fail the partition spec checking? It looks to me that before we call partition related API in `SessionCatalog`, the partition column names should be normalized

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15819 OK so the problem becomes, do we want to backport this to 1.6? cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69651/ Test FAILed. ---

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69651/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69650/ Test FAILed. ---

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69650 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69650/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69649/ Test PASSed. ---

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69649/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15998 **[Test build #69652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69652/consoleFull)** for PR 15998 at commit

[GitHub] spark issue #15998: [SPARK-18572][SQL] Add a method `listPartitionNames` to ...

2016-12-04 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15998 I've modified the behavior of the partition spec checking methods in `SessionCatalog` to test for case-sensitive analysis. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-12-04 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16077 Just to clarify this limits the auto-install feature to SparkR running on an interactive shell -- Is that right ? I think thats mostly fine as its the use-case we were targeting but it might good

[GitHub] spark issue #16094: [SPARK-18541][Python]Add metadata parameter to pyspark.s...

2016-12-04 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/16094 Lets see if maybe @marmbrus or @davies has some time to look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with ...

2016-12-04 Thread anabranch
Github user anabranch commented on a diff in the pull request: https://github.com/apache/spark/pull/16138#discussion_r90788929 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DateFunctionsSuite.scala --- @@ -351,34 +351,81 @@ class DateFunctionsSuite extends QueryTest with

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-04 Thread merlintang
Github user merlintang commented on the issue: https://github.com/apache/spark/pull/15819 it is updated. On Sun, Dec 4, 2016 at 11:23 AM, Xiao Li wrote: > @merlintang Could you please add > [Branch-1.6] in

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69651/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69650/consoleFull)** for PR 16138 at commit

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69648/ Test FAILed. ---

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16138 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69648/consoleFull)** for PR 16138 at commit

[GitHub] spark pull request #15998: [SPARK-18572][SQL] Add a method `listPartitionNam...

2016-12-04 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15998#discussion_r90788135 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -519,6 +519,26 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #16138: [WIP][SPARK-16609] Add to_date/to_timestamp with format ...

2016-12-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16138 **[Test build #69649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69649/consoleFull)** for PR 16138 at commit

  1   2   3   >