[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-25 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15566 Cool, I'll rebase https://github.com/apache/spark/pull/15515 and see if we can completely fix mixed case datasource tables. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67485/ Test PASSed. ---

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67485 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67485/consoleFull)** for PR 15566 at commit [`71ded51`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67485/consoleFull)** for PR 15566 at commit [`71ded51`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67439/ Test PASSed. ---

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67439 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67439/consoleFull)** for PR 15566 at commit [`d4fbeb2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67439 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67439/consoleFull)** for PR 15566 at commit [`d4fbeb2`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67389/ Test FAILed. ---

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67389/consoleFull)** for PR 15566 at commit [`3d6f418`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67389/consoleFull)** for PR 15566 at commit [`3d6f418`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 I have changed it to `This PR makes partition spec case preserving at parser`, sorry for the confusion. Previously we were lazy and alway lower case the column names in partition spec. In

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-21 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15566 > This PR makes partition spec case preserving Sorry if there has already been a discussion on this. Why would any user want this ? Its great that the engine can preserve cases but its j

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67340/consoleFull)** for PR 15566 at commit [`3d6f418`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 Sorry I was wrong. The root cause of SPARK-17990 is that, when we write data for a hive table, we ignore the truth that hive table is not case-preserving, and create the partition directory with t

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 Actually SPARK-17990 can be fixed in this PR with a little more work. Let me do it now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15566 I went through the script I wrote for https://issues.apache.org/jira/browse/SPARK-17990. At the point where I ran ``` (0 to 9).foreach { p => sql(s"alter table mixed_case_partitioning ad

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15566 cc @mallman --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67254/ Test PASSed. ---

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67254/consoleFull)** for PR 15566 at commit [`82c9f86`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15566 **[Test build #67254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67254/consoleFull)** for PR 15566 at commit [`82c9f86`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #15566: [SPARK-18026][SQL] should not always lowercase partition...

2016-10-20 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15566 cc @yhuai @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,