[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-11-05 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 Because it is a design of `DataFrame` and join results could have duplicate column names. Anyway, we couldn't change this behaviour in minor releases. --- --

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-11-05 Thread sr11231
Github user sr11231 commented on the issue: https://github.com/apache/spark/pull/17758 Why it's ok to have duplicate columns when you read from RDD/DS and not when you read directly from file? Maybe it's should be configurable option? When you have duplicate columns, how can you de

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-11-05 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 yea, I think that is an expected behaviour, actually, some operations of `DataFrame/Dataset` accepts the duplication. e.g., ``` scala> Seq((1, 2)).toDF("a", "a").show +---+---+ | a|

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-11-05 Thread sr11231
Github user sr11231 commented on the issue: https://github.com/apache/spark/pull/17758 Still when you load the json file through Dataset[String] by doing `spark.read.json(spark.read.textFile("json.file")`, Spark does not trow any error and you get DataFrame with duplicate columns. Is

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-10 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 ok, I'll file a ticket first. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17758 We can create a ticket first and discuss there. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-10 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 @cloud-fan Thanks! BTW, we better handle other duplication (e.g., local temporary tables)?; ``` scala> Seq((1, 1)).toDF("a", "a").createOrReplaceTempView("t") scala> sql("SELECT * FROM t")

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17758 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17758 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79323/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79323/testReport)** for PR 17758 at commit [`5ed2c0d`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79320/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79320/testReport)** for PR 17758 at commit [`8cbfbd0`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79323/testReport)** for PR 17758 at commit [`5ed2c0d`](https://github.com/apache/spark/commit/5e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-07 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79320/testReport)** for PR 17758 at commit [`8cbfbd0`](https://github.com/apache/spark/commit/8c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79284/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79284/testReport)** for PR 17758 at commit [`5c29a75`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79284/testReport)** for PR 17758 at commit [`5c29a75`](https://github.com/apache/spark/commit/5c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-05 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 @cloud-fan The latest fix satisfies your intention? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79215/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79215/testReport)** for PR 17758 at commit [`6b9aceb`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79215/testReport)** for PR 17758 at commit [`6b9aceb`](https://github.com/apache/spark/commit/6b

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79170/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79170/testReport)** for PR 17758 at commit [`e5f582d`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79170/testReport)** for PR 17758 at commit [`e5f582d`](https://github.com/apache/spark/commit/e5

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79158/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79158/testReport)** for PR 17758 at commit [`a3cd434`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79157/testReport)** for PR 17758 at commit [`e31a318`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79157/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79158/testReport)** for PR 17758 at commit [`a3cd434`](https://github.com/apache/spark/commit/a3

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79157/testReport)** for PR 17758 at commit [`e31a318`](https://github.com/apache/spark/commit/e3

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79154/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79154 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79154/testReport)** for PR 17758 at commit [`35626b4`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79154/testReport)** for PR 17758 at commit [`35626b4`](https://github.com/apache/spark/commit/35

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79148/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79148 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79148/testReport)** for PR 17758 at commit [`d456600`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79149/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79149 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79149/testReport)** for PR 17758 at commit [`8df8909`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79149 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79149/testReport)** for PR 17758 at commit [`8df8909`](https://github.com/apache/spark/commit/8d

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-04 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79148 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79148/testReport)** for PR 17758 at commit [`d456600`](https://github.com/apache/spark/commit/d4

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79096 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79096/testReport)** for PR 17758 at commit [`dbb8cd9`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79096/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 Updated policy: The check for the SQL(DDL) case: - This check should be done in `RunnableCommand.run`. The check for the datasource case: - The check for a user-defined data

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79096 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79096/testReport)** for PR 17758 at commit [`dbb8cd9`](https://github.com/apache/spark/commit/db

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79095/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79095 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79095/testReport)** for PR 17758 at commit [`dfc0d2d`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79095 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79095/testReport)** for PR 17758 at commit [`dfc0d2d`](https://github.com/apache/spark/commit/df

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79094/testReport)** for PR 17758 at commit [`6309174`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79094/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-07-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #79094 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79094/testReport)** for PR 17758 at commit [`6309174`](https://github.com/apache/spark/commit/63

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78274/testReport)** for PR 17758 at commit [`f9c65cc`](https://github.com/apache/spark/commit/f9

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78267/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78267/testReport)** for PR 17758 at commit [`c0fa505`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 yea, I've already found the cause; to fix the issue, it's okay to check name duplication for partition columns in `getOrInferFileFormatSchema` as @gatorsmile suggested (https://github.com/apache/spa

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17758 I think we should figure out https://issues.apache.org/jira/browse/SPARK-21144 first. It doesn't make sense to have duplicated columns between partition columns and data columns. --- If your pr

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78267/testReport)** for PR 17758 at commit [`c0fa505`](https://github.com/apache/spark/commit/c0

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-18 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 ok, I'll recheck. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-18 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17758 shall we check duplicated columns in write path? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-17 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17758 LGTM except one comment --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78199/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78199/testReport)** for PR 17758 at commit [`ce71163`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78199/testReport)** for PR 17758 at commit [`ce71163`](https://github.com/apache/spark/commit/ce

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78179/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78179 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78179/testReport)** for PR 17758 at commit [`d94f3d3`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78179/testReport)** for PR 17758 at commit [`d94f3d3`](https://github.com/apache/spark/commit/d9

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78177/testReport)** for PR 17758 at commit [`8cdc192`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78177/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78177/testReport)** for PR 17758 at commit [`8cdc192`](https://github.com/apache/spark/commit/8c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78176/testReport)** for PR 17758 at commit [`8cdc192`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78176/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78176/testReport)** for PR 17758 at commit [`8cdc192`](https://github.com/apache/spark/commit/8c

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78174/testReport)** for PR 17758 at commit [`a71fe8e`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78174/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78174/testReport)** for PR 17758 at commit [`a71fe8e`](https://github.com/apache/spark/commit/a7

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-16 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 No. This pr does not target the change and it is to make error messages more explicit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17758 Any behavior change is added by this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-15 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 @wzhfy Applied. Could u check again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78142/ Test PASSed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-06-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17758 **[Test build #78142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78142/testReport)** for PR 17758 at commit [`44f3d35`](https://github.com/apache/spark/commit/4

  1   2   >