[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71907/ Test FAILed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 LGTM The PR title is not right. BTW, we might need a release note for this PR. This will change the behaviors. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71130/ Test PASSed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71130/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #71130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71130/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70860/ Test PASSed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #70860 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70860/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #70860 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70860/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70797/ Test FAILed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 Just for your reference, below is the conversion charts of MS SQL Server. It includes both implicit and explicit conversion rules. ![screenshot 2017-01-02 23 18

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #70797 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70797/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2017-01-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-12-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70755/ Test PASSed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-12-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-12-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #70755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70755/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-12-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #70755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70755/testReport)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-12-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-20 Thread dasbipulkumar
Github user dasbipulkumar commented on the issue: https://github.com/apache/spark/pull/15880 @gatorsmile configuration flag would be good approach. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 The [official Hive document](https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-AllowedImplicitConversions) explains the implicit type casting rules.

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 In the future, more code changes might break Hive compatibility accidentally or intentionally. Maybe, we can introduce a configuration flag. For example, in DB2, we have a flag like

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-17 Thread dasbipulkumar
Github user dasbipulkumar commented on the issue: https://github.com/apache/spark/pull/15880 yes. As a Dev we can handle these things, but as Spark Sql is moving towards more abstracted APIs, it can be painful for general users. I hope that handing these issues can be planned in

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 I agree implicit cast is kind of evil, and for the example in SPARK-18489, it's better to follow postgres and fail the query because we can't cast "s" to integer. But this will break hive

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-17 Thread dasbipulkumar
Github user dasbipulkumar commented on the issue: https://github.com/apache/spark/pull/15880 Please refer this bug https://issues.apache.org/jira/browse/SPARK-18489 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 `BinaryComparison` is special and we have special rules for it. For UDF we only apply the normal implicit type conversions. Have you met any problem with UDF? --- If your project is set up for

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-17 Thread dasbipulkumar
Github user dasbipulkumar commented on the issue: https://github.com/apache/spark/pull/15880 @cloud-fan Will this handle UDFs? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 to be safe, how about we retargeting this ticket to 2.2? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68667/ Test PASSed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68667 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68667/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68667 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68667/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-15 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15880 +1 on the postgres approach --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15880 +1 on the postgres approach --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68645/ Test FAILed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68645/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 +1 on the postgres approach --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15880 +1 on the postgres approach --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 Ok we need to make a decision here, to follow hive and give a warning message, or to follow postgres and cast string to the type of the other side. Personally I prefer the postgres way, I

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68645/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15880 Below contains a section of `Implicit Data Conversion` in Oracle: https://docs.oracle.com/cd/B19306_01/server.102/b14200/sql_elements002.htm It clearly documents the potential changes in

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15880 Hi, @cloud-fan . What about just showing warning for that? For Hive 1.2.1 and 2.1.0, it's `true` like the old Spark. ```sql hive> SELECT 19157170390056973L = "19157170390056971";

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15880 Yeah, you are totally right about that. I like this approach, the only bothering me is that this breaks backwards compatibility. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15880 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68612/ Test FAILed. ---

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68612/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 We can only know if this string is castable at runtime. BTW, other databases(like MySQL) have special implicit type conversion rules for constants, should we follow them? --- If your project is

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15880 This might be a bad idea: should we follow the old casting strategy if we cannot cast from string to atomic datatype? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15880 **[Test build #68612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68612/consoleFull)** for PR 15880 at commit

[GitHub] spark issue #15880: [SPARK-17913][SQL] compare long and string type column m...

2016-11-14 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15880 cc @yhuai @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes