Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71907/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #71907 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)**
for PR 15880 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
LGTM
The PR title is not right. BTW, we might need a release note for this PR.
This will change the behaviors.
---
If your project is set up for it, you can reply to this email and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #71907 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71907/testReport)**
for PR 15880 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71130/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #71130 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71130/testReport)**
for PR 15880 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #71130 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71130/testReport)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70860/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #70860 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70860/testReport)**
for PR 15880 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #70860 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70860/testReport)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70797/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
Just for your reference, below is the conversion charts of MS SQL Server.
It includes both implicit and explicit conversion rules.
![screenshot 2017-01-02 23 18
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #70797 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70797/testReport)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70755/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #70755 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70755/testReport)**
for PR 15880 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #70755 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70755/testReport)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user dasbipulkumar commented on the issue:
https://github.com/apache/spark/pull/15880
@gatorsmile
configuration flag would be good approach.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
The [official Hive
document](https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-AllowedImplicitConversions)
explains the implicit type casting rules.
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
In the future, more code changes might break Hive compatibility
accidentally or intentionally.
Maybe, we can introduce a configuration flag. For example, in DB2, we have
a flag like
Github user dasbipulkumar commented on the issue:
https://github.com/apache/spark/pull/15880
yes. As a Dev we can handle these things, but as Spark Sql is moving
towards more abstracted APIs, it can be painful for general users. I hope that
handing these issues can be planned in
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
I agree implicit cast is kind of evil, and for the example in SPARK-18489,
it's better to follow postgres and fail the query because we can't cast "s" to
integer. But this will break hive
Github user dasbipulkumar commented on the issue:
https://github.com/apache/spark/pull/15880
Please refer this bug
https://issues.apache.org/jira/browse/SPARK-18489
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
`BinaryComparison` is special and we have special rules for it. For UDF we
only apply the normal implicit type conversions. Have you met any problem with
UDF?
---
If your project is set up for
Github user dasbipulkumar commented on the issue:
https://github.com/apache/spark/pull/15880
@cloud-fan
Will this handle UDFs?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
to be safe, how about we retargeting this ticket to 2.2?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68667/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68667 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68667/consoleFull)**
for PR 15880 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68667 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68667/consoleFull)**
for PR 15880 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/15880
+1 on the postgres approach
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/15880
+1 on the postgres approach
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68645/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68645 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68645/consoleFull)**
for PR 15880 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
+1 on the postgres approach
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/15880
+1 on the postgres approach
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
Ok we need to make a decision here, to follow hive and give a warning
message, or to follow postgres and cast string to the type of the other side.
Personally I prefer the postgres way, I
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68645 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68645/consoleFull)**
for PR 15880 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/15880
Below contains a section of `Implicit Data Conversion` in Oracle:
https://docs.oracle.com/cd/B19306_01/server.102/b14200/sql_elements002.htm
It clearly documents the potential changes in
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/15880
Hi, @cloud-fan . What about just showing warning for that?
For Hive 1.2.1 and 2.1.0, it's `true` like the old Spark.
```sql
hive> SELECT 19157170390056973L = "19157170390056971";
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/15880
Yeah, you are totally right about that. I like this approach, the only
bothering me is that this breaks backwards compatibility.
---
If your project is set up for it, you can reply to this
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15880
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68612/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68612 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68612/consoleFull)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
We can only know if this string is castable at runtime. BTW, other
databases(like MySQL) have special implicit type conversion rules for
constants, should we follow them?
---
If your project is
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/15880
This might be a bad idea: should we follow the old casting strategy if we
cannot cast from string to atomic datatype?
---
If your project is set up for it, you can reply to this email and have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15880
**[Test build #68612 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68612/consoleFull)**
for PR 15880 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15880
cc @yhuai @gatorsmile
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
57 matches
Mail list logo