[ https://issues.apache.org/jira/browse/HIVE-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615066#comment-14615066 ]
Aihua Xu commented on HIVE-11129: --------------------------------- That should be the case. While seems like the warning may be too restrict since converting between UTF-8, UTF-16 and UTF-32 should cause no loss. let me handle that case. > Issue a warning when copied from UTF-8 to ISO 8859-1 > ---------------------------------------------------- > > Key: HIVE-11129 > URL: https://issues.apache.org/jira/browse/HIVE-11129 > Project: Hive > Issue Type: Bug > Components: File Formats > Reporter: Aihua Xu > Assignee: Aihua Xu > Fix For: 2.0.0 > > Attachments: HIVE-11129.patch > > > Copying data from a table using UTF-8 encoding to one using ISO 8859-1 > encoding causes data corruption without warning. > {noformat} > CREATE TABLE person_utf8 (name STRING) > ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' > WITH SERDEPROPERTIES ('serialization.encoding'='UTF8'); > {noformat} > Put the following data in the table: > Müller,Thomas > Jørgensen,Jørgen > Vega,Andrés > 中村,浩人 > אביה,נועם > {noformat} > CREATE TABLE person_2 ROW FORMAT SERDE > 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' > WITH SERDEPROPERTIES ('serialization.encoding'='ISO8859_1') > AS select * from person_utf8; > {noformat} > expected to get mangled data but we should give a warning. -- This message was sent by Atlassian JIRA (v6.3.4#6332)