[jira] Commented: (HIVE-365) Create Table to support multiple levels of delimiters
[ https://issues.apache.org/jira/browse/HIVE-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12877731#action_12877731 ] mangaiappan commented on HIVE-365: -- Multiple separators works with only control characters , and does not works with normal characters . CREATE TABLE nested(array_of_arrays ARRAY ARRAY INT, map_of_maps MAP STRING, MAP INT, INT ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '@''#''$''%''' Now , except for @ ,other separators are not recognized as separators. Create Table to support multiple levels of delimiters - Key: HIVE-365 URL: https://issues.apache.org/jira/browse/HIVE-365 Project: Hadoop Hive Issue Type: New Feature Reporter: Zheng Shao From HIVE-337, the SerDe layer now supports multiple-levels of delimiters, for the purpose of supporting nested map/array/struct. Array(the same as List) and struct consume a single level of separator, and Map consumes 2 levels. DDL (Create Table) needs to allow users to specify multiple levels of delimiters in order to take the advantage of this new feature. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-365) Create Table to support multiple levels of delimiters
[ https://issues.apache.org/jira/browse/HIVE-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875556#action_12875556 ] mangaiappan commented on HIVE-365: -- Can you please give the sample input file to the above table 'nested' Create Table to support multiple levels of delimiters - Key: HIVE-365 URL: https://issues.apache.org/jira/browse/HIVE-365 Project: Hadoop Hive Issue Type: New Feature Reporter: Zheng Shao From HIVE-337, the SerDe layer now supports multiple-levels of delimiters, for the purpose of supporting nested map/array/struct. Array(the same as List) and struct consume a single level of separator, and Map consumes 2 levels. DDL (Create Table) needs to allow users to specify multiple levels of delimiters in order to take the advantage of this new feature. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-365) Create Table to support multiple levels of delimiters
[
https://issues.apache.org/jira/browse/HIVE-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12875677#action_12875677
]
Arvind Prabhakar commented on HIVE-365:
---
For the table nested as defined above, a row that contains the following data:
[ [1,2,3],[10,20,30] ], { {foo:{1:1} }, {bar:{2,2} } }
would be represented as:
1 \003 2 \003 3 \002 10 \003 20 \003 30 \001 foo \003 1 \004 1 \002 \bar \003 2
\004 2
note: spaces added for readability
Create Table to support multiple levels of delimiters
-
Key: HIVE-365
URL: https://issues.apache.org/jira/browse/HIVE-365
Project: Hadoop Hive
Issue Type: New Feature
Reporter: Zheng Shao
From HIVE-337, the SerDe layer now supports multiple-levels of delimiters,
for the purpose of supporting nested map/array/struct.
Array(the same as List) and struct consume a single level of separator, and
Map consumes 2 levels.
DDL (Create Table) needs to allow users to specify multiple levels of
delimiters in order to take the advantage of this new feature.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-365) Create Table to support multiple levels of delimiters
[
https://issues.apache.org/jira/browse/HIVE-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847048#action_12847048
]
Zheng Shao commented on HIVE-365:
-
I am thinking something like:
{code}
CREATE TABLE nested(array_of_arrays ARRAY ARRAY INT, map_of_maps MAP
STRING, MAP INT, INT )
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\001' '\002' '\003' '\004' '\005';
{code}
Basically allowing multiple separators after FIELDS TERMINATED.
The top level (fields) consumes 1 level of separators. Each level of array
consumes 1 level of separators, while each level of map consumes 2.
Create Table to support multiple levels of delimiters
-
Key: HIVE-365
URL: https://issues.apache.org/jira/browse/HIVE-365
Project: Hadoop Hive
Issue Type: New Feature
Reporter: Zheng Shao
From HIVE-337, the SerDe layer now supports multiple-levels of delimiters,
for the purpose of supporting nested map/array/struct.
Array(the same as List) and struct consume a single level of separator, and
Map consumes 2 levels.
DDL (Create Table) needs to allow users to specify multiple levels of
delimiters in order to take the advantage of this new feature.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-365) Create Table to support multiple levels of delimiters
[
https://issues.apache.org/jira/browse/HIVE-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12846473#action_12846473
]
Arvind Prabhakar commented on HIVE-365:
---
Zheng - can you please give an example DDL that needs to be supported? As of
0.5.0 release of hive the following are considered valid DDL:
{quote}
{{CREATE TABLE nested_array (array_of_arrays ARRAY ARRAY INT)}}
{{CREATE TABLE nested_map (map_of_maps MAP STRING, MAP INT, MAP INT,
ARRAY INT)}}
{quote}
Create Table to support multiple levels of delimiters
-
Key: HIVE-365
URL: https://issues.apache.org/jira/browse/HIVE-365
Project: Hadoop Hive
Issue Type: New Feature
Reporter: Zheng Shao
From HIVE-337, the SerDe layer now supports multiple-levels of delimiters,
for the purpose of supporting nested map/array/struct.
Array(the same as List) and struct consume a single level of separator, and
Map consumes 2 levels.
DDL (Create Table) needs to allow users to specify multiple levels of
delimiters in order to take the advantage of this new feature.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
