[
https://issues.apache.org/jira/browse/HIVE-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659431#comment-13659431
]
Harsh J commented on HIVE-4571:
-------------------------------
A sample change would be:
{code}
diff --git
a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
index 0036a8e..252ea6b 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
@@ -211,7 +211,7 @@ public class LazySimpleSerDe implements SerDe {
// Read the separators: We use 8 levels of separators by default, but we
// should change this when we allow users to specify more than 10 levels
// of separators through DDL.
- serdeParams.separators = new byte[8];
+ serdeParams.separators = new byte[32];
serdeParams.separators[0] = getByte(tbl.getProperty(Constants.FIELD_DELIM,
tbl.getProperty(Constants.SERIALIZATION_FORMAT)),
DefaultSeparators[0]);
serdeParams.separators[1] = getByte(tbl
{code}
> Reinvestigate HIVE-337 induced limit on number of separator characters in
> LazySerDe
> -----------------------------------------------------------------------------------
>
> Key: HIVE-4571
> URL: https://issues.apache.org/jira/browse/HIVE-4571
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
> Affects Versions: 0.10.0
> Reporter: Harsh J
> Priority: Minor
>
> HIVE-337 added support for complex data structures and also oddly added in a
> limit of the # of separator characters required to make that happen.
> When using an Avro-based table that has more than 8-10 levels of nesting in
> records, this limit gets hit and such tables can't be queried.
> We either need to remove such a limit or raise it to a high-enough value to
> support such nested data structures.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
