[
https://issues.apache.org/jira/browse/HAWQ-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218392#comment-15218392
]
Shivram Mani commented on HAWQ-178:
-----------------------------------
[~hellstorm] Earlier we did support flattening complex types for Hive but
decided to switch to converting complex types to TEXT
By flattening out complex types, different records will end up with different
number of columns and this caused too much sparse data in the HAWQ table when
we flattened out lists form Hive to HAWQ columns. On the other hand the TEXT
alternative still provides the flexibility of defining functions to map them to
the appropriate table/views. We went with the similar approach for avro complex
types too.
The natural progression with JSON is to eventually support converting complex
types to TEXT by default in the future.
[~tzolov] thoughts ?
> Add JSON plugin support in code base
> ------------------------------------
>
> Key: HAWQ-178
> URL: https://issues.apache.org/jira/browse/HAWQ-178
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: PXF
> Reporter: Goden Yao
> Assignee: Christian Tzolov
> Fix For: backlog
>
> Attachments: PXFJSONPluginforHAWQ2.0andPXF3.0.0.pdf,
> PXFJSONPluginforHAWQ2.0andPXF3.0.0v.2.pdf,
> PXFJSONPluginforHAWQ2.0andPXF3.0.0v.3.pdf
>
>
> JSON has been a popular format used in HDFS as well as in the community,
> there has been a few JSON PXF plugins developed by the community and we'd
> like to see it being incorporated into the code base as an optional package.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
