[ https://issues.apache.org/jira/browse/HAWQ-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218392#comment-15218392 ]
Shivram Mani commented on HAWQ-178: ----------------------------------- [~hellstorm] Earlier we did support flattening complex types for Hive but decided to switch to converting complex types to TEXT By flattening out complex types, different records will end up with different number of columns and this caused too much sparse data in the HAWQ table when we flattened out lists form Hive to HAWQ columns. On the other hand the TEXT alternative still provides the flexibility of defining functions to map them to the appropriate table/views. We went with the similar approach for avro complex types too. The natural progression with JSON is to eventually support converting complex types to TEXT by default in the future. [~tzolov] thoughts ? > Add JSON plugin support in code base > ------------------------------------ > > Key: HAWQ-178 > URL: https://issues.apache.org/jira/browse/HAWQ-178 > Project: Apache HAWQ > Issue Type: New Feature > Components: PXF > Reporter: Goden Yao > Assignee: Christian Tzolov > Fix For: backlog > > Attachments: PXFJSONPluginforHAWQ2.0andPXF3.0.0.pdf, > PXFJSONPluginforHAWQ2.0andPXF3.0.0v.2.pdf, > PXFJSONPluginforHAWQ2.0andPXF3.0.0v.3.pdf > > > JSON has been a popular format used in HDFS as well as in the community, > there has been a few JSON PXF plugins developed by the community and we'd > like to see it being incorporated into the code base as an optional package. -- This message was sent by Atlassian JIRA (v6.3.4#6332)