[
https://issues.apache.org/jira/browse/PARQUET-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Julien Le Dem updated PARQUET-103:
----------------------------------
Description:
It is tricky to support in parquet because struct fields are stored in the
definition levels of the fields they contain.
So if there is no content, they can not be stored.
Here is a proposed solution to support this in Parquet:
https://github.com/apache/incubator-parquet-mr/pull/65
Basically, I'm adding an artificial optional field in the struct that will be
always null but will store whether the struct that contains it is defined or
not.
> Support empty structs in Thrift
> -------------------------------
>
> Key: PARQUET-103
> URL: https://issues.apache.org/jira/browse/PARQUET-103
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Reporter: Julien Le Dem
> Assignee: Julien Le Dem
>
> It is tricky to support in parquet because struct fields are stored in the
> definition levels of the fields they contain.
> So if there is no content, they can not be stored.
> Here is a proposed solution to support this in Parquet:
> https://github.com/apache/incubator-parquet-mr/pull/65
> Basically, I'm adding an artificial optional field in the struct that will be
> always null but will store whether the struct that contains it is defined or
> not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
