Vinoth Govindarajan created HUDI-3290:
-----------------------------------------

             Summary: Make the .hoodie-partition-metadata as empty parquet file
                 Key: HUDI-3290
                 URL: https://issues.apache.org/jira/browse/HUDI-3290
             Project: Apache Hudi
          Issue Type: New Feature
          Components: metadata
            Reporter: Vinoth Govindarajan
            Assignee: Vinoth Govindarajan


For BigQuery and Snowflake integration, we can't able to create external tables 
when the partition folder has a non-parquet file `.hoodie-partition-metadata`.

I understand this is an important file to find the .hoodie folder from within 
the partition folder, the long term solution is to get rid of this file, but as 
a short term solution if we can convert this to an empty parquet file and add 
the necessary depth information in the footer, then it will pass the 
BigQuery/Snowflake external table validation and allow us to create an external 
parquet table on top of hudi folder structure.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to