mccheah commented on issue #16: Custom metadata in data files
URL: 
https://github.com/apache/incubator-iceberg/issues/16#issuecomment-442171391
 
 
   We're planning to use Iceberg as an ephemeral table storage format so that 
we can take advantage of Iceberg's Data Source V2 implementation to read 
Parquet files. However, we intend to customize the way files are read and 
written that is specific to our representation of data (see 
https://github.com/apache/incubator-iceberg/issues/12). In such a case we need 
multiple metadata fields that we know will only make sense in our use case and 
no one else's, really - they're specific to our data platform.
   
   There are also some examples of metadata tags in the issue description.
   
   `Map<String, String>` is effectively a JSON Blob as it is, right? It's more 
strongly typed than just `String`. I'd prefer biasing more towards strongly 
typed schemas than the more loosely typed `String`.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to