emilie-wang opened a new pull request, #769:
URL: https://github.com/apache/incubator-xtable/pull/769

   
   ## What is the purpose of the pull request
   
   While converting from Delta table, the nested field's stats gets lost. 
Example:
   
   ```
   root
    |-- a: struct (nullable = true)
    |    |-- b: string (nullable = true)
    |    |-- c: integer (nullable = true)
   ```
   
   Column stats for a.b and a.c wasn't processed correctly.
   
   This Pr aims to fix it.
   
   
   ## Brief change log
   
   The pr make sure the nested field's stats is extracted.
   ## Verify this pull request
   
   This pull request is already covered by existing tests, such as 
https://github.com/emilie-wang/incubator-xtable/blob/27f6a162082a04c21755ff49184c34a975caef00/xtable-core/src/test/java/org/apache/xtable/delta/TestDeltaStatsExtractor.java#L119
   The test doesn't need change because it uses `List<InternalField> fields = 
schema.getAllFields();` instead of `List<InternalField> fields = 
schema.getAllFields();`, so that no nested fields are filtered out.
   -  Add a new nested field into the existing test.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to