[GitHub] [hudi] n3nash commented on issue #1845: [SUPPORT] Support for Schema evolution. Facing an error

2021-06-15 Thread GitBox


n3nash commented on issue #1845:
URL: https://github.com/apache/hudi/issues/1845#issuecomment-862016359


   @nsivabalan Can you please reply above ?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [hudi] n3nash commented on issue #1845: [SUPPORT] Support for Schema evolution. Facing an error

2020-07-22 Thread GitBox


n3nash commented on issue #1845:
URL: https://github.com/apache/hudi/issues/1845#issuecomment-662269249


   @sbernauer I briefly looked at the test-case you added and I see what you 
are trying to reproduce. The issue seems to be as follows : 
   1) Generate data with schema A, pass schema A 
   2) Generate data with schema B, pass schema B 
   3) Generate data with schema A, pass schema B 
   Where schema A is smaller schema, schema B is a larger schema with 1 added 
field.
   @bvaradar Have we tested such a scenario before with the 
`AvroConversionHelper` class where we convert the RDD to DF 
with schema A, but pass schema B as the writer schema ?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org