n3nash commented on issue #1845:
URL: https://github.com/apache/hudi/issues/1845#issuecomment-662269249
@sbernauer I briefly looked at the test-case you added and I see what you
are trying to reproduce. The issue seems to be as follows :
1) Generate data with schema A, pass schema A
2) Generate data with schema B, pass schema B
3) Generate data with schema A, pass schema B
Where schema A is smaller schema, schema B is a larger schema with 1 added
field.
@bvaradar Have we tested such a scenario before with the
`AvroConversionHelper` class where we convert the RDD to DF
with schema A, but pass schema B as the writer schema ?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org