n3nash commented on issue #1845: URL: https://github.com/apache/hudi/issues/1845#issuecomment-662269249
@sbernauer I briefly looked at the test-case you added and I see what you are trying to reproduce. The issue seems to be as follows : 1) Generate data with schema A, pass schema A <works fine> 2) Generate data with schema B, pass schema B <works fine> 3) Generate data with schema A, pass schema B <fails in `AvroConversionHelper`> Where schema A is smaller schema, schema B is a larger schema with 1 added field. @bvaradar Have we tested such a scenario before with the `AvroConversionHelper` class where we convert the RDD<GenericRecord> to DF<Row> with schema A, but pass schema B as the writer schema ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
