aditiwari01 commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-801047682
Digging a bit deeper I have concluded that the issue is as following: The avro refuses to read anny payload where reader schema has some extra field than writer schema unless default has been defined for that optional field. (even if the field is nullable, avro expects a default to read). And while registering Avro schema, Hudi uses SparkAvroUtils to generate schema which explicitly creates schema with **noDefault**. Hence the unexpected behavior. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org