aditiwari01 commented on issue #2675:
URL: https://github.com/apache/hudi/issues/2675#issuecomment-801047682


   Digging a bit deeper I have concluded that the issue is as following:
   
   The avro refuses to read anny payload where reader schema has some extra 
field than writer schema unless default has been defined for that optional 
field. (even if the field is nullable, avro expects a default to read).
   
   And while registering Avro schema, Hudi uses SparkAvroUtils to generate 
schema which explicitly creates schema with **noDefault**. Hence the unexpected 
behavior.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to