sbernauer opened a new pull request #2650:
URL: https://github.com/apache/hudi/pull/2650


   Hi Hudi team!
   
   ## What is the purpose of the pull request
   We need to upgrade to at least Avro 1.9.x in production so i tried upgrading 
the avro version in the pom.xml of Hudi. Doing so i noticed some problems:
   
   Upgrade to Avro 1.9.2:
   - Renamed method defaultValue to defaultVal
   - Moved NullNode.getInstance() to JsonProperties.NULL_VALUE
   - Avro complains about invalid schemas/default values in 
hudi-common/src/main/avro/
   - The shaded guava libs from Avro have been removed
   
   Upgrade to Avro 1.10.1:
   - Some more stuff
   
   Spark 3.2.0 (we currently use 3.1.1) will contain Avro 1.10.1 
(https://issues.apache.org/jira/browse/SPARK-27733).
   Ín order to reduce the effort switching to a newer Avro version in the 
future i provided a patches that fixes the above mentioned issues.
   
   ## Brief change log
   Fix the above mentioned issues
   
   ## Verify this pull request
   Run Unit tests
   
   Kind regards
   Sebastian
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to