vinothchandar commented on issue #1290: [HUDI-584] Relocate spark-avro dependency by maven-shade-plugin URL: https://github.com/apache/incubator-hudi/pull/1290#issuecomment-582238771 @umehrot2 as well.. We considered doing this when we moved to `spark-avro` actually. The concern was that the bundle now has a dependency on the spark version used by Hudi.. i.e we use spark 2.4.4 and the spark bundle would contain `spark-avro:2.4.4`. I believe this may be working with `spark-3.0-preview2` now. But what if the user wants some changes in `spark-avro:3.0-preview2` (esp with avro <=> row datatype conversions that keep coming up)? They would have to make a custom build right? In short, I don't know if this is a good idea..
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
