leesf commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007441054
> @leesf few questions. > > 1. What do the hudi-spark2-extensions/hudi-spark3-extensions do? What code would these have in the future? > 2. Users may have spark jobs that depend directly on `hudi-spark` . any impact to these from the changes? > 3. I feel there are way too many packages now - hudi-spark*, then it depends hudi-spark-common* . Is there a way for us to merge hudi-spark-common into hudi-spark* ? is the hudi-spark3-common so we can share code across the different 3.x versions? Can you add a README that explains what code should go where going forward > 4. Any updates to release notes or README? 1. I did intend to remove the modules but wrongly added. removed now. 2. I did not change hudi-spark module, so it should have no impact on the users. 3. I think the current modules has be in a good shape, if merge code from hudi-spark-common into hudi-spark* or merge code from hudi-spark3-common into hudi-spark3 & spark3.1.x, there would be many duplicate classes, which i think is not an ideal way. 4. Added a README under hudi-spark-datasource module. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
