yihua opened a new issue, #20559:
URL: https://github.com/apache/hudi/issues/20559

   The Spark 4.1, 4.2 and 4.3 modules each carry their own copy of the same 
code: the SQL grammars, the Avro and Parquet forks, the Catalyst and schema 
utils, the variant inferrer, and the extended SQL parser. Apart from class 
names these copies are nearly identical, about 3,400 lines each. Every fix has 
to be applied three times, and every new Spark version adds another copy.
   
   The proposal is to keep one copy of that code in a shared source root that 
each 4.1+ module compiles against its own Spark version, and keep only the real 
per-version differences in each module. Spark 4.0 differs too much to share and 
stays as it is.
   
   Part of #16053. Follows #20550.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to