Hi, @holden Karau recently created two Jiras that deal with two items of interest namely:
1. Improve Spark Driver Launch Time SPARK-44950 <https://issues.apache.org/jira/browse/SPARK-44950> 2. Improve Spark Dynamic Allocation SPARK-44951 <https://issues.apache.org/jira/browse/SPARK-44951> These are both very much in demand (at least IMO) These topics have been discussed a few times. Most recently in spark-dev thread I*mproving Dynamic Allocation Logic for Spark 4+* on 7th August Pretty much in skeleton form yet. Add your vote if you are interested and comment. Thanks, view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.
