Hi, Just tried doing a mvn clean install -DskipTests, and the build failed. My local SPARK_HOME is pointing to spark 3.3 installation. Does that all matter now? Quite possible this is an issue with my setup, just flagging.
Thanks Vinoth On Fri, May 26, 2023 at 8:30 AM Shiyan Xu <xu.shiyan.raym...@gmail.com> wrote: > Hi all, > > We recently landed a change > < > https://github.com/apache/hudi/commit/516c3d59404934e6a142ea1c9d97002c065f8a4f > > > in master switching the default Spark profile from 2.4 to 3.2. If your > local Hudi repo is configured to use Spark 2.4, you may need to re-import > the IDEA project (this may involve clearing `.idea/` folder and *.iml files > in each maven module) > > I'd also like to acknowledge contributions from Forward Xu, Rahil, Zhang > Yue, and Danny, who have previously worked on or helped tackle this > migration, as it involved a lot of dependency issue wrangling and test > fixes. > > Cheers, > > -- > Best, > Shiyan >
