Hi, Does Hudi 0.10 drop support for Spark 3.0?
>From the website, Hudi claims to work with Spark-2.4.3+ & Spark 3.x >versions[1]. The Apache Kyuubi (Incubating) has integration tests with Hudi, some tests works well with Hudi 0.9.0 but fails after bumping Hudi 0.10.0-rc3[2]. I paste some stacktrace, and you can check the details on GitHub Actions[3]. ``` java.sql.SQLException: Error operating EXECUTE_STATEMENT: java.lang.NoSuchMethodError: 'org.apache.spark.sql.catalyst.expressions.AttributeSet org.apache.spark.sql.catalyst.plans.logical.Command.producedAttributes$(org.apache.spark.sql.catalyst.plans.logical.Command)' at org.apache.spark.sql.hudi.command.CreateHoodieTableCommand.producedAttributes(CreateHoodieTableCommand.scala:48) at org.apache.spark.sql.catalyst.plans.QueryPlan.references$lzycompute(QueryPlan.scala:72) at org.apache.spark.sql.catalyst.plans.QueryPlan.references(QueryPlan.scala:72) ``` [1] https://hudi.apache.org/docs/next/quick-start-guide#setup [2] https://github.com/apache/incubator-kyuubi/pull/1460 [3] https://github.com/apache/incubator-kyuubi/runs/4440884713 Thanks, Cheng Pan On Tue, Dec 7, 2021 at 2:18 PM Nishith <n3.nas...@gmail.com> wrote: > > +1 (binding) > > - build successful > - QuickStart successful > - verified checksum > > Thanks, > Nishith > > > On Dec 6, 2021, at 6:40 AM, vino yang <yanghua1...@gmail.com> wrote: > > > > +1 (binding) > > > > - build successfully > > - ran spark quickstart > > - verified checksum
