You are right. After SPARK-36837, we tried to ship Apache Spark 3.3.0 with Apache Kafka 3.1.1 via the following PR.
https://github.com/apache/spark/pull/36135 [WIP][SPARK-38850][BUILD] Upgrade Kafka to 3.1.1 However, the final decision was to revert it from `branch-3.3` and move directly to Apache Kafka 3.2.0 at `master` branch. We need to remove it from the 3.3.0 release note. On Fri, Jun 3, 2022 at 9:54 AM Koert Kuipers <ko...@tresata.com> wrote: > i thought SPARK-36837 didnt make it in? i see it in notes > > On Fri, Jun 3, 2022 at 4:31 AM Maxim Gekk > <maxim.g...@databricks.com.invalid> wrote: > >> Hi All, >> >> I am preparing the release notes of Spark 3.3.0. Here is a draft document: >> >> https://docs.google.com/document/d/1gGySrLGvIK8bajKdGjTI_mDqk0-YPvHmPN64YjoWfOQ/edit?usp=sharing >> >> Please take a look and let me know if I missed any major changes or >> something. >> >> Maxim Gekk >> >> Software Engineer >> >> Databricks, Inc. >> > > CONFIDENTIALITY NOTICE: This electronic communication and any files > transmitted with it are confidential, privileged and intended solely for > the use of the individual or entity to whom they are addressed. If you are > not the intended recipient, you are hereby notified that any disclosure, > copying, distribution (electronic or otherwise) or forwarding of, or the > taking of any action in reliance on the contents of this transmission is > strictly prohibited. Please notify the sender immediately by e-mail if you > have received this email by mistake and delete this email from your system. > > Is it necessary to print this email? If you care about the environment > like we do, please refrain from printing emails. It helps to keep the > environment forested and litter-free.
