This is an automated email from the ASF dual-hosted git repository.
mimaison pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/kafka-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 7021dd2a9 MINOR: Add blog post for 4.1.0 (#711)
7021dd2a9 is described below
commit 7021dd2a9633017f288f71a320f2d6c2fd112aab
Author: Mickael Maison <[email protected]>
AuthorDate: Thu Sep 4 11:47:09 2025 +0200
MINOR: Add blog post for 4.1.0 (#711)
Reviewers: Stanislav Kozlovski <[email protected]>, Andrew
Schofield <[email protected]>, Robert Young <[email protected]>,
Shashank <[email protected]>
---
blog.html | 154 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 154 insertions(+)
diff --git a/blog.html b/blog.html
index 163d6c41e..70748ae26 100644
--- a/blog.html
+++ b/blog.html
@@ -22,6 +22,160 @@
<!--#include virtual="includes/_nav.htm" -->
<div class="right">
<h1 class="content-title">Blog</h1>
+ <article>
+ <h2 class="bullet">
+ <a id="apache_kafka_410_release_announcement"></a>
+ <a href="#apache_kafka_410_release_announcement">Apache
Kafka 4.1.0 Release Announcement</a>
+ </h2>
+ 4 September 2025 - Mickael Maison (<a
href="https://x.com/MickaelMaison";>@MickaelMaison</a>)
+
+ <p>
+ We are proud to announce the release of Apache Kafka®
4.1.0. This release contains many new
+ features and improvements. This blog post will highlight
some of the more prominent ones.
+ For a full list of changes, be sure to check the <a
href="https://download.apache.org/dist/kafka/4.1.0/RELEASE_NOTES.html";>release
notes</a>.
+ </p>
+ <p>
+ Queues for Kafka (<a
href="https://cwiki.apache.org/confluence/x/4hA0Dw";>KIP-932</a>) is now in
preview. It's still not ready for
+ production but you can start evaluating and testing it.
See the
+ <a
href="https://cwiki.apache.org/confluence/x/CIq3FQ";>preview release notes</a>
+ for more details.
+ </p>
+ <p>
+ This release also introduces a new Streams Rebalance
Protocol (<a href="https://cwiki.apache.org/confluence/x/2BCTEg";>KIP-1071</a>)
+ in early access. It is based on the new consumer group
protocol (<a href="https://cwiki.apache.org/confluence/x/HhD1D";>KIP-848</a>).
+ <p>
+ See the <a
href="https://kafka.apache.org/documentation.html#upgrade_4_1_0";>Upgrading to
4.1</a> section in the
+ documentation for the list of notable changes and detailed
upgrade steps.
+ </p>
+
+ <h3>Kafka Broker, Controller, Producer, Consumer and Admin
Client</h3>
+
+ <ul>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/lY3GDQ";>KIP-877: Mechanism for
plugins and connectors to register metrics</a>
+ <br>
+ Many client-side plugins can now implement the
<code>Monitorable</code> interface to easily register their own metrics. Tags
identifying
+ the plugin are automatically injected and the metrics
use the <code>kafka.CLIENT:type=plugins</code> naming where CLIENT is either
producer, consumer or admin.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/8ItyEg";>KIP-1050: Consistent error
handling for Transactions</a>
+ <br>
+ This KIP updates the error handling logic and
documentation of all the transaction APIs to make it simpler to build robust
applications and build
+ third-party Kafka clients that behave the same way as
the Java client.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/JQstEw";>KIP-1092: Extend
Consumer#close with an option to leave the group or not</a>
+ <br>
+ This adds a new
<code>Consumer.close(CloseOptions)</code> method which indicates whether the
consumer should explicitly leave its group when
+ it's shutting down. This enables Streams to control
when to trigger group rebalances. The <code>Consumer.close(Duration)</code>
method is now
+ deprecated.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/FouMEw";>KIP-1101: Trigger rebalance
on rack topology changes</a>
+ <br>
+ This KIP updates the rack-aware partition assignment
from the consumer rebalance protocol and makes it a lot more memory efficient,
allowing
+ to have hundreds of members in a consumer group.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/-42MEw";>KIP-1109: Unifying Kafka
Consumer Topic Metrics</a>
+ <br>
+ The consumer used to replace dots in topic names by
underscore it its metric names. In this release, topic metrics are also emitted
with the topic
+ names unchanged. Users should transition to these new
metrics. In 5.0, the metrics with the changed topic names will be removed.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/LorREw";>KIP-1118: Add Deadlock
Protection on Producer Network Thread</a>
+ <br>
+ From 4.1, if <code>KafkaProducer.flush()</code> is
called from the <code>KafkaProducer.send()</code> callback, then an exception
is raised. Previously this
+ could lead to a deadlock in the producer.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/uIxEF";>KIP-1139: Add support for
OAuth jwt-bearer grant type</a>
+ <br>
+ In addition to the client_credentials grant type,
Kafka now supports the jwt-bearer grant type for OAuth. This grant type avoids
putting secrets in clear
+ in the configuration and is also supported by many
OAuth providers.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/LwqWF";>KIP-1143: Deprecated
Optional<String> and return String from public Endpoint#listenerName</a>
+ <br>
+ This is a cleanup in the <code>Endpoint</code> class.
The existing <code>listenerName()</code> method which returns
<code>Optional<String></code> is now
+ deprecated and users should transition to the new
<code>listenerName()</code> method which returns <code>String</code>.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/4gm9F";>KIP-1152: Add transactional
ID pattern filter to ListTransactions API</a>
+ <br>
+ When listing transactions you can now provide a
pattern to filter based on the transactional ID. In environments with many
transactional IDs, this avoids
+ having to list all transactions and filter them on the
client-side.
+ </li>
+ </ul>
+
+ <h3>Kafka Streams</h3>
+
+ <ul>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/lAtYEQ";>KIP-1020: Move
window.size.ms and windowed.inner.class.serde from StreamsConfig to
TimeWindowedDe/Serializer and SessionWindowedDe/Serializer class</a>
+ <br>
+ The <code>window.size.ms</code> and
<code>windowed.inner.class.serde</code> configurations are now defined in
TimeWindowed and SessionWindowed SerDes.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/2BCTEg";>KIP-1071: Streams Rebalance
Protocol</a>
+ <br>
+ This builds on KIP-848 and makes Streams task
assignment a first-class citizen in the Kafka protocol. A lot of logic also
moves to the coordinator
+ such a task assignments, internal topic creations.
This is currently in early access and not ready for production use. See the
+ <a
href="/documentation/streams/upgrade-guide#streams_api_changes_410">upgrade
guide</a> for more details.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/4Y_MEw";>KIP-1111: Enforcing
Explicit Naming for Kafka Streams Internal Topics</a>
+ <br>
+ Streams stores its state in internal topics whose
names are generated. A new configuration,
<code>ensure.explicit.internal.resource.naming</code>
+ allows to enforce explicit naming of all internal
resources to make topic names predictable and allow altering a topology and
still conserve the
+ existing topics.
+ </li>
+ </ul>
+
+ <h3>Kafka Connect</h3>
+
+ <ul>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/lY3GDQ";>KIP-877: Mechanism for
plugins and connectors to register metrics</a>
+ <br>
+ All worker and connector plugins can now register
their own metrics. For connectors and tasks this is done via their context.
Other plugins
+ can implement the <code>Monitorable</code> interface
to do so.
+ </li>
+ <li>
+ <a
href="https://cwiki.apache.org/confluence/x/qY0ODg";>KIP-891: Running multiple
versions of Connector plugins</a>
+ <br>
+ Connect now supports installing and running multiple
versions of the same connector plugins (Connectors, Converters, Transformations
and
+ Predicates). This make it easier to upgrade, and
downgrade in case of issues, plugins without needing to use separate Connect
clusters.
+ </li>
+ </ul>
+
+ <h3>Summary</h3>
+
+ <p>Ready to get started with Apache Kafka 4.1.0? Check out all
the details in the <a
href="https://kafka.apache.org/documentation.html#upgrade_4_1_0";>upgrade
notes</a> and
+ the <a
href="https://downloads.apache.org/kafka/4.1.0/RELEASE_NOTES.html";>release
notes</a>,
+ and <a
href="https://kafka.apache.org/downloads";>download</a> Apache Kafka 4.1.0.</p>
+
+ <p>This was a community effort, so thank you to everyone who
contributed to this release, including all our users and our 167
contributors:<br>
+ 陳昱霖(Yu-Lin Chen), A. Sophie Blee-Goldman, Abhinav Dixit,
Albert, Alieh Saeedi, Almog Gavra, Alyssa Huang, Andrew Schofield,
+ Andy Li, Ao Li, Apoorv Mittal, Artem Livshits, Ayoub
Omari, Azhar Ahmed, Bill Bejeck, Bolin Lin, Bruno Cadonna, Calvin Liu,
+ Cheryl Simmons, Chia-Ping Tsai, ChickenchickenLove,
Chih-Yuan Chien, Chirag Wadhwa, Chris Flood, Christo Lolov,
+ ClarkChen, Clay Johnson, co63oc, Colin P. McCabe, Colt
McNealy, Damien Gasparina, Dániel Urbán, Dave Troiano, David Arthur, David
Jacot,
+ David Mao, Dejan Stojadinović, dengziming, Dimitar
Dimitrov, Divij Vaidya, DL1231, Dmitry Werner, Dongnuo Lyu, Edoardo Comar,
fangxiaobing,
+ Federico Valeri, Florian Hussonnois, Fred Zheng, Gantigmaa
Selenge, Gaurav Narula, Gerard Klijs-Nefkens, Goooler, grace, Greg Harris,
+ Guang, Guozhang Wang, Gyeongwon, Do, Hailey Ni, hgh1472,
Hong-Yi Chen, Iamoshione, Ismael Juma, Istvan Toth, Janindu Pathirana, Jared
Harley,
+ Jason Taylor, Jeff Kim, Jhen-Yung Hsu, Ji-Seung Ryu,
jimmy, Jimmy Wang, Jing-Jia Hung, Joao Pedro Fonseca Dantas, John Huang, John
Roesler,
+ Jonah Hooper, Jorge Esteban Quilcate Otoya, Josep Prat,
José Armando García Sancio, Jun Rao, Justine Olshan, Kamal Chandraprakash,
Karsten Spang,
+ Kaushik Raina, Ken Huang, Kevin Wu, Kirk True, Kondrat
Bertalan, Kuan-Po Tseng, Lan Ding, leaf-soba, Liam Miller-Cushon, Lianet
Magrans,
+ Logan Zhu, Loïc GREFFIER, Lorcan, Lucas Brutschy,
lucliu1108, Luke Chen, Mahsa Seifikar, Manikumar Reddy, Manoj, Martin Sillence,
Matthias J. Sax,
+ Mehari Beyene, Mickael Maison, Milly, Ming-Yen Chung,
mingdaoy, Nick Guo, Nick Telford, NICOLAS GUYOMAR, nilmadhab mondal, Okada
Haruki,
+ Omnia Ibrahim, Parker Chang, Peter Lee, Piotr P. Karwasz,
PoAn Yang, Pramithas Dhakal, qingbozhang, Rajini Sivaram, Rich Chen, Ritika
Reddy,
+ Rohan, S.Y. Wang, Sanskar Jhajharia, santhoshct, Satish
Duggana, Sean Quah, Sebastien Viale, Shaan, Shahbaz Aamir, ShihYuan Lin,
+ Shivsundar R, snehashisp, Stanislav Kozlovski, Steven
Schlansker, Sushant Mahajan, Swikar Patel, TaiJuWu, Ted Yan, TengYao Chi,
Thomas Gebert,
+ Thomas Thornton, Tsung-Han Ho (Miles Ho), u0184996,
Uladzislau Blok, Vadym Zhytkevych, Vedarth Sharma, Vikas Singh, Viktor
Somogyi-Vass,
+ Vincent PÉRICART, Xiaobing Fang, xijiu, Xuan-Zhang Gong,
yangjf2019, Yaroslav Kutsela, Yu-Syuan Jheng, YuChia Ma, Yunchi Pang, Yung,
YunKui Lu,
+ yx9o, Zachary Hamilton, Zhihong Yu
+ </p>
+ </article>
<article>
<h2 class="bullet">
<a id="apache_kafka_391_release_announcement"></a>
