This is an automated email from the ASF dual-hosted git repository. mjsax pushed a commit to branch 3.4 in repository https://gitbox.apache.org/repos/asf/kafka.git
The following commit(s) were added to refs/heads/3.4 by this push: new 65e223a76c4 MINOR: update Kafka Streams docs with 3.4 KIP information (#16336) 65e223a76c4 is described below commit 65e223a76c40d712b0f2ecef3911ad927d8ad2df Author: Matthias J. Sax <matth...@confluent.io> AuthorDate: Fri Jun 14 15:01:35 2024 -0700 MINOR: update Kafka Streams docs with 3.4 KIP information (#16336) Reviewers: Jim Galasyn <jim.gala...@confluent.io>, Bill Bejeck <b...@confluent.io> --- docs/ops.html | 10 ++++++++++ docs/streams/upgrade-guide.html | 29 +++++++++++++++++++++++++++++ 2 files changed, 39 insertions(+) diff --git a/docs/ops.html b/docs/ops.html index 20597e5963c..4922f73a997 100644 --- a/docs/ops.html +++ b/docs/ops.html @@ -2858,6 +2858,16 @@ active-process-ratio metrics which have a recording level of <code>info</code>: <td>The fraction of time the stream thread spent on processing this task among all assigned active tasks.</td> <td>kafka.streams:type=stream-task-metrics,thread-id=([-.\w]+),task-id=([-.\w]+)</td> </tr> + <tr> + <td>input-buffer-bytes-total</td> + <td>The total number of bytes accumulated by this task,</td> + <td>kafka.streams:type=stream-task-metrics,thread-id=([-.\w]+),task-id=([-.\w]+)</td> + </tr> + <tr> + <td>cache-size-bytes-total</td> + <td>The cache size in bytes accumulated by this task.</td> + <td>kafka.streams:type=stream-task-metrics,thread-id=([-.\w]+),task-id=([-.\w]+)</td> + </tr> </tbody> </table> diff --git a/docs/streams/upgrade-guide.html b/docs/streams/upgrade-guide.html index 0f5fff21258..fd6c6f60e2f 100644 --- a/docs/streams/upgrade-guide.html +++ b/docs/streams/upgrade-guide.html @@ -117,6 +117,35 @@ More details about the new config <code>StreamsConfig#TOPOLOGY_OPTIMIZATION</code> can be found in <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3A+Add+Streams+Configuration+Allowing+for+Optional+Topology+Optimization">KIP-295</a>. </p> + <h3><a id="streams_api_changes_340" href="#streams_api_changes_340">Streams API changes in 3.4.0</a></h3> + <p> + <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186878390">KIP-770</a> deprecates + config <code>cache.max.bytes.buffering</code> in favor of the newly introduced config <code>statestore.cache.max.bytes</code>. + To improve monitoring, two new metrics <code>input-buffer-bytes-total</code> and <code>cache-size-bytes-total</code> + were added at the DEBUG level. Note, that the KIP is only partially implemented in the 3.4.0 release, and config + <code>input.buffer.max.bytes</code> is not available yet. + </p> + + <p> + <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=211883356">KIP-873</a> enables you to multicast + result records to multiple partition of downstream sink topics and adds functionality for choosing to drop result records without sending. + The <code>Integer StreamPartitioner.partition()</code> method is deprecated and replaced by the newly added + <code>Optiona≶Set<Integer>>StreamPartitioner.partitions()</code> method, which enables returning a set of partitions to send the record to. + </p> + + <p> + <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-862%3A+Self-join+optimization+for+stream-stream+joins">KIP-862</a> + adds a DSL optimization for stream-stream self-joins. The optimization is enabled via a new option <code>single.store.self.join</code> + which can be set via existing config <code>topology.optimization</code>. If enabled, the DSL will use a different + join processor implementation that uses a single RocksDB store instead of two, to avoid unnecessary data duplication for the self-join case. + </p> + + <p> + <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-865%3A+Support+--bootstrap-server+in+kafka-streams-application-reset">KIP-865</a> + updates the Kafka Streams application reset tool’s server parameter name to conform to the other Kafka tooling by deprecating + the <code>--bootstrap-servers</code> parameter and introducing a new <code>--bootstrap-server</code> parameter in its place. + </p> + <h3><a id="streams_api_changes_330" href="#streams_api_changes_330">Streams API changes in 3.3.0</a></h3> <p> Kafka Streams does not send a "leave group" request when an instance is closed. This behavior implies