Re: [ANNOUNCE] Apache Kafka 3.1.0
Thanks David for driving the release! @Deepti, no, this release doesn't include the log4j2 upgrade feature. Luke On Tue, Jan 25, 2022 at 11:43 AM Gwen Shapira wrote: > Exciting! Thanks for driving the release, David. > > On Mon, Jan 24, 2022 at 9:04 AM David Jacot wrote: > > > > The Apache Kafka community is pleased to announce the release for > > Apache Kafka 3.1.0. > > > > It is a major release that includes many new features, including: > > > > * Apache Kafka supports Java 17 > > * The FetchRequest supports Topic IDs (KIP-516) > > * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) > > * Add broker count metrics (KIP-748) > > * Differentiate consistently metric latency measured in millis and > > nanos (KIP-773) > > * The eager rebalance protocol is deprecated (KAFKA-13439) > > * Add TaskId field to StreamsException (KIP-783) > > * Custom partitioners in foreign-key joins (KIP-775) > > * Fetch/findSessions queries with open endpoints for > > SessionStore/WindowStore (KIP-766) > > * Range queries with open endpoints (KIP-763) > > * Add total blocked time metric to Streams (KIP-761) > > * Add additional configuration to control MirrorMaker2 internal topics > > naming convention (KIP-690) > > > > You may read a more detailed list of features in the 3.1.0 blog post: > > https://blogs.apache.org/kafka/ > > > > All of the changes in this release can be found in the release notes: > > https://www.apache.org/dist/kafka/3.1.0/RELEASE_NOTES.html > > > > You can download the source and binary release (Scala 2.12 and 2.13) > from: > > https://kafka.apache.org/downloads#3.1.0 > > > > > --- > > > > > > Apache Kafka is a distributed streaming platform with four core APIs: > > > > ** The Producer API allows an application to publish a stream of records > to > > one or more Kafka topics. > > > > ** The Consumer API allows an application to subscribe to one or more > > topics and process the stream of records produced to them. > > > > ** The Streams API allows an application to act as a stream processor, > > consuming an input stream from one or more topics and producing an > > output stream to one or more output topics, effectively transforming the > > input streams to output streams. > > > > ** The Connector API allows building and running reusable producers or > > consumers that connect Kafka topics to existing applications or data > > systems. For example, a connector to a relational database might > > capture every change to a table. > > > > > > With these APIs, Kafka can be used for two broad classes of application: > > > > ** Building real-time streaming data pipelines that reliably get data > > between systems or applications. > > > > ** Building real-time streaming applications that transform or react > > to the streams of data. > > > > > > Apache Kafka is in use at large and small companies worldwide, including > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > > A big thank you for the following 114 contributors to this release! > > > > A. Sophie Blee-Goldman, Alexander Iskuskov, Alexander Stohr, Almog > > Gavra, Andras Katona, Andrew Patterson, Andy Chambers, Andy Lapidas, > > Anna Sophie Blee-Goldman, Antony Stubbs, Arjun Satish, Bill Bejeck, > > Boyang Chen, Bruno Cadonna, CHUN-HAO TANG, Cheng Tan, Chia-Ping Tsai, > > Chris Egerton, Christo Lolov, Colin P. McCabe, Cong Ding, Daniel > > Urban, David Arthur, David Jacot, David Mao, Dmitriy Fishman, Edoardo > > Comar, Ewen Cheslack-Postava, Greg Harris, Guozhang Wang, Igor Soarez, > > Ismael Juma, Israel Ekpo, Ivan Ponomarev, Jakub Scholz, James Galasyn, > > Jason Gustafson, Jeff Kim, Jim Galasyn, JoeCqupt, Joel Hamill, John > > Gray, John Roesler, Jongho Jeon, Jorge Esteban Quilcate Otoya, Jose > > Sancio, Josep Prat, José Armando García Sancio, Jun Rao, Justine > > Olshan, Kalpesh Patel, Kamal Chandraprakash, Kevin Zhang, Kirk True, > > Konstantine Karantasis, Kowshik Prakasam, Leah Thomas, Lee Dongjin, > > Lucas Bradstreet, Luke Chen, Manikumar Reddy, Matthew Wong, Matthias > > J. Sax, Michael Carter, Mickael Maison, Nigel Liang, Niket, Niket > > Goel, Oliver Hutchison, Omnia G H Ibrahim, Patrick Stuedi, Phil > > Hardwick, Prateek Agarwal, Rajini Sivaram, Randall Hauch, René Kerner, > > Richard Yu, Rohan, Ron Dagostino, Ryan Dielhenn, Sanjana Kaundinya, > > Satish Duggana, Sergio Peña, Sherzod Mamadaliev, Stanislav Vodetskyi, > > Ted Yu, Tom Bentley, Tomas Forsman, Tomer Wizman, Uwe Eisele, Victoria > > Xia, Viktor Somogyi-Vass, Vincent Jiang, Walker Carlson, Weisheng > > Yang, Xavier Léauté, Yanwen(Jason) Lin, Yi Ding, Zara Lim, andy0x01, > > dengziming, feyman2016, ik, ik.lim, jem, jiangyuan, kpatelatwork, > > leah, loboya~, lujiefsi, sebbASF, singingMan, vamossagar12, > > wenbingshen > > > > We welcome your help and feedback. For more information o
Re: [ANNOUNCE] Apache Kafka 3.1.0
Exciting! Thanks for driving the release, David. On Mon, Jan 24, 2022 at 9:04 AM David Jacot wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.1.0. > > It is a major release that includes many new features, including: > > * Apache Kafka supports Java 17 > * The FetchRequest supports Topic IDs (KIP-516) > * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) > * Add broker count metrics (KIP-748) > * Differentiate consistently metric latency measured in millis and > nanos (KIP-773) > * The eager rebalance protocol is deprecated (KAFKA-13439) > * Add TaskId field to StreamsException (KIP-783) > * Custom partitioners in foreign-key joins (KIP-775) > * Fetch/findSessions queries with open endpoints for > SessionStore/WindowStore (KIP-766) > * Range queries with open endpoints (KIP-763) > * Add total blocked time metric to Streams (KIP-761) > * Add additional configuration to control MirrorMaker2 internal topics > naming convention (KIP-690) > > You may read a more detailed list of features in the 3.1.0 blog post: > https://blogs.apache.org/kafka/ > > All of the changes in this release can be found in the release notes: > https://www.apache.org/dist/kafka/3.1.0/RELEASE_NOTES.html > > You can download the source and binary release (Scala 2.12 and 2.13) from: > https://kafka.apache.org/downloads#3.1.0 > > --- > > > Apache Kafka is a distributed streaming platform with four core APIs: > > ** The Producer API allows an application to publish a stream of records to > one or more Kafka topics. > > ** The Consumer API allows an application to subscribe to one or more > topics and process the stream of records produced to them. > > ** The Streams API allows an application to act as a stream processor, > consuming an input stream from one or more topics and producing an > output stream to one or more output topics, effectively transforming the > input streams to output streams. > > ** The Connector API allows building and running reusable producers or > consumers that connect Kafka topics to existing applications or data > systems. For example, a connector to a relational database might > capture every change to a table. > > > With these APIs, Kafka can be used for two broad classes of application: > > ** Building real-time streaming data pipelines that reliably get data > between systems or applications. > > ** Building real-time streaming applications that transform or react > to the streams of data. > > > Apache Kafka is in use at large and small companies worldwide, including > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > A big thank you for the following 114 contributors to this release! > > A. Sophie Blee-Goldman, Alexander Iskuskov, Alexander Stohr, Almog > Gavra, Andras Katona, Andrew Patterson, Andy Chambers, Andy Lapidas, > Anna Sophie Blee-Goldman, Antony Stubbs, Arjun Satish, Bill Bejeck, > Boyang Chen, Bruno Cadonna, CHUN-HAO TANG, Cheng Tan, Chia-Ping Tsai, > Chris Egerton, Christo Lolov, Colin P. McCabe, Cong Ding, Daniel > Urban, David Arthur, David Jacot, David Mao, Dmitriy Fishman, Edoardo > Comar, Ewen Cheslack-Postava, Greg Harris, Guozhang Wang, Igor Soarez, > Ismael Juma, Israel Ekpo, Ivan Ponomarev, Jakub Scholz, James Galasyn, > Jason Gustafson, Jeff Kim, Jim Galasyn, JoeCqupt, Joel Hamill, John > Gray, John Roesler, Jongho Jeon, Jorge Esteban Quilcate Otoya, Jose > Sancio, Josep Prat, José Armando García Sancio, Jun Rao, Justine > Olshan, Kalpesh Patel, Kamal Chandraprakash, Kevin Zhang, Kirk True, > Konstantine Karantasis, Kowshik Prakasam, Leah Thomas, Lee Dongjin, > Lucas Bradstreet, Luke Chen, Manikumar Reddy, Matthew Wong, Matthias > J. Sax, Michael Carter, Mickael Maison, Nigel Liang, Niket, Niket > Goel, Oliver Hutchison, Omnia G H Ibrahim, Patrick Stuedi, Phil > Hardwick, Prateek Agarwal, Rajini Sivaram, Randall Hauch, René Kerner, > Richard Yu, Rohan, Ron Dagostino, Ryan Dielhenn, Sanjana Kaundinya, > Satish Duggana, Sergio Peña, Sherzod Mamadaliev, Stanislav Vodetskyi, > Ted Yu, Tom Bentley, Tomas Forsman, Tomer Wizman, Uwe Eisele, Victoria > Xia, Viktor Somogyi-Vass, Vincent Jiang, Walker Carlson, Weisheng > Yang, Xavier Léauté, Yanwen(Jason) Lin, Yi Ding, Zara Lim, andy0x01, > dengziming, feyman2016, ik, ik.lim, jem, jiangyuan, kpatelatwork, > leah, loboya~, lujiefsi, sebbASF, singingMan, vamossagar12, > wenbingshen > > We welcome your help and feedback. For more information on how to > report problems, and to get involved, visit the project website at > https://kafka.apache.org/ > > Thank you! > > > Regards, > > David
RE: [ANNOUNCE] Apache Kafka 3.1.0
Congratulations! One thing would like to confirm, if we have upgraded the Log4J version from 1.x to 2.x in this release? Regards, Deepti Sharma PMP® & ITIL -Original Message- From: David Jacot Sent: Monday, January 24, 2022 10:34 PM To: annou...@apache.org; dev@kafka.apache.org; us...@kafka.apache.org; kafka-clie...@googlegroups.com Subject: [ANNOUNCE] Apache Kafka 3.1.0 The Apache Kafka community is pleased to announce the release for Apache Kafka 3.1.0. It is a major release that includes many new features, including: * Apache Kafka supports Java 17 * The FetchRequest supports Topic IDs (KIP-516) * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) * Add broker count metrics (KIP-748) * Differentiate consistently metric latency measured in millis and nanos (KIP-773) * The eager rebalance protocol is deprecated (KAFKA-13439) * Add TaskId field to StreamsException (KIP-783) * Custom partitioners in foreign-key joins (KIP-775) * Fetch/findSessions queries with open endpoints for SessionStore/WindowStore (KIP-766) * Range queries with open endpoints (KIP-763) * Add total blocked time metric to Streams (KIP-761) * Add additional configuration to control MirrorMaker2 internal topics naming convention (KIP-690) You may read a more detailed list of features in the 3.1.0 blog post: https://blogs.apache.org/kafka/ All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.1.0/RELEASE_NOTES.html You can download the source and binary release (Scala 2.12 and 2.13) from: https://kafka.apache.org/downloads#3.1.0 --- Apache Kafka is a distributed streaming platform with four core APIs: ** The Producer API allows an application to publish a stream of records to one or more Kafka topics. ** The Consumer API allows an application to subscribe to one or more topics and process the stream of records produced to them. ** The Streams API allows an application to act as a stream processor, consuming an input stream from one or more topics and producing an output stream to one or more output topics, effectively transforming the input streams to output streams. ** The Connector API allows building and running reusable producers or consumers that connect Kafka topics to existing applications or data systems. For example, a connector to a relational database might capture every change to a table. With these APIs, Kafka can be used for two broad classes of application: ** Building real-time streaming data pipelines that reliably get data between systems or applications. ** Building real-time streaming applications that transform or react to the streams of data. Apache Kafka is in use at large and small companies worldwide, including Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others. A big thank you for the following 114 contributors to this release! A. Sophie Blee-Goldman, Alexander Iskuskov, Alexander Stohr, Almog Gavra, Andras Katona, Andrew Patterson, Andy Chambers, Andy Lapidas, Anna Sophie Blee-Goldman, Antony Stubbs, Arjun Satish, Bill Bejeck, Boyang Chen, Bruno Cadonna, CHUN-HAO TANG, Cheng Tan, Chia-Ping Tsai, Chris Egerton, Christo Lolov, Colin P. McCabe, Cong Ding, Daniel Urban, David Arthur, David Jacot, David Mao, Dmitriy Fishman, Edoardo Comar, Ewen Cheslack-Postava, Greg Harris, Guozhang Wang, Igor Soarez, Ismael Juma, Israel Ekpo, Ivan Ponomarev, Jakub Scholz, James Galasyn, Jason Gustafson, Jeff Kim, Jim Galasyn, JoeCqupt, Joel Hamill, John Gray, John Roesler, Jongho Jeon, Jorge Esteban Quilcate Otoya, Jose Sancio, Josep Prat, José Armando García Sancio, Jun Rao, Justine Olshan, Kalpesh Patel, Kamal Chandraprakash, Kevin Zhang, Kirk True, Konstantine Karantasis, Kowshik Prakasam, Leah Thomas, Lee Dongjin, Lucas Bradstreet, Luke Chen, Manikumar Reddy, Matthew Wong, Matthias J. Sax, Michael Carter, Mickael Maison, Nigel Liang, Niket, Niket Goel, Oliver Hutchison, Omnia G H Ibrahim, Patrick Stuedi, Phil Hardwick, Prateek Agarwal, Rajini Sivaram, Randall Hauch, René Kerner, Richard Yu, Rohan, Ron Dagostino, Ryan Dielhenn, Sanjana Kaundinya, Satish Duggana, Sergio Peña, Sherzod Mamadaliev, Stanislav Vodetskyi, Ted Yu, Tom Bentley, Tomas Forsman, Tomer Wizman, Uwe Eisele, Victoria Xia, Viktor Somogyi-Vass, Vincent Jiang, Walker Carlson, Weisheng Yang, Xavier Léauté, Yanwen(Jason) Lin, Yi Ding, Zara Lim, andy0x01, dengziming, feyman2016, ik, ik.lim, jem, jiangyuan, kpatelatwork, leah, loboya~, lujiefsi, sebbASF, singingMan, vamossagar12, wenbingshen We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kafka.apache.org/ Thank you! Regards, David
Re: [ANNOUNCE] Apache Kafka 3.1.0
Thanks David for driving this release! On Mon, Jan 24, 2022 at 6:07 PM Deepti Sharma S wrote: > > Congratulations! > > One thing would like to confirm, if we have upgraded the Log4J version from > 1.x to 2.x in this release? > > > Regards, > Deepti Sharma > PMP® & ITIL > > > -Original Message- > From: David Jacot > Sent: Monday, January 24, 2022 10:34 PM > To: annou...@apache.org; dev@kafka.apache.org; us...@kafka.apache.org; > kafka-clie...@googlegroups.com > Subject: [ANNOUNCE] Apache Kafka 3.1.0 > > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.1.0. > > It is a major release that includes many new features, including: > > * Apache Kafka supports Java 17 > * The FetchRequest supports Topic IDs (KIP-516) > * Extend SASL/OAUTHBEARER with support for OIDC (KIP-768) > * Add broker count metrics (KIP-748) > * Differentiate consistently metric latency measured in millis and nanos > (KIP-773) > * The eager rebalance protocol is deprecated (KAFKA-13439) > * Add TaskId field to StreamsException (KIP-783) > * Custom partitioners in foreign-key joins (KIP-775) > * Fetch/findSessions queries with open endpoints for SessionStore/WindowStore > (KIP-766) > * Range queries with open endpoints (KIP-763) > * Add total blocked time metric to Streams (KIP-761) > * Add additional configuration to control MirrorMaker2 internal topics naming > convention (KIP-690) > > You may read a more detailed list of features in the 3.1.0 blog post: > https://blogs.apache.org/kafka/ > > All of the changes in this release can be found in the release notes: > https://www.apache.org/dist/kafka/3.1.0/RELEASE_NOTES.html > > You can download the source and binary release (Scala 2.12 and 2.13) from: > https://kafka.apache.org/downloads#3.1.0 > > --- > > > Apache Kafka is a distributed streaming platform with four core APIs: > > ** The Producer API allows an application to publish a stream of records to > one or more Kafka topics. > > ** The Consumer API allows an application to subscribe to one or more topics > and process the stream of records produced to them. > > ** The Streams API allows an application to act as a stream processor, > consuming an input stream from one or more topics and producing an output > stream to one or more output topics, effectively transforming the input > streams to output streams. > > ** The Connector API allows building and running reusable producers or > consumers that connect Kafka topics to existing applications or data systems. > For example, a connector to a relational database might capture every change > to a table. > > > With these APIs, Kafka can be used for two broad classes of application: > > ** Building real-time streaming data pipelines that reliably get data between > systems or applications. > > ** Building real-time streaming applications that transform or react to the > streams of data. > > > Apache Kafka is in use at large and small companies worldwide, including > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > A big thank you for the following 114 contributors to this release! > > A. Sophie Blee-Goldman, Alexander Iskuskov, Alexander Stohr, Almog Gavra, > Andras Katona, Andrew Patterson, Andy Chambers, Andy Lapidas, Anna Sophie > Blee-Goldman, Antony Stubbs, Arjun Satish, Bill Bejeck, Boyang Chen, Bruno > Cadonna, CHUN-HAO TANG, Cheng Tan, Chia-Ping Tsai, Chris Egerton, Christo > Lolov, Colin P. McCabe, Cong Ding, Daniel Urban, David Arthur, David Jacot, > David Mao, Dmitriy Fishman, Edoardo Comar, Ewen Cheslack-Postava, Greg > Harris, Guozhang Wang, Igor Soarez, Ismael Juma, Israel Ekpo, Ivan Ponomarev, > Jakub Scholz, James Galasyn, Jason Gustafson, Jeff Kim, Jim Galasyn, > JoeCqupt, Joel Hamill, John Gray, John Roesler, Jongho Jeon, Jorge Esteban > Quilcate Otoya, Jose Sancio, Josep Prat, José Armando García Sancio, Jun Rao, > Justine Olshan, Kalpesh Patel, Kamal Chandraprakash, Kevin Zhang, Kirk True, > Konstantine Karantasis, Kowshik Prakasam, Leah Thomas, Lee Dongjin, Lucas > Bradstreet, Luke Chen, Manikumar Reddy, Matthew Wong, Matthias J. Sax, > Michael Carter, Mickael Maison, Nigel Liang, Niket, Niket Goel, Oliver > Hutchison, Omnia G H Ibrahim, Patrick Stuedi, Phil Hardwick, Prateek Agarwal, > Rajini Sivaram, Randall Hauch, René Kerner, Richard Yu, Rohan, Ron Dagostino, > Ryan Dielhenn, Sanjana Kaundinya, Satish Duggana, Sergio Peña, Sherzod > Mamadaliev, Stanislav Vodetskyi, Ted Yu, Tom Bentley, Tomas Forsman, Tomer > Wizman, Uwe Eisele, Victoria Xia, Viktor Somogyi-Vass, Vincent Jiang, Walker > Carlson, Weisheng Yang, Xavier Léauté, Yanwen(Jason) Lin, Yi Ding, Zara Lim, > andy0x01, dengziming, feyman2016, ik, ik.lim, jem, jiangyuan, kpatelatwork, > leah, loboya~, lujiefsi, sebbASF, singingMan, vamossagar12
