Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0
Thanks Stansilav for running the release. That must be exhausting but you executed it well. Regards, Apoorv Mittal +44 7721681581 On Wed, Feb 28, 2024 at 11:22 AM Divij Vaidya wrote: > Thank you Stanislav for running the release, especially fixing the whole > mess with out of sync site docs in different branches. Really appreciate > your hard work on this one. > > Thank you all contributors! Your contributions is what makes Apache Kafka > community awesome <3 > > There are many impactful changes in this release but the one closest to my > heart is https://issues.apache.org/jira/browse/KAFKA-15046. I am very glad > this is fixed. The P999 latency spikes were driving me crazy for a long > time now. > > -- > Divij Vaidya > > > > On Wed, Feb 28, 2024 at 10:06 AM Satish Duggana > wrote: > > > Thanks Stanislav for all your hard work on running the release. Thanks > > to all the contributors to this release. > > > > > > On Wed, 28 Feb 2024 at 13:43, Bruno Cadonna wrote: > > > > > > Thanks Stan and all contributors for the release! > > > > > > Best, > > > Bruno > > > > > > On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: > > > > The Apache Kafka community is pleased to announce the release of > > > > Apache Kafka 3.7.0 > > > > > > > > This is a minor release that includes new features, fixes, and > > > > improvements from 296 JIRAs > > > > > > > > An overview of the release and its notable changes can be found in > the > > > > release blog post: > > > > https://kafka.apache.org/blog#apache_kafka_370_release_announcement > > > > > > > > All of the changes in this release can be found in the release notes: > > > > https://www.apache.org/dist/kafka/3.7.0/RELEASE_NOTES.html > > > > > > > > You can download the source and binary release (Scala 2.12, 2.13) > from: > > > > https://kafka.apache.org/downloads#3.7.0 > > > > > > > > > > > --- > > > > > > > > > > > > Apache Kafka is a distributed streaming platform with four core APIs: > > > > > > > > > > > > ** The Producer API allows an application to publish a stream of > > records to > > > > one or more Kafka topics. > > > > > > > > ** The Consumer API allows an application to subscribe to one or more > > > > topics and process the stream of records produced to them. > > > > > > > > ** The Streams API allows an application to act as a stream > processor, > > > > consuming an input stream from one or more topics and producing an > > > > output stream to one or more output topics, effectively transforming > > the > > > > input streams to output streams. > > > > > > > > ** The Connector API allows building and running reusable producers > or > > > > consumers that connect Kafka topics to existing applications or data > > > > systems. For example, a connector to a relational database might > > > > capture every change to a table. > > > > > > > > > > > > With these APIs, Kafka can be used for two broad classes of > > application: > > > > > > > > ** Building real-time streaming data pipelines that reliably get data > > > > between systems or applications. > > > > > > > > ** Building real-time streaming applications that transform or react > > > > to the streams of data. > > > > > > > > > > > > Apache Kafka is in use at large and small companies worldwide, > > including > > > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, > > Rabobank, > > > > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > > > > > > A big thank you to the following 146 contributors to this release! > > > > (Please report an unintended omission) > > > > > > > > Abhijeet Kumar, Akhilesh Chaganti, Alieh, Alieh Saeedi, Almog Gavra, > > > > Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew > > > > Schofield, Anna Sophie Blee-Goldman, Anton Agestam, Apoorv Mittal, > > > > Arnout Engelen, Arpit Goyal, Artem Livshits, Ashwin Pankaj, > > > > ashwinpankaj, atu-sharm, bachmanity1, Bob Barrett, Bruno Cadonna, > > > > Calvin Liu, Cerchie, chern, Chris Egerton, Christo Lolov, Colin > > > > Patrick McCabe, Colt McNealy, Crispin Bernier, David Arthur, David > > > > Jacot, David Mao, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, Dongnuo > > > > Lyu, Eaugene Thomas, Eduwer Camacaro, Eike Thaden, Federico Valeri, > > > > Florin Akermann, Gantigmaa Selenge, Gaurav Narula, gongzhongqiang, > > > > Greg Harris, Guozhang Wang, Gyeongwon, Do, Hailey Ni, Hanyu Zheng, > Hao > > > > Li, Hector Geraldino, hudeqi, Ian McDonald, Iblis Lin, Igor Soarez, > > > > iit2009060, Ismael Juma, Jakub Scholz, James Cheng, Jason Gustafson, > > > > Jay Wang, Jeff Kim, Jim Galasyn, John Roesler, Jorge Esteban Quilcate > > > > Otoya, Josep Prat, José Armando García Sancio, Jotaniya Jeel, Jouni > > > > Tenhunen, Jun Rao, Justine Olshan, Kamal Chandraprakash, Kirk True, > > > > kpatelatwork, kumarpritam863, Laglangyue, Levani Kokhreidze, Lianet > > > > Magrans, Liu Zeyu, Lucas Brutschy, Lucia Cerchie, Luke
MirrorMaker + Failover
Hi, When using MirrorMaker for a forwarding flow like A->B, B->C what are the options for handling failure of B so that C could then mirror from A? >From what I can see MirrorMaker has no concept of failover so C cannot failover to A. Can you please confirm this is correct? An option could be having multiple MirrorMaker instances - one to mirror from A and one to mirror from B - that could then be controlled by another process depending on the availability of A or B. Has anyone else had to handle these types of scenarios? Thanks, Mark
Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0
Thank you Stanislav for running the release, especially fixing the whole mess with out of sync site docs in different branches. Really appreciate your hard work on this one. Thank you all contributors! Your contributions is what makes Apache Kafka community awesome <3 There are many impactful changes in this release but the one closest to my heart is https://issues.apache.org/jira/browse/KAFKA-15046. I am very glad this is fixed. The P999 latency spikes were driving me crazy for a long time now. -- Divij Vaidya On Wed, Feb 28, 2024 at 10:06 AM Satish Duggana wrote: > Thanks Stanislav for all your hard work on running the release. Thanks > to all the contributors to this release. > > > On Wed, 28 Feb 2024 at 13:43, Bruno Cadonna wrote: > > > > Thanks Stan and all contributors for the release! > > > > Best, > > Bruno > > > > On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: > > > The Apache Kafka community is pleased to announce the release of > > > Apache Kafka 3.7.0 > > > > > > This is a minor release that includes new features, fixes, and > > > improvements from 296 JIRAs > > > > > > An overview of the release and its notable changes can be found in the > > > release blog post: > > > https://kafka.apache.org/blog#apache_kafka_370_release_announcement > > > > > > All of the changes in this release can be found in the release notes: > > > https://www.apache.org/dist/kafka/3.7.0/RELEASE_NOTES.html > > > > > > You can download the source and binary release (Scala 2.12, 2.13) from: > > > https://kafka.apache.org/downloads#3.7.0 > > > > > > > --- > > > > > > > > > Apache Kafka is a distributed streaming platform with four core APIs: > > > > > > > > > ** The Producer API allows an application to publish a stream of > records to > > > one or more Kafka topics. > > > > > > ** The Consumer API allows an application to subscribe to one or more > > > topics and process the stream of records produced to them. > > > > > > ** The Streams API allows an application to act as a stream processor, > > > consuming an input stream from one or more topics and producing an > > > output stream to one or more output topics, effectively transforming > the > > > input streams to output streams. > > > > > > ** The Connector API allows building and running reusable producers or > > > consumers that connect Kafka topics to existing applications or data > > > systems. For example, a connector to a relational database might > > > capture every change to a table. > > > > > > > > > With these APIs, Kafka can be used for two broad classes of > application: > > > > > > ** Building real-time streaming data pipelines that reliably get data > > > between systems or applications. > > > > > > ** Building real-time streaming applications that transform or react > > > to the streams of data. > > > > > > > > > Apache Kafka is in use at large and small companies worldwide, > including > > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, > Rabobank, > > > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > > > > A big thank you to the following 146 contributors to this release! > > > (Please report an unintended omission) > > > > > > Abhijeet Kumar, Akhilesh Chaganti, Alieh, Alieh Saeedi, Almog Gavra, > > > Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew > > > Schofield, Anna Sophie Blee-Goldman, Anton Agestam, Apoorv Mittal, > > > Arnout Engelen, Arpit Goyal, Artem Livshits, Ashwin Pankaj, > > > ashwinpankaj, atu-sharm, bachmanity1, Bob Barrett, Bruno Cadonna, > > > Calvin Liu, Cerchie, chern, Chris Egerton, Christo Lolov, Colin > > > Patrick McCabe, Colt McNealy, Crispin Bernier, David Arthur, David > > > Jacot, David Mao, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, Dongnuo > > > Lyu, Eaugene Thomas, Eduwer Camacaro, Eike Thaden, Federico Valeri, > > > Florin Akermann, Gantigmaa Selenge, Gaurav Narula, gongzhongqiang, > > > Greg Harris, Guozhang Wang, Gyeongwon, Do, Hailey Ni, Hanyu Zheng, Hao > > > Li, Hector Geraldino, hudeqi, Ian McDonald, Iblis Lin, Igor Soarez, > > > iit2009060, Ismael Juma, Jakub Scholz, James Cheng, Jason Gustafson, > > > Jay Wang, Jeff Kim, Jim Galasyn, John Roesler, Jorge Esteban Quilcate > > > Otoya, Josep Prat, José Armando García Sancio, Jotaniya Jeel, Jouni > > > Tenhunen, Jun Rao, Justine Olshan, Kamal Chandraprakash, Kirk True, > > > kpatelatwork, kumarpritam863, Laglangyue, Levani Kokhreidze, Lianet > > > Magrans, Liu Zeyu, Lucas Brutschy, Lucia Cerchie, Luke Chen, maniekes, > > > Manikumar Reddy, mannoopj, Maros Orsak, Matthew de Detrich, Matthias > > > J. Sax, Max Riedel, Mayank Shekhar Narula, Mehari Beyene, Michael > > > Westerby, Mickael Maison, Nick Telford, Nikhil Ramakrishnan, Nikolay, > > > Okada Haruki, olalamichelle, Omnia G.H Ibrahim, Owen Leung, Paolo > > > Patierno, Philip Nee, Phuc-Hong-Tran, Proven Provenzano, Purshotam > > > Chauhan, Qichao Chu, Matt
Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0
Thanks Stanislav for all your hard work on running the release. Thanks to all the contributors to this release. On Wed, 28 Feb 2024 at 13:43, Bruno Cadonna wrote: > > Thanks Stan and all contributors for the release! > > Best, > Bruno > > On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: > > The Apache Kafka community is pleased to announce the release of > > Apache Kafka 3.7.0 > > > > This is a minor release that includes new features, fixes, and > > improvements from 296 JIRAs > > > > An overview of the release and its notable changes can be found in the > > release blog post: > > https://kafka.apache.org/blog#apache_kafka_370_release_announcement > > > > All of the changes in this release can be found in the release notes: > > https://www.apache.org/dist/kafka/3.7.0/RELEASE_NOTES.html > > > > You can download the source and binary release (Scala 2.12, 2.13) from: > > https://kafka.apache.org/downloads#3.7.0 > > > > --- > > > > > > Apache Kafka is a distributed streaming platform with four core APIs: > > > > > > ** The Producer API allows an application to publish a stream of records to > > one or more Kafka topics. > > > > ** The Consumer API allows an application to subscribe to one or more > > topics and process the stream of records produced to them. > > > > ** The Streams API allows an application to act as a stream processor, > > consuming an input stream from one or more topics and producing an > > output stream to one or more output topics, effectively transforming the > > input streams to output streams. > > > > ** The Connector API allows building and running reusable producers or > > consumers that connect Kafka topics to existing applications or data > > systems. For example, a connector to a relational database might > > capture every change to a table. > > > > > > With these APIs, Kafka can be used for two broad classes of application: > > > > ** Building real-time streaming data pipelines that reliably get data > > between systems or applications. > > > > ** Building real-time streaming applications that transform or react > > to the streams of data. > > > > > > Apache Kafka is in use at large and small companies worldwide, including > > Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, > > Target, The New York Times, Uber, Yelp, and Zalando, among others. > > > > A big thank you to the following 146 contributors to this release! > > (Please report an unintended omission) > > > > Abhijeet Kumar, Akhilesh Chaganti, Alieh, Alieh Saeedi, Almog Gavra, > > Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew > > Schofield, Anna Sophie Blee-Goldman, Anton Agestam, Apoorv Mittal, > > Arnout Engelen, Arpit Goyal, Artem Livshits, Ashwin Pankaj, > > ashwinpankaj, atu-sharm, bachmanity1, Bob Barrett, Bruno Cadonna, > > Calvin Liu, Cerchie, chern, Chris Egerton, Christo Lolov, Colin > > Patrick McCabe, Colt McNealy, Crispin Bernier, David Arthur, David > > Jacot, David Mao, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, Dongnuo > > Lyu, Eaugene Thomas, Eduwer Camacaro, Eike Thaden, Federico Valeri, > > Florin Akermann, Gantigmaa Selenge, Gaurav Narula, gongzhongqiang, > > Greg Harris, Guozhang Wang, Gyeongwon, Do, Hailey Ni, Hanyu Zheng, Hao > > Li, Hector Geraldino, hudeqi, Ian McDonald, Iblis Lin, Igor Soarez, > > iit2009060, Ismael Juma, Jakub Scholz, James Cheng, Jason Gustafson, > > Jay Wang, Jeff Kim, Jim Galasyn, John Roesler, Jorge Esteban Quilcate > > Otoya, Josep Prat, José Armando García Sancio, Jotaniya Jeel, Jouni > > Tenhunen, Jun Rao, Justine Olshan, Kamal Chandraprakash, Kirk True, > > kpatelatwork, kumarpritam863, Laglangyue, Levani Kokhreidze, Lianet > > Magrans, Liu Zeyu, Lucas Brutschy, Lucia Cerchie, Luke Chen, maniekes, > > Manikumar Reddy, mannoopj, Maros Orsak, Matthew de Detrich, Matthias > > J. Sax, Max Riedel, Mayank Shekhar Narula, Mehari Beyene, Michael > > Westerby, Mickael Maison, Nick Telford, Nikhil Ramakrishnan, Nikolay, > > Okada Haruki, olalamichelle, Omnia G.H Ibrahim, Owen Leung, Paolo > > Patierno, Philip Nee, Phuc-Hong-Tran, Proven Provenzano, Purshotam > > Chauhan, Qichao Chu, Matthias J. Sax, Rajini Sivaram, Renaldo Baur > > Filho, Ritika Reddy, Robert Wagner, Rohan, Ron Dagostino, Roon, runom, > > Ruslan Krivoshein, rykovsi, Sagar Rao, Said Boudjelda, Satish Duggana, > > shuoer86, Stanislav Kozlovski, Taher Ghaleb, Tang Yunzi, TapDang, > > Taras Ledkov, tkuramoto33, Tyler Bertrand, vamossagar12, Vedarth > > Sharma, Viktor Somogyi-Vass, Vincent Jiang, Walker Carlson, > > Wuzhengyu97, Xavier Léauté, Xiaobing Fang, yangy, Ritika Reddy, > > Yanming Zhou, Yash Mayya, yuyli, zhaohaidao, Zihao Lin, Ziming Deng > > > > We welcome your help and feedback. For more information on how to > > report problems, and to get involved, visit the project website at > > https://kafka.apache.org/ > > > > Thank you! > > > > > > Regards, > > > > Stanislav
Re: [ANNOUNCE] Apache Kafka 3.7.0
Thanks Stan and all contributors for the release! Best, Bruno On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: The Apache Kafka community is pleased to announce the release of Apache Kafka 3.7.0 This is a minor release that includes new features, fixes, and improvements from 296 JIRAs An overview of the release and its notable changes can be found in the release blog post: https://kafka.apache.org/blog#apache_kafka_370_release_announcement All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/3.7.0/RELEASE_NOTES.html You can download the source and binary release (Scala 2.12, 2.13) from: https://kafka.apache.org/downloads#3.7.0 --- Apache Kafka is a distributed streaming platform with four core APIs: ** The Producer API allows an application to publish a stream of records to one or more Kafka topics. ** The Consumer API allows an application to subscribe to one or more topics and process the stream of records produced to them. ** The Streams API allows an application to act as a stream processor, consuming an input stream from one or more topics and producing an output stream to one or more output topics, effectively transforming the input streams to output streams. ** The Connector API allows building and running reusable producers or consumers that connect Kafka topics to existing applications or data systems. For example, a connector to a relational database might capture every change to a table. With these APIs, Kafka can be used for two broad classes of application: ** Building real-time streaming data pipelines that reliably get data between systems or applications. ** Building real-time streaming applications that transform or react to the streams of data. Apache Kafka is in use at large and small companies worldwide, including Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others. A big thank you to the following 146 contributors to this release! (Please report an unintended omission) Abhijeet Kumar, Akhilesh Chaganti, Alieh, Alieh Saeedi, Almog Gavra, Alok Thatikunta, Alyssa Huang, Aman Singh, Andras Katona, Andrew Schofield, Anna Sophie Blee-Goldman, Anton Agestam, Apoorv Mittal, Arnout Engelen, Arpit Goyal, Artem Livshits, Ashwin Pankaj, ashwinpankaj, atu-sharm, bachmanity1, Bob Barrett, Bruno Cadonna, Calvin Liu, Cerchie, chern, Chris Egerton, Christo Lolov, Colin Patrick McCabe, Colt McNealy, Crispin Bernier, David Arthur, David Jacot, David Mao, Deqi Hu, Dimitar Dimitrov, Divij Vaidya, Dongnuo Lyu, Eaugene Thomas, Eduwer Camacaro, Eike Thaden, Federico Valeri, Florin Akermann, Gantigmaa Selenge, Gaurav Narula, gongzhongqiang, Greg Harris, Guozhang Wang, Gyeongwon, Do, Hailey Ni, Hanyu Zheng, Hao Li, Hector Geraldino, hudeqi, Ian McDonald, Iblis Lin, Igor Soarez, iit2009060, Ismael Juma, Jakub Scholz, James Cheng, Jason Gustafson, Jay Wang, Jeff Kim, Jim Galasyn, John Roesler, Jorge Esteban Quilcate Otoya, Josep Prat, José Armando García Sancio, Jotaniya Jeel, Jouni Tenhunen, Jun Rao, Justine Olshan, Kamal Chandraprakash, Kirk True, kpatelatwork, kumarpritam863, Laglangyue, Levani Kokhreidze, Lianet Magrans, Liu Zeyu, Lucas Brutschy, Lucia Cerchie, Luke Chen, maniekes, Manikumar Reddy, mannoopj, Maros Orsak, Matthew de Detrich, Matthias J. Sax, Max Riedel, Mayank Shekhar Narula, Mehari Beyene, Michael Westerby, Mickael Maison, Nick Telford, Nikhil Ramakrishnan, Nikolay, Okada Haruki, olalamichelle, Omnia G.H Ibrahim, Owen Leung, Paolo Patierno, Philip Nee, Phuc-Hong-Tran, Proven Provenzano, Purshotam Chauhan, Qichao Chu, Matthias J. Sax, Rajini Sivaram, Renaldo Baur Filho, Ritika Reddy, Robert Wagner, Rohan, Ron Dagostino, Roon, runom, Ruslan Krivoshein, rykovsi, Sagar Rao, Said Boudjelda, Satish Duggana, shuoer86, Stanislav Kozlovski, Taher Ghaleb, Tang Yunzi, TapDang, Taras Ledkov, tkuramoto33, Tyler Bertrand, vamossagar12, Vedarth Sharma, Viktor Somogyi-Vass, Vincent Jiang, Walker Carlson, Wuzhengyu97, Xavier Léauté, Xiaobing Fang, yangy, Ritika Reddy, Yanming Zhou, Yash Mayya, yuyli, zhaohaidao, Zihao Lin, Ziming Deng We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kafka.apache.org/ Thank you! Regards, Stanislav Kozlovski Release Manager for Apache Kafka 3.7.0
