Build failed in Jenkins: kafka-2.1-jdk8 #210

See Changes: [rhauch] KAFKA-6605: Fix NPE in Flatten when optional Struct is null (#5705) [matthias] KAFKA-8637: WriteBatch objects leak off-heap memory [rhauch] KAFKA-7157: Fix handling of nulls in

Build failed in Jenkins: kafka-trunk-jdk8 #3784

See Changes: [bbejeck] Fixes #8198 KStreams testing docs use non-existent method pipe (#6678) [rhauch] KAFKA-6605: Fix NPE in Flatten when optional Struct is null (#5705) [rhauch] KAFKA-7157: Fix handling of

Build failed in Jenkins: kafka-2.3-jdk8 #61

See Changes: [rhauch] KAFKA-6605: Fix NPE in Flatten when optional Struct is null (#5705) [rhauch] KAFKA-7157: Fix handling of nulls in TimestampConverter (#7070) [matthias] HOT FIX: close RocksDB objects in

[jira] [Resolved] (KAFKA-8614) Rename the `responses` field of IncrementalAlterConfigsResponse to match AlterConfigs

[ https://issues.apache.org/jira/browse/KAFKA-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8614. Resolution: Fixed > Rename the `responses` field of IncrementalAlterConfigsResponse to

Re: [DISCUSS] KIP-487: Automatic Topic Creation on Producer

Just a quick update-- It seems that enabling both the broker and producer configs works fine, except that the broker configurations for partitions, replication factor take precedence. I don't know if that is something we would want to change, but I'll be updating the KIP for now to reflect this.

Request for permission to create a KIP

Hi, I'm planning to create a KIP titled "Add keymanager and trustmanager security providers in Kafka Security config". My wiki id is mprsai. Please grant me permissions to create one. -- Thanks, M.Sai Sandeep

Build failed in Jenkins: kafka-2.0-jdk8 #284

See Changes: [rhauch] KAFKA-6605: Fix NPE in Flatten when optional Struct is null (#5705) [rhauch] KAFKA-7157: Fix handling of nulls in TimestampConverter (#7070) --

Build failed in Jenkins: kafka-2.3-jdk8 #60

See Changes: [bill] KAFKA-5998: fix checkpointableOffsets handling (#7030) [bill] Fixes #8198 KStreams testing docs use non-existent method pipe (#6678) -- [...truncated

Re: [DISCUSS] KIP-480 : Sticky Partitioner

Hi Colin, The first thing that comes to mind is AlwaysStickyPartitioner, but maybe I could think about it a bit more and come up with something better. The only reason why I hesitate about the RoundRobin part is that it doesn't really distinguish that this partitioner will have this behavior on

Jenkins build is back to normal : kafka-2.1-jdk8 #209

See

Re: [VOTE] KIP-488: Clean up Sum,Count,Total Metrics

John, I'm glad to learn I'm not the only one who's re-read the metrics code multiple times. I do wonder if the proposed names could be improved further though, given that "sum", "total", and "count" are roughly synonymous. I'm already scratching my head at what "TotalSum" means. It's clear in the

Re: [VOTE] KIP-476: Add Java AdminClient interface

Awesome sauce - so I'd like to close the voting. final vote was: 4 for binding, none against 3 non-binding, none against. I'll update the KIP to reflect the passing of the vote. Thanks you all for your time & brain power, Andy On Thu, 11 Jul 2019 at 14:51, Rajini Sivaram wrote: > +1

Jenkins build is back to normal : kafka-2.2-jdk8 #145

See

Re: [VOTE] KIP-488: Clean up Sum,Count,Total Metrics

Thanks for the KIP, seems like a good change. +1 (binding) -Bill On Fri, Jul 12, 2019 at 2:47 PM Bruno Cadonna wrote: > Hi John, > > +1 (non-binding) > > Best, > Bruno > > On Fri, Jul 12, 2019 at 8:45 PM John Roesler wrote: > > > > Hi Kafka devs, > > > > Yesterday, I proposed KIP-488 as a

Re: [VOTE] KIP-488: Clean up Sum,Count,Total Metrics

Hi John, +1 (non-binding) Best, Bruno On Fri, Jul 12, 2019 at 8:45 PM John Roesler wrote: > > Hi Kafka devs, > > Yesterday, I proposed KIP-488 as a minor cleanup of some of our metric > implementations. > > KIP-488: https://cwiki.apache.org/confluence/x/kkAyBw > > The change seems pretty

JIRA and KIP contributor permissions

Hi developers, I would like to be a contributor to the Apache Kafka project. I would like to have permissions on the KIP wiki and JIRAs (to be able to assign tickets to myself). Please grant me these permissions. JIRA username: wyuka Confluence username: tirtha.p.chatterjee Github username:

Re: [DISCUSS] KIP-480 : Sticky Partitioner

On Fri, Jul 12, 2019, at 09:02, Justine Olshan wrote: > Hello all, > > Jun, thanks for taking a look at my KIP! We were also concerned about > batches containing a single record so we kept this in mind for the > implementation. The decision to switch the sticky partition actually > involves

[VOTE] KIP-488: Clean up Sum,Count,Total Metrics

Hi Kafka devs, Yesterday, I proposed KIP-488 as a minor cleanup of some of our metric implementations. KIP-488: https://cwiki.apache.org/confluence/x/kkAyBw The change seems pretty uncontroversial, so I'm just going to open the vote now. Feel free to veto or just request more discussion if you

Re: [DISCUSS] KIP-488: Clean up Sum,Count,Total Metrics

Hey, thanks Matthias and Bruno, I agree, "Cumulative" is a mouthful. "TotalX" sounds fine to me. Also, yes, I would have liked to not have any modifier for "non-sampled", but there is a name conflict with Sum. I'll update the KIP to reflect "TotalX" and then start the vote thread. Thanks

Build failed in Jenkins: kafka-2.0-jdk8 #283

See Changes: [bill] Fixes #8198 KStreams testing docs use non-existent method pipe (#6678) -- [...truncated 440.40 KB...] kafka.server.KafkaConfigTest >

[jira] [Resolved] (KAFKA-7157) Connect TimestampConverter SMT doesn't handle null values

[ https://issues.apache.org/jira/browse/KAFKA-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-7157. -- Resolution: Fixed Fix Version/s: 2.3.1 2.4.0 2.2.2

[jira] [Resolved] (KAFKA-8643) Incompatible MemberDescription constructor change

[ https://issues.apache.org/jira/browse/KAFKA-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8643. Resolution: Fixed > Incompatible MemberDescription constructor change >

Build failed in Jenkins: kafka-trunk-jdk8 #3783

See Changes: [bbejeck] KAFKA-5998: fix checkpointableOffsets handling (#7030) -- [...truncated 2.70 MB...]

Re: [VOTE] KIP-484: Expose metrics for group and transaction metadata loading duration

+1 Thanks for the KIP! -Jason On Fri, Jul 12, 2019 at 9:59 AM Gwen Shapira wrote: > +1 (binding) > > Looks great to me. Thank you for the KIP. > > On Mon, Jul 8, 2019 at 8:37 AM Anastasia Vela wrote: > > > > Hi, > > > > I'd like to start a vote thread for KIP-484. This addition will provide >

[jira] [Resolved] (KAFKA-6605) Flatten SMT does not properly handle fields that are null

[ https://issues.apache.org/jira/browse/KAFKA-6605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-6605. -- Resolution: Fixed Reviewer: Randall Hauch Fix Version/s: 2.3.1

Re: [VOTE] KIP-480 : Sticky Partitioner

+1 (binding) Thank you for the KIP. This was long awaited. On Tue, Jul 9, 2019 at 5:15 PM Justine Olshan wrote: > > Hello all, > > I'd like to start the vote for KIP-480 : Sticky Partitioner. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-480%3A+Sticky+Partitioner > > Thank you, >

Re: [VOTE] KIP-484: Expose metrics for group and transaction metadata loading duration

+1 (binding) Looks great to me. Thank you for the KIP. On Mon, Jul 8, 2019 at 8:37 AM Anastasia Vela wrote: > > Hi, > > I'd like to start a vote thread for KIP-484. This addition will provide > visibility for how long partitions take to load in order to understand some > inactivity seen in the

Re: [DISCUSS] KIP-487: Automatic Topic Creation on Producer

Hi Colin, Thanks for looking at the KIP. I can definitely add to the title to make it more clear. It makes sense that both configurations could be turned on since there are many cases where the user can not control the server-side configurations. I was a little concerned about how both

Re: [DISCUSS] KIP-488: Clean up Sum,Count,Total Metrics

OK, makes sense. Then, I am in favour of TotalCount and TotalSum. Best, Bruno On Fri, Jul 12, 2019 at 12:57 AM Matthias J. Sax wrote: > > `Sum` is an existing name, for the "sampled sum" metric, that gets > deprecated. Hence, we cannot use it. > > If we cannot use `Sum` and use `TotalSum`, we

Re: [DISCUSS] KIP-480 : Sticky Partitioner

Hello all, Jun, thanks for taking a look at my KIP! We were also concerned about batches containing a single record so we kept this in mind for the implementation. The decision to switch the sticky partition actually involves returning from the record accumulator and assigning the new partition

[jira] [Created] (KAFKA-8661) Flaky Test RebalanceSourceConnectorsIntegrationTest#testStartTwoConnectors

Matthias J. Sax created KAFKA-8661: -- Summary: Flaky Test RebalanceSourceConnectorsIntegrationTest#testStartTwoConnectors Key: KAFKA-8661 URL: https://issues.apache.org/jira/browse/KAFKA-8661

Re: Requesting Contributor Permissions

Hi Manish, If you do a search for tasks with the label "newbie" you'll find tickets that are great for making your first contribution(s) Thanks, Bill On Fri, Jul 12, 2019 at 11:39 AM Manish G wrote: > Hi all, > > I am a newbie here, so not sure if I can work on tickets straightaway. But > if

Re: Requesting Contributor Permissions

Hi all, I am a newbie here, so not sure if I can work on tickets straightaway. But if someone need helping hand on stuffs like writing java unit tests, I am always available. MCG On Fri, Jul 12, 2019, 8:55 PM Jun Rao wrote: > Hi, Ankit, > > Thanks for your interest. Just added you to the

Re: Requesting Contributor Permissions

Hi, Ankit, Thanks for your interest. Just added you to the contributor list. Jun On Fri, Jul 12, 2019 at 8:23 AM Ankit Choudhary wrote: > Hey Team, > > This is Ankit. I work as a Customer Operations Engineer in Cloudera, > extensively working with Kafka and other related components. And I

Requesting Contributor Permissions

Hey Team, This is Ankit. I work as a Customer Operations Engineer in Cloudera, extensively working with Kafka and other related components. And I would love to join Apache Kafka community to learn and contribute as much as possible. >> Please approve my request by granting Contributor

[jira] [Resolved] (KAFKA-8198) KStreams testing docs use non-existent method "pipe"

[ https://issues.apache.org/jira/browse/KAFKA-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8198. Resolution: Fixed > KStreams testing docs use non-existent method "pipe" >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

Hello, Kind reminder about this KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-221%3A+Enhance+KStream+with+Connecting+Topic+Creation+and+Repartition+Hint

[jira] [Created] (KAFKA-8660) Make ValueToKey SMT work only on a whitelist of topics

Marc Löhe created KAFKA-8660: Summary: Make ValueToKey SMT work only on a whitelist of topics Key: KAFKA-8660 URL: https://issues.apache.org/jira/browse/KAFKA-8660 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-5998) /.checkpoint.tmp Not found exception

[ https://issues.apache.org/jira/browse/KAFKA-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-5998. Resolution: Fixed > /.checkpoint.tmp Not found exception > >

Re: [DISCUSS] KIP-213: Second follow-up on Foreign Key Joins

@Matthias J. Sax - Thoughts on the semantics of simply leaving it as-is, with the extra tombstones? As John put it: "It may be unnecessary to "delete" a non-existant record from a view, but it's never incorrect." It may not be ideal, but the complexity of eliminating it seems to be high and

Build failed in Jenkins: kafka-trunk-jdk8 #3782

See Changes: [jason] KAFKA-8643; Bring back public MemberDescription constructor (#7060) -- [...truncated 2.55 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

On 12.07.2019 12:05, Stanislav Kozlovski wrote: > We will > not support fetching the progress of any particular reassignment call from > the server-side. If the client is interested in a particular reassignment's > progress, it should know what that reassignment consisted of and query > those

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

Hey Jan, We will support multiple Admin APIs that can fetch on-going assignments at different granularities, regardless of which (JVM) process scheduled it. If a process doesn't know which partitions/topics are being reassigned, it can ask for all on-going reassignments in the Kafka cluster. You

[jira] [Resolved] (KAFKA-6882) Wrong producer settings may lead to DoS on Kafka Server

[ https://issues.apache.org/jira/browse/KAFKA-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seweryn Habdank-Wojewodzki resolved KAFKA-6882. --- Resolution: Won't Fix As there are no improvment proposals I am

Re: Broker Startup Time (Prolonged URPs)

Hi All,  Does anyone have any thoughts on this? Many Thanks,  Jamie -Original Message- From: Jamie To: dev ; users Sent: Mon, 8 Jul 2019 18:38 Subject: Broker Startup Time (Prolonged URPs) Hi All, I'm currently doing some work into investigating why our Kafka deployment has a

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

Great KIP, pure java cruise-control would be a nice thing to have <3 I just want to ask what the opinions are on a way to get the Futures of the assignment back. Say accross JVms. Best Jan On 02.07.2019 19:47, Stanislav Kozlovski wrote: > Hey there, I need to start a new thread on KIP-455. I

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

Hello again, I've further iterated on the design and I think that we can restart the vote soon if there are no major comments. I have again edited the KIP. Key changes are: - Use the `topics/[topic]` znode to store desired reassignments. There were thoughts that we could not update the

Jenkins build is back to normal : kafka-trunk-jdk8 #3781

See

[jira] [Created] (KAFKA-8659) SetSchemaMetadata SMT fails on records with null value and schema

Marc Löhe created KAFKA-8659: Summary: SetSchemaMetadata SMT fails on records with null value and schema Key: KAFKA-8659 URL: https://issues.apache.org/jira/browse/KAFKA-8659 Project: Kafka

[jira] [Created] (KAFKA-8658) A way to configure the jmx rmi port

Agostino Sarubbo created KAFKA-8658: --- Summary: A way to configure the jmx rmi port Key: KAFKA-8658 URL: https://issues.apache.org/jira/browse/KAFKA-8658 Project: Kafka Issue Type: