Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-22 Thread Greg Harris
or config. FWIW I'd be fine with GET > /connector-plugins//versions as a first-class endpoint either > instead of or in addition to adding recommended values for all plugin > versions. > > Thanks for your continued work on this KIP, and with the progress we're > making I'm opt

[jira] [Created] (KAFKA-16809) Run javadoc build in CI

2024-05-21 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16809: --- Summary: Run javadoc build in CI Key: KAFKA-16809 URL: https://issues.apache.org/jira/browse/KAFKA-16809 Project: Kafka Issue Type: Task Components

Re: [DISCUSS] KIP-1042 support for wildcard when creating new acls

2024-05-21 Thread Greg Harris
rdinality value of each > > Bloom filter can be used instead. You can then check the smaller filters > > against the larger ones and find where one candidate is contained within > > another. > > > > If you want to know if they intersect the BloomFilter from > >

[jira] [Resolved] (KAFKA-16197) Connect Worker poll timeout prints Consumer poll timeout specific warnings.

2024-05-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16197. - Fix Version/s: 3.8.0 Resolution: Fixed > Connect Worker poll timeout prints Consu

[jira] [Created] (KAFKA-16806) Explicitly declare JUnit dependencies for all test modules

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16806: --- Summary: Explicitly declare JUnit dependencies for all test modules Key: KAFKA-16806 URL: https://issues.apache.org/jira/browse/KAFKA-16806 Project: Kafka

[jira] [Created] (KAFKA-16805) Stop using a ClosureBackedAction to configure Spotbugs reports

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16805: --- Summary: Stop using a ClosureBackedAction to configure Spotbugs reports Key: KAFKA-16805 URL: https://issues.apache.org/jira/browse/KAFKA-16805 Project: Kafka

[jira] [Created] (KAFKA-16804) Replace gradle archivesBaseName with archivesName

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16804: --- Summary: Replace gradle archivesBaseName with archivesName Key: KAFKA-16804 URL: https://issues.apache.org/jira/browse/KAFKA-16804 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16803) Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16803: --- Summary: Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil Key: KAFKA-16803 URL: https://issues.apache.org/jira/browse/KAFKA-16803 Project

[jira] [Created] (KAFKA-16802) Move build.gradle java version information inside of a java block

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16802: --- Summary: Move build.gradle java version information inside of a java block Key: KAFKA-16802 URL: https://issues.apache.org/jira/browse/KAFKA-16802 Project: Kafka

[jira] [Created] (KAFKA-16801) Streams upgrade :test target doesn't find any junit tests

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16801: --- Summary: Streams upgrade :test target doesn't find any junit tests Key: KAFKA-16801 URL: https://issues.apache.org/jira/browse/KAFKA-16801 Project: Kafka

[jira] [Created] (KAFKA-16800) Resolve Gradle 9.0 deprecations

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16800: --- Summary: Resolve Gradle 9.0 deprecations Key: KAFKA-16800 URL: https://issues.apache.org/jira/browse/KAFKA-16800 Project: Kafka Issue Type: Task

Re: please let me subscribe

2024-05-16 Thread Greg Harris
Hi Harry, Thanks for your interest in Apache Kafka. You can see how to subscribe to the mailing list(s) here: https://kafka.apache.org/contact Please note that the email for subscribing/unsubscribing is different from the one used for sending and receiving emails once you're on the list. Also,

[jira] [Created] (KAFKA-16776) Builds flaky-failing with leaked client-metrics-reaper thread

2024-05-15 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16776: --- Summary: Builds flaky-failing with leaked client-metrics-reaper thread Key: KAFKA-16776 URL: https://issues.apache.org/jira/browse/KAFKA-16776 Project: Kafka

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-15 Thread Greg Harris
wo instances of the same transform or predicate, but > with different versions for each? (I don't think this is worth significant > design/implementation effort, so if it would inflate either of those, > please don't feel obligated to support it.) > > 3) Just out of curiosity, why double-ding

[jira] [Created] (KAFKA-16768) SocketServer leaks accepted SocketChannel instances due to race condition

2024-05-14 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16768: --- Summary: SocketServer leaks accepted SocketChannel instances due to race condition Key: KAFKA-16768 URL: https://issues.apache.org/jira/browse/KAFKA-16768 Project

[jira] [Created] (KAFKA-16765) NioEchoServer leaks accepted SocketChannel instances due to race condition

2024-05-14 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16765: --- Summary: NioEchoServer leaks accepted SocketChannel instances due to race condition Key: KAFKA-16765 URL: https://issues.apache.org/jira/browse/KAFKA-16765 Project

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-14 Thread Greg Harris
TestPlugins class or somewhere > in its neighborhood to the testing plan; unfamiliar readers probably won't > get much out of what's there right now. > > [1] - > https://cwiki.apache.org/confluence/display/KAFKA/KIP-769%3A+Connect+APIs+to+list+all+connector+plugins+and+retrieve+their+configuration+

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-13 Thread Greg Harris
cation on this topic. > Again, thank you for sharing your concerns about balancing this proposal > against the impact to the ecosystem. We think the additional performance that > this could provide along with the improved flexibility to add or accelerate > compression codecs outweighs the

[jira] [Created] (KAFKA-16739) Exclude protected variables from aggregated JavaDocs

2024-05-13 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16739: --- Summary: Exclude protected variables from aggregated JavaDocs Key: KAFKA-16739 URL: https://issues.apache.org/jira/browse/KAFKA-16739 Project: Kafka Issue

[jira] [Created] (KAFKA-16703) SocketServer leaks ServerSocketChannel when port is already in-use

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16703: --- Summary: SocketServer leaks ServerSocketChannel when port is already in-use Key: KAFKA-16703 URL: https://issues.apache.org/jira/browse/KAFKA-16703 Project: Kafka

[jira] [Created] (KAFKA-16702) KafkaLog4jAppenderTest leaks producer instances

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16702: --- Summary: KafkaLog4jAppenderTest leaks producer instances Key: KAFKA-16702 URL: https://issues.apache.org/jira/browse/KAFKA-16702 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16701) Some SocketServerTest buffered close tests flaky failing locally

2024-05-10 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16701: --- Summary: Some SocketServerTest buffered close tests flaky failing locally Key: KAFKA-16701 URL: https://issues.apache.org/jira/browse/KAFKA-16701 Project: Kafka

Re: [DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-10 Thread Greg Harris
's okay with you, I would still like to get this > implemented myself, including the additional scope. > > Thanks and regards > Snehashis > > On Fri, May 10, 2024 at 12:45 AM Greg Harris > wrote: > > > Hi all, > > > > I'd like to reboot the discussion on

[DISCUSS] KIP-891: Running multiple versions of Connector plugins

2024-05-09 Thread Greg Harris
, transforms, and predicates) not just connectors & tasks 2. Specifying a range of versions instead of an exact match 3. New metrics to observe what versions are in-use Thanks to Snehashis for the original KIP idea! Thanks, Greg On Tue, Jan 2, 2024 at 11:49 AM Greg Harris wrote: > > Hi

[jira] [Resolved] (KAFKA-16356) Remove class-name dispatch in RemoteLogMetadataSerde

2024-05-06 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16356. - Fix Version/s: 3.8.0 Resolution: Fixed > Remove class-name dispa

Re: [DISCUSS] KIP-1042 support for wildcard when creating new acls

2024-05-06 Thread Greg Harris
Hi Murali, Thanks for the KIP! I think I understand the motivation for this KIP in situations where there are a "cross product" of topics for two or more variables X and Y, and want to write ACLs for each of the variable axes. If you format your topics "X-Y-suffix", it's not easy to write rules

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-05-01 Thread Greg Harris
t; > > 4. Passing the class name as metadata is one way to have the producer > > talk to the broker about which plugin to use. However there could be > > other implementation > >where you could set every thing to know about the topic using topic > > level compress

Re: [VOTE] KIP-477: Add PATCH method for connector config in Connect REST API

2024-05-01 Thread Greg Harris
Hi Ivan, Thank you for the KIP! I think PATCH using the same return type as PUT benefits the clients, even though the "created" field will always be false. +1 (binding) Thanks, Greg On Fri, Apr 12, 2024 at 4:31 AM Yash Mayya wrote: > > Hi Ivan, > > Thanks for reviving this KIP, I think it

[jira] [Created] (KAFKA-16643) Add ModifierOrder checkstyle rule

2024-04-29 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16643: --- Summary: Add ModifierOrder checkstyle rule Key: KAFKA-16643 URL: https://issues.apache.org/jira/browse/KAFKA-16643 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-16641) MM2 offset translation should interpolate between sparse OffsetSyncs

2024-04-29 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16641: --- Summary: MM2 offset translation should interpolate between sparse OffsetSyncs Key: KAFKA-16641 URL: https://issues.apache.org/jira/browse/KAFKA-16641 Project: Kafka

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

2024-04-01 Thread Greg Harris
t there would be a ton of conflicts so it might be > best to start over and use it as a guide. I can work on a new PR once we > are all on the same page. I don't think it would take too long to put > together since most of the work is just dependency updates and package > renaming.

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

2024-03-29 Thread Greg Harris
>= 3.0. The upgrade for Kafka could be very similar and not incur a major version release. We can leave some time to hear from anyone else that is impacted by this change, but from the open source projects present on github, this LGTM. Thanks, Greg On Fri, Mar 29, 2024 at 5:27 PM Greg Harris wrot

Re: [DISCUSS] KIP-1032: Upgrade to Jakarta and JavaEE 9 in Kafka 4.0

2024-03-29 Thread Greg Harris
Hi Chris, Thank you so much for opening this KIP, and making sure Kafka keeps up with the rest of the Java ecosystem! I took a look around at some Open Source connector implementations, and checked their Java version support: * The Aiven connect plugins (http, bigquery, jdbc, elasticsearch,

[jira] [Created] (KAFKA-16450) Add thread-safe alternative to Exit

2024-03-29 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16450: --- Summary: Add thread-safe alternative to Exit Key: KAFKA-16450 URL: https://issues.apache.org/jira/browse/KAFKA-16450 Project: Kafka Issue Type: Task

[jira] [Resolved] (KAFKA-16349) ShutdownableThread fails build by calling Exit with race condition

2024-03-28 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16349. - Fix Version/s: 3.8.0 Assignee: Greg Harris Resolution: Fixed

Re: [VOTE] KIP-981: Manage Connect topics with custom implementation of Admin

2024-03-27 Thread Greg Harris
KIP appearing as a follow-up to KIP-787 is evidence that the > > problem is more general than the proposed solution. > As KIP-787 is built based on the idea that having a class delegate resource > management to AdminClient isn’t new to Kafka what would your suggestion means > fo

Re: [DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

2024-03-26 Thread Greg Harris
of life doesn't make > sense to me. I know that Connect supports isolated classloaders for > connectors but that of course is not the same as different Java versions. > > Chris > > On Tue, Mar 26, 2024 at 11:33 AM Greg Harris > wrote: > > > Hi Christopher! > > &

Re: [DISCUSS] Jakarta and Java EE 9/10 support in Kafka 4.0

2024-03-26 Thread Greg Harris
Hi Christopher! Thanks so much for raising this. I agree that we should move to the new namespace in 4.0, and not doing so would be a mistake. This breaking change has a lot of benefits, and the only cost I am aware of is that ConnectRestExtensions will need to be migrated, rebuilt, and

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-03-25 Thread Greg Harris
hank you. > > Luke > > > > On Sat, Mar 23, 2024 at 1:24 PM Arpit Goyal > > wrote: > > > > > Hi Team, > > > Any further comments or suggestions on the possible approaches discussed > > > above. > > > > > > On Tue, Mar 19, 2024

[jira] [Created] (KAFKA-16421) Refactor CommandDefaultOptions subclasses to throw exceptions instead of calling exit.

2024-03-25 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16421: --- Summary: Refactor CommandDefaultOptions subclasses to throw exceptions instead of calling exit. Key: KAFKA-16421 URL: https://issues.apache.org/jira/browse/KAFKA-16421

[jira] [Created] (KAFKA-16420) Replace utils.Exit with a thread-safe alternative

2024-03-25 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16420: --- Summary: Replace utils.Exit with a thread-safe alternative Key: KAFKA-16420 URL: https://issues.apache.org/jira/browse/KAFKA-16420 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16410) kafka-leader-election / LeaderElectionCommand doesn't set exit code on error

2024-03-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16410: --- Summary: kafka-leader-election / LeaderElectionCommand doesn't set exit code on error Key: KAFKA-16410 URL: https://issues.apache.org/jira/browse/KAFKA-16410 Project

[jira] [Created] (KAFKA-16409) kafka-delete-records / DeleteRecordsCommand should use standard exception handling

2024-03-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16409: --- Summary: kafka-delete-records / DeleteRecordsCommand should use standard exception handling Key: KAFKA-16409 URL: https://issues.apache.org/jira/browse/KAFKA-16409

[jira] [Created] (KAFKA-16408) kafka-get-offsets / GetOffsetShell doesn't handle --version or --help

2024-03-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16408: --- Summary: kafka-get-offsets / GetOffsetShell doesn't handle --version or --help Key: KAFKA-16408 URL: https://issues.apache.org/jira/browse/KAFKA-16408 Project: Kafka

[jira] [Resolved] (KAFKA-16354) FinalizedFeatureChangeListenerTest should use mocked latches

2024-03-22 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16354. - Resolution: Won't Fix > FinalizedFeatureChangeListenerTest should use mocked latc

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-03-14 Thread Greg Harris
gt; Proposed > > /** > * @return Producer snapshot file until this segment. > */ > public Optional producerSnapshotIndex() { > return producerSnapshotIndex; > } > > > Thanks and Regards > Arpit Goyal > 8861094754 > > > On Wed, Mar 13, 2024 at 9:25 PM Gr

Re: [VOTE] KIP-981: Manage Connect topics with custom implementation of Admin

2024-03-14 Thread Greg Harris
Hi Omnia, Thanks for the KIP. I don't think we can adapt the ForwardingAdmin as-is for use as a first-class Connect plugin. 1. It doesn't have a default constructor, and so can't be included in the existing plugin discovery mechanisms. 2. It doesn't implement Versioned, and so won't have version

Re: [DISCUSS] KIP-1026: Handling producer snapshot when upgrading from < v2.8.0 for Tiered Storage

2024-03-13 Thread Greg Harris
Hi Arpit, Thanks for the KIP! I am not familiar with the necessity of producer snapshots, but your explanation sounds like this should be made optional. Can you expand the KIP to include the changes that need to be made to the constructor and getter, and explain more about backwards

[jira] [Created] (KAFKA-16364) MM2 High-Resolution Offset Translation

2024-03-11 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16364: --- Summary: MM2 High-Resolution Offset Translation Key: KAFKA-16364 URL: https://issues.apache.org/jira/browse/KAFKA-16364 Project: Kafka Issue Type: New Feature

[jira] [Created] (KAFKA-16362) Fix type-unsafety in KStreamKStreamJoin caused by isLeftSide

2024-03-11 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16362: --- Summary: Fix type-unsafety in KStreamKStreamJoin caused by isLeftSide Key: KAFKA-16362 URL: https://issues.apache.org/jira/browse/KAFKA-16362 Project: Kafka

[jira] [Created] (KAFKA-16356) Remove class-name dispatch in RemoteLogMetadataSerde

2024-03-08 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16356: --- Summary: Remove class-name dispatch in RemoteLogMetadataSerde Key: KAFKA-16356 URL: https://issues.apache.org/jira/browse/KAFKA-16356 Project: Kafka Issue

[jira] [Created] (KAFKA-16354) FinalizedFeatureChangeListenerTest should use mocked latches

2024-03-07 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16354: --- Summary: FinalizedFeatureChangeListenerTest should use mocked latches Key: KAFKA-16354 URL: https://issues.apache.org/jira/browse/KAFKA-16354 Project: Kafka

[jira] [Created] (KAFKA-16349) ShutdownableThread fails build by calling Exit with race condition

2024-03-06 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16349: --- Summary: ShutdownableThread fails build by calling Exit with race condition Key: KAFKA-16349 URL: https://issues.apache.org/jira/browse/KAFKA-16349 Project: Kafka

[jira] [Resolved] (KAFKA-16288) Values.convertToDecimal throws ClassCastExceptions on String inputs

2024-03-06 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16288. - Fix Version/s: 3.8.0 Resolution: Fixed > Values.convertToDecimal thr

[jira] [Resolved] (KAFKA-10582) Mirror Maker 2 not replicating new topics until restart

2024-03-04 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-10582. - Fix Version/s: 3.5.0 Resolution: Fixed > Mirror Maker 2 not replicating new topics un

[jira] [Created] (KAFKA-16303) Add upgrade notes about recent MM2 offset translation changes

2024-02-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16303: --- Summary: Add upgrade notes about recent MM2 offset translation changes Key: KAFKA-16303 URL: https://issues.apache.org/jira/browse/KAFKA-16303 Project: Kafka

[jira] [Resolved] (KAFKA-6675) Connect workers should log plugin path and available plugins more clearly

2024-02-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-6675. Fix Version/s: 3.6.0 Assignee: Greg Harris (was: Valeria Vasylieva) Resolution

[jira] [Created] (KAFKA-16289) Values.parseString on heterogeneous lists and maps sometimes corrupts data by inferring incorrect schema

2024-02-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16289: --- Summary: Values.parseString on heterogeneous lists and maps sometimes corrupts data by inferring incorrect schema Key: KAFKA-16289 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-16288) Values.convertToDecimal throws ClassCastExceptions on String inputs

2024-02-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16288: --- Summary: Values.convertToDecimal throws ClassCastExceptions on String inputs Key: KAFKA-16288 URL: https://issues.apache.org/jira/browse/KAFKA-16288 Project: Kafka

Re: Seeking Assistance with MM2 Rest API Configuration - Encountering 404 Error

2024-02-18 Thread Greg Harris
Hi Aaron, This is the expected behavior of KIP-710. The relevant section reproduced here: > Enabling a single Connect REST server in the MirrorMaker 2.0 node, only supporting the internal Connect endpoints. The endpoints that are typically exposed in a distributed Connect for creating

Re: DISCUSS KIP-984 Add pluggable compression interface to Kafka

2024-02-14 Thread Greg Harris
Hi Assane, Thanks for the KIP! Looking back, it appears that the project has only ever added compression types twice: lz4 in 2014 and zstd in 2018, and perhaps Kafka has fallen behind the state-of-the-art compression algorithms. Thanks for working to fix that! I do have some concerns: 1. I

[jira] [Resolved] (KAFKA-15407) Not able to connect to kafka from the Private NLB from outside the VPC account

2024-02-14 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15407. - Resolution: Invalid > Not able to connect to kafka from the Private NLB from outside the

[jira] [Resolved] (KAFKA-10735) Kafka producer producing corrupted avro values when confluent cluster is recreated and producer application is not restarted

2024-02-14 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-10735. - Resolution: Cannot Reproduce Hi, since this doesn't contain any Apache Kafka code, and doesn't

[jira] [Resolved] (KAFKA-10719) MirrorMaker2 fails to update its runtime configuration

2024-02-14 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-10719. - Fix Version/s: 3.7.0 3.6.2 Resolution: Fixed > MirrorMaker2 fa

[jira] [Created] (KAFKA-16257) SchemaProjector should be extensible to logical types

2024-02-14 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16257: --- Summary: SchemaProjector should be extensible to logical types Key: KAFKA-16257 URL: https://issues.apache.org/jira/browse/KAFKA-16257 Project: Kafka Issue

[jira] [Resolved] (KAFKA-9376) Plugin class loader not found using MM2

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-9376. Fix Version/s: 2.5.0 Resolution: Fixed > Plugin class loader not found using

[jira] [Resolved] (KAFKA-7217) Loading dynamic topic data into kafka connector sink using regex

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-7217. Fix Version/s: 1.1.0 Resolution: Fixed > Loading dynamic topic data into kafka connec

[jira] [Resolved] (KAFKA-6340) Support of transactions in KafkaConnect

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-6340. Fix Version/s: 3.3.0 Resolution: Fixed > Support of transactions in KafkaConn

[jira] [Resolved] (KAFKA-4961) Mirrormaker crash with org.apache.kafka.common.protocol.types.SchemaException

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-4961. Resolution: Won't Fix > Mirrormaker cr

[jira] [Resolved] (KAFKA-3213) [CONNECT] It looks like we are not backing off properly when reconfiguring tasks

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-3213. Fix Version/s: 3.5.0 Resolution: Fixed > [CONNECT] It looks like we are not backing

[jira] [Resolved] (KAFKA-13338) kafka upgrade 6.1.1 asking to change log.cleanup.policy from delete to compact

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-13338. - Resolution: Invalid > kafka upgrade 6.1.1 asking to change log.cleanup.policy from del

[jira] [Resolved] (KAFKA-13163) MySQL Sink Connector - JsonConverter - DataException: Unknown schema type: null

2024-02-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-13163. - Resolution: Invalid > MySQL Sink Connector - JsonConverter - DataException: Unknown schema t

Re: Github build queue

2024-02-09 Thread Greg Harris
Juma wrote: > > > > > Why can't we add @Tag("integration") for all of those tests? Seems like > > > that would not be too hard. > > > > > > Ismael > > > > > > On Fri, Feb 9, 2024 at 9:03 AM Greg Harris > >

[jira] [Created] (KAFKA-16242) Mark flaky tests as integration tests

2024-02-09 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16242: --- Summary: Mark flaky tests as integration tests Key: KAFKA-16242 URL: https://issues.apache.org/jira/browse/KAFKA-16242 Project: Kafka Issue Type: Test

Re: Github build queue

2024-02-09 Thread Greg Harris
ion") for all of those tests? Seems like > > that would not be too hard. > > > > Ismael > > > > On Fri, Feb 9, 2024 at 9:03 AM Greg Harris > > wrote: > > > > > Hi David, > > > > > > +1 on that strategy. > > > > > > I see

Re: Github build queue

2024-02-09 Thread Greg Harris
Hi David, +1 on that strategy. I see several flaky tests that aren't marked with @Tag("integration") or @IntegrationTest, and I think those would make using the unitTest target ineffective here. We could also start a new tag @Tag("flaky") and exclude that. Thanks, Greg On Fri, Feb 9, 2024 at

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2024-02-08 Thread Greg Harris
Hi Mickael, Thanks for the KIP, this looks like a great change! 1. I see that one of my concerns was already discussed, and appears to have been concluded with: > I considered Chris' idea of automatically removing metrics but decided to > leave that responsibility to the plugins. After

Re: KRaft controller number of replicas

2024-02-06 Thread Greg Harris
Hi Dani, I believe the limitation that this documentation is hinting at is the motivation for KIP-996 [1], and the notice in the documentation would be removed once KIP-996 lands. You can read the KIP for a brief explanation and link to a more in-depth explanation of the failure scenario. While

[jira] [Created] (KAFKA-16225) Flaky test suite LogDirFailureTest

2024-02-05 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16225: --- Summary: Flaky test suite LogDirFailureTest Key: KAFKA-16225 URL: https://issues.apache.org/jira/browse/KAFKA-16225 Project: Kafka Issue Type: Bug

Re: Broken build

2024-01-30 Thread Greg Harris
> I found a bunch of builds stuck like this last week. You have to click in > the console window for force terminate. > I forced the termination as I did with the others. > > Justine > > On Tue, Jan 30, 2024 at 12:21 PM Greg Harris > wrote: > > > Hey Josep, > &

Re: Broken build

2024-01-30 Thread Greg Harris
Hey Josep, Thanks for finding and fixing this build breakage! I was wondering why we didn't find out about this via CI, since we do build with 2.12 in Jenkins. It turns out the build has been stuck for the past week, and I've raised an INFRA ticket to see if they can help us.

[jira] [Resolved] (KAFKA-16166) Generify RetryWithToleranceOperator and ErrorReporter

2024-01-22 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16166. - Fix Version/s: 3.8.0 Resolution: Fixed > Generify RetryWithToleranceOpera

[jira] [Created] (KAFKA-16166) Generify RetryWithToleranceOperator and ErrorReporter

2024-01-18 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16166: --- Summary: Generify RetryWithToleranceOperator and ErrorReporter Key: KAFKA-16166 URL: https://issues.apache.org/jira/browse/KAFKA-16166 Project: Kafka Issue

[jira] [Resolved] (KAFKA-16087) Tasks dropping incorrect records when errors.tolerance=all and errors reported asynchronously due to data race

2024-01-18 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16087. - Fix Version/s: 3.8.0 Resolution: Fixed > Tasks dropping incorrect records w

[jira] [Resolved] (KAFKA-15834) Subscribing to non-existent topic blocks StreamThread from stopping

2024-01-16 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15834. - Resolution: Fixed > Subscribing to non-existent topic blocks StreamThread from stopp

[jira] [Resolved] (KAFKA-16051) Deadlock on connector initialization

2024-01-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16051. - Fix Version/s: 3.8.0 Resolution: Fixed > Deadlock on connector initializat

[jira] [Resolved] (KAFKA-15816) Typos in tests leak network sockets

2024-01-12 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15816. - Fix Version/s: 3.8.0 Resolution: Fixed > Typos in tests leak network sock

[jira] [Resolved] (KAFKA-15760) org.apache.kafka.trogdor.coordinator.CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated is flaky

2024-01-11 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15760. - Fix Version/s: 3.8.0 Assignee: David Mao Resolution: Fixed

Re: [VOTE] KIP-1012: The need for a Kafka 3.8.x release

2024-01-08 Thread Greg Harris
Thanks Josep for leading the KIP and building consensus on 3.8! +1 (binding) Greg On Sun, Jan 7, 2024 at 11:45 PM Josep Prat wrote: > > Hi all, > > Thanks for your comments, > I reworded some parts of the KIP to express that: > - The KIP is to agree that we need at least one more minor version

Re: [DISCUSS] KIP-1012: The need for a Kafka 3.8.x release

2024-01-05 Thread Greg Harris
Hi Colin, Thanks for the quick reply! > If we cannot get KIP-853 done in time for 3.8, then we'd move to have another > 3.x release. This is the crux of my concern, and this is satisfactory. This means that the "must-haves" are advisory only, and don't constitute a binding feature list or a

[jira] [Created] (KAFKA-16087) Sink connector dropping incorrect record when ErrantRecordReporter used asynchronously

2024-01-05 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16087: --- Summary: Sink connector dropping incorrect record when ErrantRecordReporter used asynchronously Key: KAFKA-16087 URL: https://issues.apache.org/jira/browse/KAFKA-16087

Re: [VOTE] KIP-1004: Enforce tasks.max property in Kafka Connect

2024-01-05 Thread Greg Harris
e, it > shouldn't block any progress in the meantime. Thoughts? I'd also be curious > what Greg Harris thinks about this, given that it seems relevant to KIP-987 > [1]. > > [1] - > https://cwiki.apache.org/confluence/display/KAFKA/KIP-987%3A+Connect+Static+Assignments > > Cheers,

Re: [DISCUSS] KIP-1012: The need for a Kafka 3.8.x release

2024-01-05 Thread Greg Harris
Hi Josep, Thanks for the KIP! I think that the motivations for having another feature release before 4.0 are valid, as it seems that 3.7 is not suitable as the last 3.x release. I had a concern about the "Scope" section, in particular the language about "must haves", and the prevention of further

[jira] [Created] (KAFKA-16084) Simplify and deduplicate StandaloneHerderTest mocking

2024-01-04 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16084: --- Summary: Simplify and deduplicate StandaloneHerderTest mocking Key: KAFKA-16084 URL: https://issues.apache.org/jira/browse/KAFKA-16084 Project: Kafka Issue

Re: [DISCUSS] Connect Jira component name

2024-01-03 Thread Greg Harris
KafkaConnect` :) > > > -Matthias > > On 12/26/23 6:03 PM, Greg Harris wrote: > > Hi Connect Developers, > > > > I noticed recently that we had two Jira components: "KafkaConnect" and > > "connect", one with >1000 issues and one with 20 is

Re: [VOTE] KIP-1004: Enforce tasks.max property in Kafka Connect

2024-01-03 Thread Greg Harris
Hey Chris, Thanks for the KIP! I think the aggressive default and deprecation schedule is the right choice for this change. +1 (binding) On Wed, Jan 3, 2024 at 9:01 AM Mickael Maison wrote: > > Hi Chris, > > +1 (binding), thanks for the KIP > > Mickael > > On Tue, Jan 2, 2024 at 8:55 PM Hector

Re: [VOTE] KIP-1013: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7)

2024-01-03 Thread Greg Harris
Hi Ismael, I'm happy to see the minimum Java version moving forward, even if it's just for the broker and tools. I hope that this encourages operators to upgrade to 17+ across-the-board, and will make it easier to drop support for 11 in the other modules in 5.0. +1 (binding) Thanks, Greg On

Re: [DISCUSS] Kafka distributed transaction support

2024-01-02 Thread Greg Harris
Hi Rowland, First of all, welcome to the community, and thanks for thinking about the future of Kafka! I'm not very familiar with X/Open XA, but from the documentation I read, it appears most related to KIP-939: Support Participation in 2PC [1] currently in-progress. You may be interested in

Re: [DISCUSS] KIP-891: Running multiple versions of a connector.

2024-01-02 Thread Greg Harris
Hi Snehashis, Thank you for the KIP! This is something I've wanted for a long time. I know the discussion has gone cold, are you still interested in pursuing this feature? I'll make time to review the KIP if you are still accepting comments. Thanks, Greg On Tue, Nov 22, 2022 at 12:29 PM

[jira] [Created] (KAFKA-16069) Source Tasks re-transform records after Retriable exceptions

2023-12-29 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16069: --- Summary: Source Tasks re-transform records after Retriable exceptions Key: KAFKA-16069 URL: https://issues.apache.org/jira/browse/KAFKA-16069 Project: Kafka

  1   2   3   4   >