Re: [DISCUSS] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

Thanks Konstantine for the great summary! +1 for having a separate KIP discussing the trade-offs for using a new serialization format for the protocol encoding. We probably could discuss a wider options and benchmark on the performance before reaching a final decision. Best, Boyang

[DISCUSS] KIP-296 Add connector level configurability for producer/consumer client configs

Allen, I think this is a good fix -- it is often intuitive for users to define consumer and producer configs on a Connector level as opposed to a worker level, since each connector-task gets its own producer/consumer. I think we should re-start the discussion. I think this KIP is actually

[jira] [Created] (KAFKA-7905) KTable Reduce Allow Null value to be pass in Subtractor

HARSHIT AGARWAL created KAFKA-7905: -- Summary: KTable Reduce Allow Null value to be pass in Subtractor Key: KAFKA-7905 URL: https://issues.apache.org/jira/browse/KAFKA-7905 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk11 #266

See Changes: [github] KAFKA-7828: Add ExternalCommandWorker to Trogdor (#6219) -- [...truncated 2.30 MB...] org.apache.kafka.connect.runtime.WorkerSinkTaskThreadedTest >

Build failed in Jenkins: kafka-trunk-jdk8 #3368

See Changes: [github] KAFKA-7828: Add ExternalCommandWorker to Trogdor (#6219) -- [...truncated 2.29 MB...] org.apache.kafka.connect.converters.LongConverterTest >

[jira] [Created] (KAFKA-7904) Add AtMinIsr topic partition category

Kevin Lu created KAFKA-7904: --- Summary: Add AtMinIsr topic partition category Key: KAFKA-7904 URL: https://issues.apache.org/jira/browse/KAFKA-7904 Project: Kafka Issue Type: New Feature

[jira] [Created] (KAFKA-7903) Replace OffsetCommit request/response with automated protocol

Boyang Chen created KAFKA-7903: -- Summary: Replace OffsetCommit request/response with automated protocol Key: KAFKA-7903 URL: https://issues.apache.org/jira/browse/KAFKA-7903 Project: Kafka

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Thanks Eno, Adam & Satish for you review and questions. I'll address these in KIP and update the thread here. Thanks, Harsha On Wed, Feb 6, 2019, at 7:09 AM, Satish Duggana wrote: > Thanks, Harsha for the KIP. It is a good start for tiered storage in > Kafka. I have a few comments/questions. >

Re: [Discuss] Question on KIP-298: Error Handling in Kafka Connect

Hi, Pere. The primary reason that KIP-298 did not support a DLQ for source connectors was because we couldn't get around serialization problems. With source connectors, the converter (serializer) is the last element in the chain, and if there is a problem serializing a record then we could not

Re: Statestore restoration & scaling questions - possible KIP as well.

Bump - hoping someone has some insight. Alternately, redirection to a more suitable forum. Thanks On Sun, Feb 3, 2019 at 10:25 AM Adam Bellemare wrote: > Hey Folks > > I have a few questions around the operations of stateful processing while > scaling nodes up/down, and a possible KIP in

[jira] [Created] (KAFKA-7902) SASL/OAUTHBEARER can become unable to connect: javax.security.sasl.SaslException: Unable to find OAuth Bearer token in Subject's private credentials (size=2)

Ron Dagostino created KAFKA-7902: Summary: SASL/OAUTHBEARER can become unable to connect: javax.security.sasl.SaslException: Unable to find OAuth Bearer token in Subject's private credentials (size=2) Key: KAFKA-7902

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Thanks, Harsha for the KIP. It is a good start for tiered storage in Kafka. I have a few comments/questions. It may be good to have a configuration to keep the number of local segments instead of keeping only the active segment. This config can be exposed at cluster and topic levels with default

[jira] [Created] (KAFKA-7901) Message Expiring at Producer with "Unable to send" when Partitions are under replicated

Zubair Abdul Khaliq created KAFKA-7901: -- Summary: Message Expiring at Producer with "Unable to send" when Partitions are under replicated Key: KAFKA-7901 URL: https://issues.apache.org/jira/browse/KAFKA-7901