Re: [ANNOUNCE] New Committer: Vahid Hashemian

Congratulations Vahid! On Tue, Jan 15, 2019 at 11:45 PM Jason Gustafson wrote: > Hi All, > > The PMC for Apache Kafka has invited Vahid Hashemian as a project > committer and > we are > pleased to announce that he has accepted! > > Vahid has made numerous contributions to the Kafka community ove

Re: [DISCUSS] KIP-395: Encypt-then-MAC Delegation token metadata

aster key generation as part of KAFKA-7694. This will provide us out > > of the box implementation > > using ZooKeeper and pluggable interfaces for custom implementations. > > > > What do you think? > > > > Thanks, > > Manikumar > > > > On Sat, Dec

Re: "version" in kafka-reassign-partitions's JSON input file is not updated by KIP-113

Any ideas why version has not been changed of the reassignment json file? If you generate it with kafka-reassign-partitions --zookeeper $(hostname -f):2181 --topics-to-move-json-file reassign.json --broker-list "26,27,28" --generate, you can see something like this: Current partition replica ass

[DISCUSS] KIP-395: Encypt-then-MAC Delegation token metadata

Hi All, I have a proposal to allow Kafka brokers to encrypt sensitive metadata information about delegation tokens. As of now, delegation token metadata is stored in an unencrypted format in Zookeeper. Having the possibility to encrypt-then-MAC token information would be beneficial in Kafka insta

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! Keep up the good work! On Wed, Sep 26, 2018 at 7:27 PM Yishun Guan wrote: > Congrats! -Yishun > > On Wed, Sep 26, 2018, 10:04 AM Konstantine Karantasis < > konstant...@confluent.io> wrote: > > > Well deserved! Congratulations Colin. > > > > -Konstantine > > > > On Wed, Sep

Re: Issue in Creating the Kafka Consumer

Hi Sravanthi, Do I understand correctly that you pass the path to your JAAS configuration file to the JVM via a system property (e.g -Djava.security.auth.login.config=/path_to_your_directory/jaas.conf )? >From the error message: > Caused by: _java.lang.IllegalArgumentException_: No serviceName >

Re: [DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

Hi all, This is just to inform you that this KIP was taken over by Srinivas Reddy. Good luck Srinivas! Regards, - Attila On Wed, Sep 19, 2018 at 1:30 PM Attila Sasvári wrote: > Hi all, > > I have just created a KIP to add '--help' option to all available Kafka >

[DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

Hi all, I have just created a KIP to add '--help' option to all available Kafka CLI commands: https://cwiki.apache.org/confluence/display/KAFKA/KIP-373%3A+Add+%27--help%27+option+to+all+available+Kafka+CLI+commands Tracking JIRA: https://issues.apache.org/jira/browse/KAFKA-7418 Regards, - Attila

Re: [VOTE] KIP-366 - Make FunctionConversations private

+1 (non-binding) On Thu, Sep 6, 2018 at 6:38 PM Guozhang Wang wrote: > +1 for deprecating and copying the class over to internals. > > On Thu, Sep 6, 2018 at 6:56 AM, Bill Bejeck wrote: > > > +1 > > > > -Bill > > > > On Thu, Sep 6, 2018 at 4:29 AM Joan Goyeau wrote: > > > > > Sournds good, I'l

[VOTE] KIP-363: Allow performance tools to print final results to output file

Hi All, I'd like to start the vote on KIP-363: *https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file * .

Re: [VOTE] KIP-359: Verify leader epoch in produce requests

+1 (non-binding) On Mon, Sep 3, 2018 at 12:21 PM Manikumar wrote: > +1 (non-binding) > Thanks for the KIP. > > On Sun, Sep 2, 2018 at 10:06 PM Satish Duggana > wrote: > > > Thanks for the KIP, > > +1 (non-binding) > > > > On Sun, Sep 2, 2018 at 7:59 PM, Matthias J. Sax > > wrote: > > > > > +1

Re: [DISCUSS] KIP-363: Allow performance tools to print final results to output file

ing the output to a file >> > anyways. >> > >> > Just a couple minor questions... >> > >> > 1. If the configured file already exists, what would be the outcome? My >> > intuition is that the performance tool will spit out some type of error >&

Re: [VOTE] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

Thanks for the KIP and the updates Viktor! +1 (non-binding) On Wed, Aug 29, 2018 at 10:44 AM Manikumar wrote: > +1 (non-binding) > > Thanks for the KIP. > > On Wed, Aug 29, 2018 at 1:41 AM Jason Gustafson > wrote: > > > +1 Thanks for the updates. > > > > On Tue, Aug 28, 2018 at 1:15 AM, Vikt

Re: [VOTE] KIP-363: Make FunctionConversions private

Hi there, There is a conflicting KIP with the same number, see https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file Its discussion was started earlier, on August 23 https://www.mail-archive.com/dev@kafka.apache.org/msg91132.htm

Re: [DISCUSS] KIP-363: Allow performance tools to print final results to output file

rformance tool will spit out some type of error > and > > quit as we do not want to accidentally overwrite files. > > > > 2. Will the performance tool still output directly to shell if this > option > > is specified? > > > > Regards, > > Kevin > &

[DISCUSS] KIP-363: Allow performance tools to print final results to output file

Hi all, I have created a minor KIP to allow consumer and producer performance tools to print final results to output file in CSV format. https://cwiki.apache.org/confluence/display/KAFKA/KIP-363%3A+Allow+performance+tools+to+print+final+results+to+output+file Please take a look and share your th

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congratulations Dong! Well deserved. Regards, Attila Paolo Patierno ezt írta (időpont: 2018. aug. 20., H 15:09): > Congratulations Dong! > > Paolo Patierno > Principal Software Engineer (IoT) @ Red Hat > Microsoft MVP on Azure & IoT > Microsoft Azure Advisor > > Twitter : @ppatierno

Permission to create KIP

Hi there, Can you please grant me permission to create a KIP? Wiki ID: asasvari Thanks, Attila

Re: [DISCUSS] KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

e bug. > > Regards, > Dong > > On Tue, Aug 7, 2018 at 5:28 AM, Attila Sasvári > wrote: > > > Hi Dong, > > > > Thanks for the KIP. +1 on using "command-config". > > > > Regarding the testing strategy: > > - Is it planned to add new syste

Re: [DISCUSS] KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

Hi Dong, Thanks for the KIP. +1 on using "command-config". Regarding the testing strategy: - Is it planned to add new system test(s) to execute kafka-log-dirs.sh (kafka-reassign-partitions.sh) against an SSL-enabled broker? I know that the change is quite small, but it might be useful. Best, Att

Re: [DISCUSS] KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it

Thanks for the KIP. Regarding the motivation: - KIP-113 added a new command, kafka-log-dirs.sh, to get the partitions associated with a specific broker (however, it does not work on secured clusters, see KIP-340). It would be probably better/more flexible if you could specify multiple broker ids.

Re: Didn't receive video stream data into spark through kafka

Hi Biswajit, Can you please provide more information: - What other symptoms do you see? Are all your Kafka brokers up and running? - What replication did you set for offsets.topic.replication.factor (i.e. replication factor of __consumer_offsets) in your Kafka broker's config ? What is set for mi

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

t; >> per the community's feedback it > may be the better option. > >>> > > >> >> >> Although one of> >> >> >> the goals is to put this new > ConfigCommand to the tools > >>> > > >> >> >> module,

Re: [VOTE] KIP-278: Add version option to Kafka's commands

+1 (non-binding) Thomas Crayford ezt írta (időpont: 2018. máj. 11., P 18:20): > +1 (non-binding) > > On Fri, May 11, 2018 at 5:17 PM, Guozhang Wang wrote: > > > Thanks Toru-san, +1 (binding) > > > > On Fri, May 11, 2018 at 8:30 AM, Jason Gustafson > > wrote: > > > > > Thanks for the KIP! +1 (b

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

good idea and would ease the > life > > > of people using the interface. Also more importantly would make sure > that > > > we always use the same hashCode. I have created wrapper classes for the > > map > > > value as well but that was reverted to keep things

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

Thanks for working on it Viktor. It looks good to me, but I have some questions: - I see a new type DOUBLE is used for quota_value , and it is not listed among the primitive types on the Kafka protocol guide. Can you add some more details? - I am not sure that using an environment (i.e. USE_OLD_CO

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong. Keep up the good work! Becket Qin ezt írta (időpont: 2018. márc. 28., Sze 19:58): > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > Dong started working on Kafka about four yea

Re: [VOTE] 1.0.1 RC2

Hi there, Here is what I did: - Verified signature and hashes - Built kafka from source - Executed tests - all passed - Started Zookeeper, Kafka broker, a console producer and consumer. Verified that the stream of records published to my test Kafka topic was processed - Ran the Kafka Streams demo