Re: [ANNOUNCE] New committer: Damian Guy

2017-06-12 Thread BigData dev
congrats Damian!! Regards, Bharat On Mon, Jun 12, 2017 at 12:52 PM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Congrats! > > On Mon, Jun 12, 2017 at 12:48 PM, Michael Noll > wrote: > > > Congratulations, Damian! > > > > On Mon, Jun 12, 2017 at 9:07 AM,

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-06-11 Thread BigData dev
; > Thanks, > > > > Bill > > > > > > > > On Thu, Jun 1, 2017 at 7:45 PM, Guozhang Wang <wangg...@gmail.com> > > > wrote: > > > > > > > >> +1 again. Thanks. > > > >> > > > >> On

Info regarding kafka topic

2017-06-08 Thread BigData dev
Hi, I have a 3 node Kafka Broker cluster. I have created a topic and the leader for the topic is broker 1(1001). And the broker got died. But when I see the information in zookeeper for the topic, I see the leader is still set to broker 1 (1001) and isr is set to 1001. Is this a bug in kafka, as

Re: [VOTE] KIP-162: Enable topic deletion by default

2017-06-06 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Tue, Jun 6, 2017 at 9:21 AM, Ashwin Sinha wrote: > +1 > > On Tue, Jun 6, 2017 at 11:20 PM, Mickael Maison > wrote: > > > +1 (non binding), thanks > > > > On Tue, Jun 6, 2017 at 2:16 PM, Bill Bejeck

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-30 Thread BigData dev
, 2017 at 1:18 PM, Guozhang Wang <wangg...@gmail.com> wrote: > +1. Thanks! > > On Tue, May 16, 2017 at 1:12 AM, Eno Thereska <eno.there...@gmail.com> > wrote: > > > +1 thanks. > > > > Eno > > > On 16 May 2017, at 04:20, BigData dev <

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-22 Thread BigData dev
e more familiar with Kafka security can help > out here. I personally have only limited knowledge about this topic. > > > -Matthias > > > > On 5/19/17 11:09 AM, BigData dev wrote: > > Thanks for the info, Matthias. > > > > Regards, > > Bhar

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-19 Thread BigData dev
Thanks for the info, Matthias. Regards, Bharat On Fri, May 19, 2017 at 10:25 AM, Matthias J. Sax <matth...@confluent.io> wrote: > KIP-157 cannot be included in 0.11.0.0 anymore. KIP freeze date deadline > is strict. > > -Matthias > > On 5/19/17 10:15 AM, BigData de

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-19 Thread BigData dev
ter you update KIP-14. > > Thanks for your contributions! > > > -Matthias > > > On 5/17/17 12:56 PM, BigData dev wrote: > > Hi, > > When I was trying to find more info, there is already a proposed KIP for > > this > > https://cwiki.apache.org/confluen

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-17 Thread BigData dev
Hi, When I was trying to find more info, there is already a proposed KIP for this https://cwiki.apache.org/confluence/display/KAFKA/KIP-14+-+Tools+Standardization Thanks, Bharat On Wed, May 17, 2017 at 12:38 PM, BigData dev <bigdatadev...@gmail.com> wrote: > Hi Ewen, Matthias, >

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-17 Thread BigData dev
ear path forward for > >> future tools. > >> > >> I think I still have at least one open PR from when I first started on > the > >> project where I was trying to clean up some command line stuff to be > more > >> consistent. This has been an issue

Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-15 Thread BigData dev
Hi All, Given the simple and non-controversial nature of the KIP, I would like to start the voting process for KIP-157: Add consumer config options to streams reset tool *https://cwiki.apache.org/confluence/display/KAFKA/KIP+157+-+Add+consumer+config+options+to+streams+reset+tool

Re: [VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-10 Thread BigData dev
parameter to a CLI requires a KIP. It > > seems > > > excessive. > > > > > > > > > On Tue, May 9, 2017 at 7:57 PM Jay Kreps <j...@confluent.io> wrote: > > > > > > > +1 > > > > On Tue, May 9, 2017 at 3:41 PM BigData dev <bigdatad

Re: [VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-09 Thread BigData dev
> safe I guess. > > Eno > > > On May 9, 2017, at 8:41 PM, BigData dev <bigdatadev...@gmail.com> wrote: > > > > Hi, Everyone, > > > > Since this is a relatively simple change, I would like to start the > voting > > process for KIP-156: Add

[VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-09 Thread BigData dev
Hi, Everyone, Since this is a relatively simple change, I would like to start the voting process for KIP-156: Add option "dry run" to Streams application reset tool https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69410150 The vote will run for a minimum of 72 hours. Thanks,

Re: [VOTE] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
+1 (non-binding) On Mon, May 8, 2017 at 3:25 PM, Dongjin Lee wrote: > +1 > > On Tue, May 9, 2017 at 7:24 AM, Sriram Subramanian > wrote: > > > +1 > > > > On Mon, May 8, 2017 at 2:14 PM, Konstantine Karantasis < > > konstant...@confluent.io> wrote: > > > >

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
one but include a relevant comment. > > On Mon, May 8, 2017 at 11:14 PM, BigData dev <bigdatadev...@gmail.com> > wrote: > > > So, when Kafka broker is less than 3, and the user has not set the > > replication configuration it will throw an error to the user, to correct

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
odes is a > bit harsher than I'd like, it does appear to be the safer option: an error > message (with instructions on how to correct) is better than inadvertently > setting the replication factor too small and not knowing about it until it > is too late. > > On Mon, May 8, 2017 at

Re: [VOTE] KIP-151: Expose Connector type in REST API (first attempt :)

2017-05-08 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Mon, May 8, 2017 at 4:39 PM, Konstantine Karantasis < konstant...@confluent.io> wrote: > +1 (non-binding) > > On Mon, May 8, 2017 at 3:39 PM, dan wrote: > > > i'd like to begin voting on > >

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
Hi, I liked the KIP, as it will avoid so many errors which user can make during setup. I have 1 questions here. 1. As default replication factor is set to 3, but if Kafka cluster is setup for one node, then the user needs to override the default configuraion, till then topics will not be created.

[DISCUSS] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-08 Thread BigData dev
Hi All, I want to start a discussion on this simple KIP for Kafka Streams reset tool (kafka-streams-application-reset.sh). https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69410150 Thank you, Matthias J Sax for providing me Jira and info to work on. Thanks, Bharat

Need Permissions for creating KIP in Kafka

2017-05-05 Thread BigData dev
Hi, Could you please provide permission for creating KIP in Kafka. username: bharatv email: bigdatadev...@gmail.com

Reg: Kafka HDFS Connector with (HDFS SSL enabled)

2017-02-15 Thread BigData dev
Hi, Does Kafka HDFS Connect work with HDFS (SSL). As I see only properties in security is hdfs.authentication.kerberos, connect.hdfs.keytab,hdfs.namenode.principal as these properties are all related to HDFS Kerberos. As from the configuration and code I see we pass only Kerberos parameters, not

Re: [VOTE] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-02-09 Thread BigData dev
+1 Thanks, Bharat On Thu, Feb 9, 2017 at 9:27 AM, Jason Gustafson wrote: > +1 > > On Thu, Feb 9, 2017 at 9:00 AM, Grant Henke wrote: > > > +1 > > > > On Thu, Feb 9, 2017 at 10:51 AM, Mickael Maison < > mickael.mai...@gmail.com> > > wrote: > > > > > +1

Reg: Kafka Kerberos

2017-02-07 Thread BigData dev
Hi, I am using Kafka 0.10.1.0 and kerberozied cluster. Kafka_jaas.conf file: Client { com.sun.security.auth.module.Krb5LoginModule required useKeyTab=true keyTab="/etc/security/keytabs/kafka.service.keytab" storeKey=true useTicketCache=false serviceName="zookeeper"

Reg: Kafka ACLS

2017-01-25 Thread BigData dev
Hi, I have a question, can we use Kafka ACL's with only SASL/PLAIN mechanism. Because after I enabled, still I am able to produce/consume from topics. And one more observation is in kafka-_jaas.conf, there is no client section, will get an WARN as below, as we dont have this kind of mechanisim

Re: Reg: ACLS

2016-12-10 Thread BigData dev
is not enabled what will be the allow-principal value. Any information on this would be greatly helpful. Thanks On Sat, Dec 10, 2016 at 11:02 AM, BigData dev <bigdatadev...@gmail.com> wrote: > Hi Ashish, Ismael > Thanks for Info. > So on Kafka Cluster (With out any security enabled)

Re: Reg: ACLS

2016-12-10 Thread BigData dev
sl, all requests will appear to > come > > > from anonymous user, and as long as a user is not identified it is not > > > possible to do authorization on. > > > > > > On Fri, Dec 9, 2016 at 10:40 AM, BigData dev <bigdatadev...@gmail.com> > > > wrote: &g

Reg: ACLS

2016-12-09 Thread BigData dev
Hi All, I have a question here, Does Kafka support ACL's with out kerberos/SSL? Any info on this would be greatly helpful. Thanks

Re: [ANNOUNCE] New committer: Jiangjie (Becket) Qin

2016-10-31 Thread BigData dev
Congratulations Becket!! Thanks, Bharat On Mon, Oct 31, 2016 at 11:26 AM, Jun Rao wrote: > Congratulations, Jiangjie. Thanks for all your contributions to Kafka. > > Jun > > On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote: > > > The PMC for Apache

Reg: Kafka Security features

2016-10-12 Thread BigData dev
Hi All, Could you please provide below information. 1. Kafka security features (Kerberos , ACL's) are beta quality code or can they be used in production? Because Kafka documentation shows they are of beta code quality. >From Apache Kafka Documentation "In release 0.9.0.0, the Kafka community

Reg: DefaultParititioner in Kafka

2016-08-29 Thread BigData dev
Hi All, In DefaultPartitioner implementation, when key is null, we get the partition number by modulo of available partitions. Below is the code snippet. if (availablePartitions.size() > 0) { int part = Utils.toPositive(nextValue) % availablePartitions.size(); return

Re: [DISCUSS] KIP-76: Enable getting password from executable rather than passing as plaintext in config files

2016-08-24 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Wed, Aug 24, 2016 at 12:03 PM, Ashish Singh wrote: > Hey Guys, > > I’ve just posted KIP-76: Enable getting password from executable rather > than passing as plaintext in config files >

Reg: SSL setup

2016-08-03 Thread BigData dev
Hi, Can you please provide information on Self signed certificate setup in Kafka. As in Kafka documentation only CA signed setup is provided. http://kafka.apache.org/documentation.html#security_ssl As because, we need to provide parameters trustore, keystore during configuration. Or to work

Reg: Build Validation Jenkins

2016-06-16 Thread BigData dev
Hi, I have opened pull request for one of the JIRA. My build has been marked has failed due to time out exception. I think configuration setup is like that after 2 hours mark it as build fail. I have seen other builds on jenkins they also has same issue. Is this jenkins server executing machines

Re: Reg: Kafka-Acls

2016-05-05 Thread BigData dev
On Thu, May 5, 2016 at 4:19 PM, parth brahmbhatt <brahmbhatt.pa...@gmail.com > wrote: > Acls will be written in zookeeper but you are using getAcl , what you need > is get /kafka-acl/Topic/permissiontopic > > Thanks > Parth > > On Thu, May 5, 2016 at 3:28 PM, BigData d

Reg: Kafka-Acls

2016-05-05 Thread BigData dev
Hi, When I run the command /bin/kafka-acls.sh --topic permissiontopic --add --allow-host {host} --allow-principal User:dev --operation Write --authorizer-properties zookeeper.connect={host:port} I am getting output as acls are set. But when i check under zookeeper using below command, it is not

Re: [ANNOUNCE] New committer: Ismael Juma

2016-04-26 Thread BigData dev
Congrats Ismael!! Regards, Bharat On Tue, Apr 26, 2016 at 4:17 PM, Edward Ribeiro wrote: > Congratulations, Ismael! > > E. Ribeiro > Em 26/04/2016 15:33, "Jason Gustafson" escreveu: > > > Great work, Ismael! > > > > On Tue, Apr 26, 2016 at 9:00

Re: Kafka missing from ASF Jira?

2016-04-25 Thread BigData dev
Hi Wang, Me too facing the same issue. Can you provide access to me too. Regards, Bharat On Mon, Apr 25, 2016 at 11:21 AM, Guozhang Wang wrote: > Greg, > > Could you try again now? I think even non-contributor should be able to > create Kafka JIRAs, but they may not be

Reg: Kafka With Kerberos/SSL [Enhancement to add option, Need suggestions on this]

2016-04-14 Thread BigData dev
Hi All, When Kafka is running on kerberoized cluster/ SSL. Can we add an option security.protocol. So, that user can given PLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL. This will be helpful during running console producer and console consumer. ./bin/kafka-console-producer.sh --broker-list --topic

Reg: Issue with Kafka Kerberos (Kafka Version 0.9.0.1)

2016-04-12 Thread BigData dev
Hi All, I am facing issue with kafka kerberoized cluster. After following the steps how to enables SASL on kafka by using below link. http://docs.confluent.io/2.0.0/kafka/sasl.html After this,when i start the kafka-server I am getting below error. [2016-04-12 16:59:26,201] ERROR

Reg: Contribution to Kafka

2016-03-24 Thread BigData dev
Hi Kafka Contributors, I am interested in contributing to kafka open source. Can you please provide some suggestions in understanding the code of kafka. Can you please provide any method you have followed to understand the code. Regards, BigDataDev