Re: [ANNOUNCE] New committer: Damian Guy

2017-06-12 Thread BigData dev
congrats Damian!! Regards, Bharat On Mon, Jun 12, 2017 at 12:52 PM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Congrats! > > On Mon, Jun 12, 2017 at 12:48 PM, Michael Noll > wrote: > > > Congratulations, Damian! > > > > On Mon, Jun 12, 2017 at 9:07 AM, Molnár Bálint > > wrot

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-06-11 Thread BigData dev
gt; > > > > Thanks for updating the KIP! > > > > > > -Matthias > > > > > > On 6/1/17 6:18 PM, Bill Bejeck wrote: > > > > +1 > > > > > > > > Thanks, > > > > Bill > > > > > > > > On Th

Info regarding kafka topic

2017-06-08 Thread BigData dev
Hi, I have a 3 node Kafka Broker cluster. I have created a topic and the leader for the topic is broker 1(1001). And the broker got died. But when I see the information in zookeeper for the topic, I see the leader is still set to broker 1 (1001) and isr is set to 1001. Is this a bug in kafka, as no

Re: [VOTE] KIP-162: Enable topic deletion by default

2017-06-06 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Tue, Jun 6, 2017 at 9:21 AM, Ashwin Sinha wrote: > +1 > > On Tue, Jun 6, 2017 at 11:20 PM, Mickael Maison > wrote: > > > +1 (non binding), thanks > > > > On Tue, Jun 6, 2017 at 2:16 PM, Bill Bejeck wrote: > > > +1 > > > > > > -Bill > > > > > > On Tue, Jun 6,

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-30 Thread BigData dev
, 2017 at 1:18 PM, Guozhang Wang wrote: > +1. Thanks! > > On Tue, May 16, 2017 at 1:12 AM, Eno Thereska > wrote: > > > +1 thanks. > > > > Eno > > > On 16 May 2017, at 04:20, BigData dev wrote: > > > > > > Hi All, > > >

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-22 Thread BigData dev
a security can help > out here. I personally have only limited knowledge about this topic. > > > -Matthias > > > > On 5/19/17 11:09 AM, BigData dev wrote: > > Thanks for the info, Matthias. > > > > Regards, > > Bharat > > > > > > On

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-19 Thread BigData dev
Thanks for the info, Matthias. Regards, Bharat On Fri, May 19, 2017 at 10:25 AM, Matthias J. Sax wrote: > KIP-157 cannot be included in 0.11.0.0 anymore. KIP freeze date deadline > is strict. > > -Matthias > > On 5/19/17 10:15 AM, BigData dev wrote: > > Hi Matthias, &g

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-19 Thread BigData dev
> Thanks for your contributions! > > > -Matthias > > > On 5/17/17 12:56 PM, BigData dev wrote: > > Hi, > > When I was trying to find more info, there is already a proposed KIP for > > this > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 14+-+Tools+

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-17 Thread BigData dev
Hi, When I was trying to find more info, there is already a proposed KIP for this https://cwiki.apache.org/confluence/display/KAFKA/KIP-14+-+Tools+Standardization Thanks, Bharat On Wed, May 17, 2017 at 12:38 PM, BigData dev wrote: > Hi Ewen, Matthias, > For common configuration across a

Re: Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-17 Thread BigData dev
t; >> > >> I think I still have at least one open PR from when I first started on > the > >> project where I was trying to clean up some command line stuff to be > more > >> consistent. This has been an issue for many years now... > >> > >> -Ew

Reg: [VOTE] KIP 157 - Add consumer config options to streams reset tool

2017-05-15 Thread BigData dev
Hi All, Given the simple and non-controversial nature of the KIP, I would like to start the voting process for KIP-157: Add consumer config options to streams reset tool *https://cwiki.apache.org/confluence/display/KAFKA/KIP+157+-+Add+consumer+config+options+to+streams+reset+tool

Re: [VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-10 Thread BigData dev
> > > > > > > > On Tue, May 9, 2017 at 7:57 PM Jay Kreps wrote: > > > > > > > +1 > > > > On Tue, May 9, 2017 at 3:41 PM BigData dev > > > > wrote: > > > > > > > > > Hi, Everyone, > > > > > >

Re: [VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-09 Thread BigData dev
> > > On May 9, 2017, at 8:41 PM, BigData dev wrote: > > > > Hi, Everyone, > > > > Since this is a relatively simple change, I would like to start the > voting > > process for KIP-156: Add option "dry run" to Streams application reset > tool &

[VOTE] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-09 Thread BigData dev
Hi, Everyone, Since this is a relatively simple change, I would like to start the voting process for KIP-156: Add option "dry run" to Streams application reset tool https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69410150 The vote will run for a minimum of 72 hours. Thanks,

Re: [VOTE] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
+1 (non-binding) On Mon, May 8, 2017 at 3:25 PM, Dongjin Lee wrote: > +1 > > On Tue, May 9, 2017 at 7:24 AM, Sriram Subramanian > wrote: > > > +1 > > > > On Mon, May 8, 2017 at 2:14 PM, Konstantine Karantasis < > > konstant...@confluent.io> wrote: > > > > > +1 (non binding) > > > > > > On Mon,

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
a relevant comment. > > On Mon, May 8, 2017 at 11:14 PM, BigData dev > wrote: > > > So, when Kafka broker is less than 3, and the user has not set the > > replication configuration it will throw an error to the user, to correct > > the configuration according to his s

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
harsher than I'd like, it does appear to be the safer option: an error > message (with instructions on how to correct) is better than inadvertently > setting the replication factor too small and not knowing about it until it > is too late. > > On Mon, May 8, 2017 at 6:12 PM, BigD

Re: [VOTE] KIP-151: Expose Connector type in REST API (first attempt :)

2017-05-08 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Mon, May 8, 2017 at 4:39 PM, Konstantine Karantasis < konstant...@confluent.io> wrote: > +1 (non-binding) > > On Mon, May 8, 2017 at 3:39 PM, dan wrote: > > > i'd like to begin voting on > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > > 151+Expos

Re: [DISCUSS] KIP-154 Add Kafka Connect configuration properties for creating internal topics

2017-05-08 Thread BigData dev
Hi, I liked the KIP, as it will avoid so many errors which user can make during setup. I have 1 questions here. 1. As default replication factor is set to 3, but if Kafka cluster is setup for one node, then the user needs to override the default configuraion, till then topics will not be created. S

[DISCUSS] KIP-156 Add option "dry run" to Streams application reset tool

2017-05-08 Thread BigData dev
Hi All, I want to start a discussion on this simple KIP for Kafka Streams reset tool (kafka-streams-application-reset.sh). https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69410150 Thank you, Matthias J Sax for providing me Jira and info to work on. Thanks, Bharat

Need Permissions for creating KIP in Kafka

2017-05-05 Thread BigData dev
Hi, Could you please provide permission for creating KIP in Kafka. username: bharatv email: bigdatadev...@gmail.com

Reg: Kafka HDFS Connector with (HDFS SSL enabled)

2017-02-15 Thread BigData dev
Hi, Does Kafka HDFS Connect work with HDFS (SSL). As I see only properties in security is hdfs.authentication.kerberos, connect.hdfs.keytab,hdfs.namenode.principal as these properties are all related to HDFS Kerberos. As from the configuration and code I see we pass only Kerberos parameters, not

Re: [VOTE] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-02-09 Thread BigData dev
+1 Thanks, Bharat On Thu, Feb 9, 2017 at 9:27 AM, Jason Gustafson wrote: > +1 > > On Thu, Feb 9, 2017 at 9:00 AM, Grant Henke wrote: > > > +1 > > > > On Thu, Feb 9, 2017 at 10:51 AM, Mickael Maison < > mickael.mai...@gmail.com> > > wrote: > > > > > +1 too. > > > > > > On Thu, Feb 9, 2017 at 4

Reg: Kafka Kerberos

2017-02-07 Thread BigData dev
Hi, I am using Kafka 0.10.1.0 and kerberozied cluster. Kafka_jaas.conf file: Client { com.sun.security.auth.module.Krb5LoginModule required useKeyTab=true keyTab="/etc/security/keytabs/kafka.service.keytab" storeKey=true useTicketCache=false serviceName="zookeeper" principal=

Reg: Kafka ACLS

2017-01-25 Thread BigData dev
Hi, I have a question, can we use Kafka ACL's with only SASL/PLAIN mechanism. Because after I enabled, still I am able to produce/consume from topics. And one more observation is in kafka-_jaas.conf, there is no client section, will get an WARN as below, as we dont have this kind of mechanisim wit

Re: Reg: ACLS

2016-12-10 Thread BigData dev
enabled what will be the allow-principal value. Any information on this would be greatly helpful. Thanks On Sat, Dec 10, 2016 at 11:02 AM, BigData dev wrote: > Hi Ashish, Ismael > Thanks for Info. > So on Kafka Cluster (With out any security enabled) I can add ACLS with IP > addres

Re: Reg: ACLS

2016-12-10 Thread BigData dev
a user is not identified it is not > > > possible to do authorization on. > > > > > > On Fri, Dec 9, 2016 at 10:40 AM, BigData dev > > > wrote: > > > > > > > Hi All, > > > > I have a question here, Does Kafka support ACL

Reg: ACLS

2016-12-09 Thread BigData dev
Hi All, I have a question here, Does Kafka support ACL's with out kerberos/SSL? Any info on this would be greatly helpful. Thanks

Re: [ANNOUNCE] New committer: Jiangjie (Becket) Qin

2016-10-31 Thread BigData dev
Congratulations Becket!! Thanks, Bharat On Mon, Oct 31, 2016 at 11:26 AM, Jun Rao wrote: > Congratulations, Jiangjie. Thanks for all your contributions to Kafka. > > Jun > > On Mon, Oct 31, 2016 at 10:35 AM, Joel Koshy wrote: > > > The PMC for Apache Kafka has invited Jiangjie (Becket) Qin t

Reg: Kafka Security features

2016-10-12 Thread BigData dev
Hi All, Could you please provide below information. 1. Kafka security features (Kerberos , ACL's) are beta quality code or can they be used in production? Because Kafka documentation shows they are of beta code quality. >From Apache Kafka Documentation "In release 0.9.0.0, the Kafka community ad

Reg: DefaultParititioner in Kafka

2016-08-29 Thread BigData dev
Hi All, In DefaultPartitioner implementation, when key is null, we get the partition number by modulo of available partitions. Below is the code snippet. if (availablePartitions.size() > 0) { int part = Utils.toPositive(nextValue) % availablePartitions.size(); return availablePartitions.get(part).

Re: [DISCUSS] KIP-76: Enable getting password from executable rather than passing as plaintext in config files

2016-08-24 Thread BigData dev
+1 (non-binding) Thanks, Bharat On Wed, Aug 24, 2016 at 12:03 PM, Ashish Singh wrote: > Hey Guys, > > I’ve just posted KIP-76: Enable getting password from executable rather > than passing as plaintext in config files > 76+Enable+gettin

Reg: SSL setup

2016-08-03 Thread BigData dev
Hi, Can you please provide information on Self signed certificate setup in Kafka. As in Kafka documentation only CA signed setup is provided. http://kafka.apache.org/documentation.html#security_ssl As because, we need to provide parameters trustore, keystore during configuration. Or to work wit

Reg: Build Validation Jenkins

2016-06-16 Thread BigData dev
Hi, I have opened pull request for one of the JIRA. My build has been marked has failed due to time out exception. I think configuration setup is like that after 2 hours mark it as build fail. I have seen other builds on jenkins they also has same issue. Is this jenkins server executing machines

Re: Reg: Kafka-Acls

2016-05-05 Thread BigData dev
On Thu, May 5, 2016 at 4:19 PM, parth brahmbhatt wrote: > Acls will be written in zookeeper but you are using getAcl , what you need > is get /kafka-acl/Topic/permissiontopic > > Thanks > Parth > > On Thu, May 5, 2016 at 3:28 PM, BigData dev > wrote: > > > Hi

Reg: Kafka-Acls

2016-05-05 Thread BigData dev
Hi, When I run the command /bin/kafka-acls.sh --topic permissiontopic --add --allow-host {host} --allow-principal User:dev --operation Write --authorizer-properties zookeeper.connect={host:port} I am getting output as acls are set. But when i check under zookeeper using below command, it is not

Re: [ANNOUNCE] New committer: Ismael Juma

2016-04-26 Thread BigData dev
Congrats Ismael!! Regards, Bharat On Tue, Apr 26, 2016 at 4:17 PM, Edward Ribeiro wrote: > Congratulations, Ismael! > > E. Ribeiro > Em 26/04/2016 15:33, "Jason Gustafson" escreveu: > > > Great work, Ismael! > > > > On Tue, Apr 26, 2016 at 9:00 AM, Grant Henke > wrote: > > > > > Congratulat

Re: Kafka missing from ASF Jira?

2016-04-25 Thread BigData dev
Hi Wang, Me too facing the same issue. Can you provide access to me too. Regards, Bharat On Mon, Apr 25, 2016 at 11:21 AM, Guozhang Wang wrote: > Greg, > > Could you try again now? I think even non-contributor should be able to > create Kafka JIRAs, but they may not be able to assign JIRAs to

Re: Reg: Issue with Kafka Kerberos (Kafka Version 0.9.0.1)

2016-04-18 Thread BigData dev
:kafka to your > server.properties. > -Harsha > > On Tue, Apr 12, 2016, at 05:07 PM, BigData dev wrote: > > Hi All, > > I am facing issue with kafka kerberoized cluster. > > > > After following the steps how to enables SASL on kafka by using below &g

Reg: Kafka With Kerberos/SSL [Enhancement to add option, Need suggestions on this]

2016-04-14 Thread BigData dev
Hi All, When Kafka is running on kerberoized cluster/ SSL. Can we add an option security.protocol. So, that user can given PLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL. This will be helpful during running console producer and console consumer. ./bin/kafka-console-producer.sh --broker-list --topic --

Reg: Issue with Kafka Kerberos (Kafka Version 0.9.0.1)

2016-04-12 Thread BigData dev
Hi All, I am facing issue with kafka kerberoized cluster. After following the steps how to enables SASL on kafka by using below link. http://docs.confluent.io/2.0.0/kafka/sasl.html After this,when i start the kafka-server I am getting below error. [2016-04-12 16:59:26,201] ERROR [KafkaApi-1001]

Reg: Contribution to Kafka

2016-03-24 Thread BigData dev
Hi Kafka Contributors, I am interested in contributing to kafka open source. Can you please provide some suggestions in understanding the code of kafka. Can you please provide any method you have followed to understand the code. Regards, BigDataDev