Re: SIGSEGV (0xb) on TransactionCoordinator

2019-01-07 Thread Car Devops
Hi folks :) Can you please Wenxing comfirm that removing G1GC really solved the problem. Unfortunately I faced that issue last night. And what do you mean by " remove the G1GC"? How did you do that? Thanks! -Original Message- From: wenxing zheng [mailto:wenxing.zh...@gmail.com]

Re: Kafka Streams 2.1.0, 3rd time data lose investigation

2019-01-07 Thread John Roesler
Hi Nitay, > I will provide extra logs if it will happen again (I really really hope it > won't hehe :)) Yeah, I hear you. Reproducing errors in production is a real double-edged sword! Thanks for the explanation. It makes sense now. This may be grasping at straws, but it seems like your

RE: Unable to Restrict Access to Consumer Group ACLs

2019-01-07 Thread Chapin, Ryan
Well, I feel a bit stupid on this one . . . . Guess what happens when I discover the following ACL rule that was in place? Current ACLs for resource `Group:*`: User:* has Allow permission for operations: Read from hosts: * And then guess what happens when I delete that rule?

Re: KTable.suppress(Suppressed.untilWindowCloses) does not suppress some non-final results when the kafka streams process is restarted

2019-01-07 Thread John Roesler
Hi Peter, Sorry, I just now have seen this thread. You asked if this behavior is unexpected, and the answer is yes. Suppress.untilWindowCloses is intended to emit only the final result, regardless of restarts. You also asked how the suppression buffer can resume after a restart, since it's not

Automating topic cleanup

2019-01-07 Thread Diogo Vieira
Hello! I’m using a Kafka cluster with dynamically created and temporary topics that each map to a different consumer. After a consumer disconnects the topic isn’t cleaned which means my topics will grow with the consumers. As far as I know, Kafka won’t automatically clean those topics (I

Unable to Restrict Access to Consumer Group ACLs

2019-01-07 Thread Chapin, Ryan
I do not seem to be able to restrict access to specific users for specific consumer groups. It seems as though I am doing something wrong, or that there is a bug as I imagine what I am trying to do is very straight forward. We have an 11 node cluster running the 2.11-1.0.0 open source version

Re: Is kafka support dynamic ACL rule

2019-01-07 Thread ilter P
Hi, While creating the ACL you can do that however while Kafka authorizing it does not support any REGEX for users You have to create a new Authorizer class by extending Authorizer f.i "SimpleAclAuthorizer.scala" ->

Re: One partitions segment files in different log-dirs

2019-01-07 Thread margusja
Hi Thank you for a answer. The answer I was looking for was how partition segment files are distributed over kafka-logs directories? In example I have one broker with two log directories: kafka-logs1 and kafka-logs2 both of them 100MB in example and partition file segment size is 90MB. If