Re: Need some clarification of Kafka and MQTT

No, you needs something that can speak mqtt and sent that data to kafka (and possibly the other way around). There are many such alternatives but kafka knows nothing about mqtt Den tis 8 okt. 2019 kl 18:01 skrev Sarvesh Gupta : > Hi, > > We are building some IoT driven solution for industries, I

Re: server-side message filter

The other problem would be that kafka has no idea of the serdes you use in your messages ie it only sees the key and value as bytes so it would be difficult to implement generic filtering in the broker. for your second problem it seems that creating separate topics for respective destinations

Re: Backup and Restore of kafka broker with zookeeper

You have to get a consistent zookeeper cluster before adding your Kafka nodes - they will "mirror" the state in zookeeper. So restore all the files before starting anything. Then start zookeepers and wait for for it to stabilize. Finally start Kafka nodes. - ( with the data in place of course.)

Re: Regarding : Store stream for infinite time

Yes, it will store the last value for each key 2018-01-23 18:30 GMT+01:00 Aman Rastogi : > Hi All, > > We have a use case to store stream for infinite time (given we have enough > storage). > > We are planning to solve this by Log Compaction. If each message key is >

Re: Using JMXMP to access Kafka metrics

I've used jolokia which gets JMX metrics without RMI (actually json over http) https://jolokia.org/ Integrates nicely with telegraf (and influxdb) 2017-07-19 20:47 GMT+02:00 Vijay Prakash < vijay.prak...@microsoft.com.invalid>: > Hey, > > Is there a way to use JMXMP instead of RMI to access

Re: zookeeper usage in kafka offset commit / fetch requests

Just to close this, I found out that the broker handles the request different depending on whether you specify api version 0 or 1. If using V1 the broker commits the offsets to internal topic. /svante

Re: C++ Client Library -- libkafka-asio

, but couldn't find a license? On Sun, Mar 22, 2015 at 8:29 AM, svante karlsson s...@csi.se wrote: Cool, Looks nice. I was looking for something similar a year ago. We also ended up rolling our own. https://github.com/bitbouncer/csi-kafka Have you got any performance figures

zookeeper usage in kafka offset commit / fetch requests

I'm using kafka 0.8.2.0 I'm working on a C++ client library and I'm adding consumer offset management to the client. (https://github.com/bitbouncer/csi-kafka) I know that the creation of zookeeper paths is not handled by kafkabroker so I've manually created

Re: C++ Client Library -- libkafka-asio

Cool, Looks nice. I was looking for something similar a year ago. We also ended up rolling our own. https://github.com/bitbouncer/csi-kafka Have you got any performance figures? /svante 2015-03-22 14:29 GMT+01:00 Daniel Joos dan...@joosweb.de: Hello there, I'm currently working on a C++

decoding of responses with error_codes

I'm writing (yet another) C++ binding for kafka and I'm curious on the encoding in relation to error-code != 0 There seems to be a discrepancy as to how to decode messages in presence of errors. ConsumerMetadataResponse error_code !=0 - no more data should be decoded. in all others we continue

Re: decoding of responses with error_codes

Guozhang Wang wangg...@gmail.com: Hi Svante, This is indeed an issue with the protocol definition of ConsumerMetadataResponse. Do you think this issue is fixed in the following JIRA? https://issues.apache.org/jira/browse/KAFKA-1437 Guozhang On Mon, May 12, 2014 at 1:10 AM, svante