Re: kafka consumer shell scripts (and kafkacat) with respect to JSON pretty printing

2015-10-20 Thread Ewen Cheslack-Postava
yet include the corresponding formatter. However, the formatter implementation should look very similar to the deserializer. -Ewen -Ewen On Fri, Oct 16, 2015 at 7:10 PM, David Luu wrote: > I was wondering, do the kafka consumer shell scripts (high and low level > ones) and kafkacat do any

kafka consumer shell scripts (and kafkacat) with respect to JSON pretty printing

2015-10-16 Thread David Luu
I was wondering, do the kafka consumer shell scripts (high and low level ones) and kafkacat do any pre-processing of the topic messages before outputting to stdout or does it just output "as is" in the format the message originally came in through kafka from the producer? Meaning pret

Re: kafkacat

2015-05-19 Thread Joe Stein
ending data to kafka and I don't want to spawn lots of kafkacat processes. > > On Tue, May 19, 2015 at 2:40 AM, Magnus Edenhill > wrote: > > > Hi Clay, > > > > not really sure what you mean by socket, but if you want something > > listening on a network port

Re: kafkacat

2015-05-19 Thread clay teahouse
Thanks Magnus. I'll take a look at n2kafka. I have many data sources sending data to kafka and I don't want to spawn lots of kafkacat processes. On Tue, May 19, 2015 at 2:40 AM, Magnus Edenhill wrote: > Hi Clay, > > not really sure what you mean by socket, but if you want so

Re: kafkacat

2015-05-19 Thread clay teahouse
Thanks for the input. I've tried flume but the performance is not nearly as good as kafkacat. On Tue, May 19, 2015 at 2:40 AM, Magnus Edenhill wrote: > Hi Clay, > > not really sure what you mean by socket, but if you want something > listening on a network port and forwards/pro

Re: kafkacat

2015-05-19 Thread Magnus Edenhill
network socket to kafkacat. Regards, Magnus 2015-05-19 2:02 GMT+02:00 clay teahouse : > Hi All, > > Does anyone know of an implementation of kafkacat that reads from socket? > Or for that matter any kafka producer client that can read from socket and > publish to kafka? > > thanks > > Clay >

Re: kafkacat

2015-05-18 Thread Gwen Shapira
Flume with netcat source and Kafka Channel or Kafka Sink will do that. A bit more complex than a Kafkacat equivalent, but will get the job done. On Tue, May 19, 2015 at 3:02 AM, clay teahouse wrote: > Hi All, > > Does anyone know of an implementation of kafkacat that reads from soc

kafkacat

2015-05-18 Thread clay teahouse
Hi All, Does anyone know of an implementation of kafkacat that reads from socket? Or for that matter any kafka producer client that can read from socket and publish to kafka? thanks Clay