What you're seeing is normal. When your client shuts down, the TCP connection closes, so Heka spins down the goroutines for handling that connection. Each connection gets its own decoder instance, so you're seeing the ProtobufDecoder for that connection exiting.

Since TcpInput defaults to using ProtobufDecoder, you'll need to specify something to override the default. Ideally you'd do some actual parsing here, but if you don't need to do any parsing the most minimal performance impact would probably be to use a ScribbleDecoder to scribble some value onto each message.

-r


On 08/19/2015 01:44 PM, Christian Kniep wrote:
Hey y’all,

after opening an issue on github I am still not sure how to create the
TCP input to allow me sending arbitrary strings.
https://github.com/mozilla-services/heka/issues/1683

I am creating a docker image out of it:
https://github.com/qnib/docker-heka

My heka.toml looks as follows:
##############
[hekad]
maxprocs = 2

[TcpInput]
address = ":5514"
splitter = "newline_splitter"

[newline_splitter]
type = "RegexSplitter"
delimiter = '\n'
delimiter_eol = true

[split_on_space]
type = "TokenSplitter"
delimiter = " "

[PayloadEncoder]
append_newlines = true

[LogOutput]
message_matcher = "TRUE"
encoder = “PayloadEncoder"
##############

If I send a string the TCPInput stops:
##############
[root@heka tmp]# /opt/heka/bin/hekad -config=/etc/heka/hekad.toml
2015/08/19 22:38:14 Pre-loading: [LogOutput]
2015/08/19 22:38:14 Pre-loading: [TcpInput]
2015/08/19 22:38:14 Pre-loading: [newline_splitter]
2015/08/19 22:38:14 Pre-loading: [split_on_space]
2015/08/19 22:38:14 Pre-loading: [PayloadEncoder]
2015/08/19 22:38:14 Pre-loading: [HekaFramingSplitter]
2015/08/19 22:38:14 Loading: [HekaFramingSplitter]
2015/08/19 22:38:14 Pre-loading: [NullSplitter]
2015/08/19 22:38:14 Loading: [NullSplitter]
2015/08/19 22:38:14 Pre-loading: [ProtobufDecoder]
2015/08/19 22:38:14 Loading: [ProtobufDecoder]
2015/08/19 22:38:14 Pre-loading: [ProtobufEncoder]
2015/08/19 22:38:14 Loading: [ProtobufEncoder]
2015/08/19 22:38:14 Pre-loading: [TokenSplitter]
2015/08/19 22:38:14 Loading: [TokenSplitter]
2015/08/19 22:38:14 Loading: [PayloadEncoder]
2015/08/19 22:38:14 Loading: [newline_splitter]
2015/08/19 22:38:14 Loading: [split_on_space]
2015/08/19 22:38:14 Loading: [TcpInput]
2015/08/19 22:38:14 Loading: [LogOutput]
2015/08/19 22:38:14 Starting hekad...
2015/08/19 22:38:14 Output started: LogOutput
2015/08/19 22:38:14 MessageRouter started.
2015/08/19 22:38:14 Input started: TcpInput
2015/08/19 22:38:18 Decoder 'TcpInput-ProtobufDecoder-::1': stopped
2015/08/19 22:38:18
##############
While sending something like this:
# echo "huhu\n"|nc -w1 localhost 5514

Cheers
Christian


_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka

_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka

Reply via email to