Hi,
I created a message stream in my consumer using connector
.createMessageStreamsByFilter(new Whitelist("mm-benchmark-test\\w*"), 5); I
have 5 topics in my cluster and each of the topic has only one partition.
My understanding of wildcard stream is that multiple streams are shared
between selected topics. In my case 5 streams should be shared between 5
different topics. But when I looked at the log it showed a different story
2015-03-09 19:02:36 INFO kafka.utils.Logging$class:68 -
[test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75],
test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75-0 successfully
owned partition 0 for topic mm-benchmark-test2
2015-03-09 19:02:36 INFO kafka.utils.Logging$class:68 -
[test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75],
test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75-0 successfully
owned partition 0 for topic mm-benchmark-test
2015-03-09 19:02:36 INFO kafka.utils.Logging$class:68 -
[test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75],
test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75-0 successfully
owned partition 0 for topic mm-benchmark-test1
2015-03-09 19:02:36 INFO kafka.utils.Logging$class:68 -
[test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75],
test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75-0 successfully
owned partition 0 for topic mm-benchmark-test4
2015-03-09 19:02:36 INFO kafka.utils.Logging$class:68 -
[test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75],
test12345667ffff_LM-SHC-00950667-1425898953590-d99e2d75-0 successfully
owned partition 0 for topic mm-benchmark-test3
As indicated from the log only one stream was assigned to all topics. I
just wanted to know if this is expected behavior? if yes how do we evenly
distribute topics across different streams? by using roundrobin assigner?
--
Regards,
Tao
