It appears that kafka and/or kafka streams has gotten itself into a weird state. My KS app is not running. I try to reset it using the reset command line tool and I get:
ERROR: java.lang.IllegalStateException: Consumer group 'dp-consumption-aggregation-processor-staging2' is still active. Make sure to stop all running application instances before running the reset tool. java.lang.IllegalStateException: Consumer group 'dp-consumption-aggregation-processor-staging2' is still active. Make sure to stop all running application instances before running the reset tool. But as I said the application is not running. So I ran ./kafka-consumer-groups.sh --bootstrap-server smf1-abi-09-sr1.prod.twitter.com:9092 --group dp-consumption-aggregation-processor-staging2 --describe and the first line is Warning: Consumer group 'dp-consumption-aggregation-processor-staging2' is rebalancing. How do I get it out of this state and how did I get it into this state? Thanks! -- Russell Teabeault | Senior Software Engineer | Twitter | @rusticules
