KafkaServer in integration test not properly assigning to leaders to partitions

2015-05-14 Thread Corey Nolet
I'm firing up a KafkaServer (using some EmbeddedKafkaBroker code that I found on Github) so that I can run an end-to-end test ingesting data through a kafka topic with consumers in Spark Streaming pushing to Accumulo. Thus far, my code is doing this: 1) Creating a MiniAccumuloCluster and

Re: KafkaServer in integration test not properly assigning to leaders to partitions

2015-05-14 Thread Corey Nolet
I raised the log levels to try to figure out what happens. I see log statements on the broker stating: New topic creation callback for New partition creation callback for Invoking state change to NewPartition for partitions Invoking state change to OnlinePartitions for partitions Error while

Re: KafkaServer in integration test not properly assigning to leaders to partitions

2015-05-14 Thread Corey Nolet
I think I figured out what the problem is, though I'm not sure how to fix it. I've managed to debug through the embedded broker's callback for the TopicChangeListener#handleChildChange() int he PartitionStateMachine class. The following line from that function that's failing look this: val

Re: KafkaServer in integration test not properly assigning to leaders to partitions

2015-05-14 Thread Corey Nolet
Json encoded blob definitely appears to be going in as a json string. The partition assignment json seems to be the only thing that is being prefixed by these bytes. Any ideas? On Thu, May 14, 2015 at 5:17 PM, Corey Nolet cjno...@gmail.com wrote: I think I figured out what the problem is,