Hi, I am working at adding some code to the kafka.Kafka.scala file. What I was thinking for the Utils.loadProps is to create some ResourceNegotiatedConfiguration class or something to sit with it so various frameworks can be supported.
For Mesos I am thinking of storing the properties in zookeeper. For a new node joining => registering a default config (originally set by a tool) and saving it unique for that broker in a znode. This znode would be the input to the serverConfig for the KafkaServerStartable. I am going to create a kafka.tools.ResourceNegotiator.ApacheMesos tool too. that tool will take in a server.properties file to set the original default. Once loaded in zookeeper another command to take a property and flag it with a function to run (like the "use new broker id value") and such. I would rather have some implementation in Kafka.scala and have object KafkaMesos be in Kafka.scala too but wasn't sure what other thoughts folks might have? I will be creating JIRA soon for it. /******************************************* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> ********************************************/
