Josh, On Sun, Nov 30, 2014 at 10:17 PM, Josh J <joshjd...@gmail.com> wrote: > > I would like to setup a Kafka pipeline whereby I write my data to a single > topic 1, then I continue to process using spark streaming and write the > transformed results to topic2, and finally I read the results from topic 2. >
Not really related to your question, but you may also want to look into Samza <http://samza.incubator.apache.org/> which was built exactly for this kind of processing. Tobias