I am also interested with hadoop+kafka capabilities. I am using kafka 0.7 , so my question : What is the best way to consume contect from kafka and write it to hdfs? At this time I need the only consuming functionality.
thanks Oleg. On Wed, Aug 7, 2013 at 7:33 PM, <ao...@wikimedia.org> wrote: > Hi all, > > Over at the Wikimedia Foundation, we're trying to figure out the best way > to do our ETL from Kafka into Hadoop. We don't currently use Avro and I'm > not sure if we are going to. I came across this post. > > If the plan is to remove the hadoop-consumer from Kafka contrib, do you > think we should not consider it as one of our viable options? > > Thanks! > -Andrew