Your question in unclear: HDFS has no queues for ingesting data (it is a simple, distributed FileSystem). The Hadoop M/R and Hadoop YARN components have queues for processing data purposes.
On Fri, Jan 11, 2013 at 8:42 AM, Panshul Whisper <ouchwhis...@gmail.com> wrote: > Hello, > > I have a hadoop cluster setup of 10 nodes and I an in need of implementing > queues in the cluster for receiving high volumes of data. > Please suggest what will be more efficient to use in the case of receiving > 24 Million Json files.. approx 5 KB each in every 24 hours : > 1. Using Capacity Scheduler > 2. Implementing RabbitMQ and receive data from them using Spring Integration > Data pipe lines. > > I cannot afford to loose any of the JSON files received. > > Thanking You, > > -- > Regards, > Ouch Whisper > 010101010101 -- Harsh J
