This feature doesn't currently work. I don't remember the JIRA for it, but there's a ticket which will allow a reader to read from an HDFS file before it's closed. In that case, you implement a queue by having the producer write to the end of the file and the reader read from the beginning of the file.
I'm not sure if there will be a way to tell that a file is still being written, so you may need your own end of stream marker. -Joey On Jun 13, 2011, at 2:55, ltomuno <ltom...@163.com> wrote: > I heard a HDFS file as a producer - consumer queue, a file can be used as a > queue? I am very confused
