We should be able to extend the Tail command to allow a size specifier. Could you file a JIRA for this?
Although, I don't think the tail prints newlines at every gap unless there's a newline in the data itself, so your "listener" can perhaps wait for that? On Tue, Jul 17, 2012 at 5:19 AM, Sukhendu Chakraborty <sukhendu.chakrabo...@gmail.com> wrote: > Hi, > > Is there a way to get around the 1KB limitation of the hadoop fs -tail > command (http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#tail)? > In my application some of the records can have length greater than 1KB > before the newline and I would like to get the full records as part of > 'tail' (not truncated versions). > > Thanks, > -Sukhendu -- Harsh J