It is a text file. If we want to use wc, we need to copy file from HDFS and then use wc, and this may take time. Is there a way without copying file from HDFS to local directory?
Thanks On Mon, May 13, 2013 at 11:04 AM, Rahul Bhattacharjee < rahul.rec....@gmail.com> wrote: > few pointers. > > what kind of files are we talking about. for text you can use wc , for > avro data files you can use avro-tools. > > or get the job that pig is generating , get the counters for that job from > the jt of your hadoop cluster. > > Thanks, > Rahul > > > On Mon, May 13, 2013 at 11:21 PM, Mix Nin <pig.mi...@gmail.com> wrote: > >> Hello, >> >> What is the bets way to get the count of records in an HDFS file >> generated by a PIG script. >> >> Thanks >> >> >
