Hi All,
I have two questions, providing info on it will be helpful.
1, I am using hadoop to analyze and to find top n search term metric's from
logs.
If any new log file is added to HDFS then again we are running the job to
find the metrics.
Daily we will be getting log files and we are parsing t
Hi Manoj
You can load daily logs into a individual directories in hdfs and process them
daily. Keep those results in hdfs or hbase or dbs etc. Every day do the
processing, get the results and aggregate the same with the previously
aggregated results till date.
Regards
Bejoy KS
Sent from hand
Thank you Bejoy.
Does file append is production stable?
Cheers!
Manoj.
On Sun, Sep 9, 2012 at 10:19 PM, Bejoy KS wrote:
> **
> Hi Manoj
>
> You can load daily logs into a individual directories in hdfs and process
> them daily. Keep those results in hdfs or hbase or dbs etc. Every day do
>