Re: mapreduce for proxy log file analysis

2010-08-01 Thread Sonal Goyal
Hi, Have you checked Hive? Seems to fit your needs perfectly. Thanks and Regards, Sonal www.meghsoft.com http://in.linkedin.com/in/sonalgoyal On Sun, Aug 1, 2010 at 1:40 AM, Bright D L wrote: > Hi all, >I am doing a simple project to analyze http proxy server logs by > hadoop mapreduc

mapreduce for proxy log file analysis

2010-07-31 Thread Bright D L
Hi all, I am doing a simple project to analyze http proxy server logs by hadoop mapreduce approach (in Java). The log file contains logs for a week or some times more than that. I have following requirements: 1) Find the top 50 bandwidth consumers (IPs) for each