Re: [PHP-DB] big table / hadoop / map reduce

2010-10-30 Thread Artur Ejsmont
sure that was a bit more helpful, thanks :) i was still wondering to what other use cases would that apply. This is a good article (best so far i guess): http://code.google.com/edu/parallel/mapreduce-tutorial.html The thing is that reduce has to aggregate data or it would be impractical. So i am

Re: [PHP-DB] big table / hadoop / map reduce

2010-10-30 Thread Andrés G . Montañez
Hi Artur, in your IPs examples, lets supouse you have ten access log files (from ten different servers), there you already have the mapping part done. Then you reduce each log into anonther new file, indicating the IP address and the times it's repeated. At this stage you have a reduced version

Re: [PHP-DB] big table / hadoop / map reduce

2010-10-30 Thread Artur Ejsmont
yeah i think that would make sense. if you find more good examples from different areas let me know ... i think i get the basic idea ... will try to apply it some time :) cheers :) art On 30 October 2010 18:58, Andrés G. Montañez andresmonta...@gmail.com wrote: Hi Artur, in your IPs