abhinav wrote: > Hi guys.I have to implement a topical crawler as a part of my > project.What language should i implement > C or Python?Python though has fast development cycle but my concern is > speed also.I want to strke a balance between development speed and > crawler speed.Since Python is an interpreted language it is rather > slow.The crawler which will be working on huge set of pages should be > as fast as possible.One possible implementation would be implementing > partly in C and partly in Python so that i can have best of both > worlds.But i don't know to approach about it.Can anyone guide me on > what part should i implement in C and what should be in Python? > Get real. Any web crawler is bound to spend huge amounts of its time waiting for data to come in over network pipes. Or do you have plans for massive parallelism previously unheard of in the Python world?
regards Steve -- Steve Holden +44 150 684 7255 +1 800 494 3119 Holden Web LLC www.holdenweb.com PyCon TX 2006 www.python.org/pycon/ -- http://mail.python.org/mailman/listinfo/python-list