1.You can use wget to get the homepage source. 2.Then u can grep the links in it and using cut to get the clear links associated in that page. 3.Doing that recursively all links can be crawled.
-- ATul Singh | Final Year | Computer Science & Engineering | NIT Jalandhar | 9530739855 | -- You received this message because you are subscribed to the Google Groups "Algorithm Geeks" group. To post to this group, send email to algogeeks@googlegroups.com. To unsubscribe from this group, send email to algogeeks+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/algogeeks?hl=en.