Hi Wildn, I don't find the recent news of last 23 days when I do a search on
zipclue. What is the crawl frequency? Also are you storing and displaying the
results from db? The search is quite slow. Original message From:Sjaiful Bahri<
[email protected] >Date: 29 Jan 09 10:51:36Subject:Re: Crawl News WebTo:
[email protected] Wildan,This is the process to crawl news
site:1. Deep First search to identify news site2. Crawl process using regular
expression3. Save result contents into database4. Users ready to find News
through database Wwrote:> Can you share the architecture do you use ? are you >
using nutch also > for the backend ? >>> Regards, > Wildan >> On Tue, Jan 27,
2009 at 4:53 PM, Sjaiful Bahri >wrote: > > FYI, > > Zipclue is designed to
crawl news information on > the > > web effectively and efficiently. > > > >
http://zipclue.com > > > > > > > > Cheers > > iful at http://zipclue.com > > >
> > > > > >>>> > > tobeThink! > www.tobethink.com >> Alignin
g IT and Education >> >> 02199325243 > Y! : hawking123 > Linkedln :
http://www.linkedin.com/in/wildanmaulana >Cheersiful at http://zipclue.com