Hi, right now i have no alternatives right now. Actually since i only need a fraction of features nutch provides (fetching, parsing, indexing) i'm going to write my own simple spider in .net with traditional database in backend. You can find alternatives here http://en.wikipedia.org/wiki/Web_crawler#Open-source_crawlers
On Jan 4, 2008 7:46 PM, <[EMAIL PROTECTED]> wrote: > > Hi, > > Do you recommended something other than nutch? > > Thanks. > Alex. > > > > > > > > -----Original Message----- > From: Karol Rybak <[EMAIL PROTECTED]> > To: [email protected] > Sent: Fri, 4 Jan 2008 4:15 am > Subject: Re: Nutch - crashed during a large fetch, how to restart? > > > > > > > > > > > Hi there i had similiar experiences with nutch - general unstability, i > experienced a vast range of different crashes and hangups. Actually it > worked stable only on single machine, however when number of urls grown > higher it became useless. So generally speaking i would not recommend it > for > using in production environment to anyone. Maybe there is a way to set it > up > properly for large internet fetches, but i couldn't accomplish that. > > -- > Karol Rybak > Programista / Programmer > Sekcja aplikacji / Applications section > Wyższa Szkoła Informatyki i Zarządzania / University of Internet > Technology > and Management > +48(17)8661277 > > > > > > > > ________________________________________________________________________ > More new features than ever. Check out the new AIM(R) Mail ! - > http://webmail.aim.com > -- Karol Rybak Programista / Programmer Sekcja aplikacji / Applications section Wyższa Szkoła Informatyki i Zarządzania / University of Internet Technology and Management +48(17)8661277
