It's not a problem. I've done it with up to 30 at a time on a single blade server, each using different lists and outputting to different directories. I didn't see any cross pollination happening.
--- On Tue, 4/21/09, Alexander Aristov <[email protected]> wrote: > From: Alexander Aristov <[email protected]> > Subject: running two crawlers at the same time > To: [email protected] > Date: Tuesday, April 21, 2009, 7:21 AM > Hi all > > I want to run two crawlers using single server at the same > time across > different seed lists. > > The question is > > Is it safe to use one binaries? I have developed scripts to > specify > different input/output locations but I wonder if nutch > creates some > temporarily folders during its work which I cannot control > and so it would > be possible situation when two crawlers overlap working > data. > > Thanks > Alexander Aristov
