Re: can not deal too many files under one folder

2008-09-03 Thread 宫照
deniz > > > > --- On Tue, 9/2/08, 宫照 <[EMAIL PROTECTED]> wrote: > > > From: 宫照 <[EMAIL PROTECTED]> > > Subject: can not deal too many files under one folder > > To: nutch-user@lucene.apache.org > > Date: Tuesday, September 2, 2008, 6:43 AM > &g

Re: can not deal too many files under one folder

2008-09-02 Thread Srinivas Gokavarapu
hi First check whether u have kept the settings for crawling intranet correctly. Here is a link check it out. http://www.folge2.de/tp/search/1/crawling-the-local-filesystem-with-nutch And try one thing Just try to index only one folder containing more than 32 files. Regards, Srinivas. O

Re: can not deal too many files under one folder

2008-09-02 Thread Onur Deniz
http.content.limit... hope this helps.. regards onur deniz --- On Tue, 9/2/08, 宫照 <[EMAIL PROTECTED]> wrote: > From: 宫照 <[EMAIL PROTECTED]> > Subject: can not deal too many files under one folder > To: nutch-user@lucene.apache.org > Date: Tuesday, September 2, 2008, 6:43 AM &g

can not deal too many files under one folder

2008-09-01 Thread 宫照
Hi all, I have post this porblem before, but not solved. I use nutch to crawl on intranet to crawl some documents. For some urls there are many documents under it. I find after crawling, if there are more than 32 files under one folder, I only can search 32 documents before ,other documents afte