Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Canan GİRGİN
a Lucene] <[hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4049588&i=1>> > > > > > > > > > > > > > > > I use Nutch 2.1 and don't use that crawldb command. I have an > > Hbase > > > > > > database. Can I see such kind o

Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
.472066.n3.nabble.com/Does-Nutch-Checks-Whether-A-Page-crawled-before-or-not-tp4049371.html Sent from the Nutch - User mailing list archive at Nabble.com.

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kiran chitturi
; > > > > > > > > > > > > > > 2013/3/21 kamaci [via Lucene] <[hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4049588&i=1>> > > > > > > > > > > > > > > > I use Nutch 2.1 and

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Lewis John Mcgibbney
; > > > 2013/3/21 kamaci [via Lucene] <[hidden email]< > > > http://user/SendEmail.jtp?type=node&node=4049588&i=1>> > > > > > > > > > > > > > > > I use Nutch 2.1 and don't use that crawldb command. I have an >

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
t use that crawldb command. I have an > Hbase > > > > > database. Can I see such kind of data still? I think readdb > doesn't > > > work > > > > at > > > > > my situaton? > > > > > > > > > > ---

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Tejas Patil
88&i=1>> > > > > > > > > > I use Nutch 2.1 and don't use that crawldb command. I have an Hbase > > > > database. Can I see such kind of data still? I think readdb doesn't > > work > > > at > > > > my situaton? > &

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
; > > > > > > I use Nutch 2.1 and don't use that crawldb command. I have an Hbase > > > database. Can I see such kind of data still? I think readdb doesn't > work > > at > > > my situaton? > > > > > > --------------

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Tejas Patil
of data still? I think readdb doesn't work > at > > my situaton? > > > > -- > > If you reply to this email, your message will be added to the discussion > > below: > > > > > http://lucene.472066.n3.nabble.com/Does-Nutch-C

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
at > my situaton? > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://lucene.472066.n3.nabble.com/Does-Nutch-Checks-Whether-A-Page-crawled-before-or-not-tp4049564p4049582.html > To unsubscribe from Does Nutch Check

RE: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
I use Nutch 2.1 and don't use that crawldb command. I have an Hbase database. Can I see such kind of data still? I think readdb doesn't work at my situaton? -- View this message in context: http://lucene.472066.n3.nabble.com/Does-Nutch-Checks-Whether-A-Page-crawled-bef

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
idden email]<http://user/SendEmail.jtp?type=node&node=4049572&i=1> > > Subject: Re: Does Nutch Checks Whether A Page crawled before or not > > > > Where does Nutch stores that information? > > > > 2013/3/21 Markus Jelsma-2 [via Lucene] < > > [hidden

RE: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Markus Jelsma
> To: user@nutch.apache.org > Subject: Re: Does Nutch Checks Whether A Page crawled before or not > > Where does Nutch stores that information? > > 2013/3/21 Markus Jelsma-2 [via Lucene] < > ml-node+s472066n4049568...@n3.nabble.com> > > > Nutch selects records th

Re: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
il]<http://user/SendEmail.jtp?type=node&node=4049568&i=0>> > > > Sent: Wed 20-Mar-2013 23:46 > > To: [hidden email]<http://user/SendEmail.jtp?type=node&node=4049568&i=1> > > Subject: Does Nutch Checks Whether A Page crawled before or not > > >

RE: Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread Markus Jelsma
s the previously fetchTime + interval. -Original message- > From:kamaci > Sent: Wed 20-Mar-2013 23:46 > To: user@nutch.apache.org > Subject: Does Nutch Checks Whether A Page crawled before or not > > Lets assume that I am crawling wikipedia.org with depth 1 and topN

Does Nutch Checks Whether A Page crawled before or not

2013-03-20 Thread kamaci
.472066.n3.nabble.com/Does-Nutch-Checks-Whether-A-Page-crawled-before-or-not-tp4049564.html Sent from the Nutch - User mailing list archive at Nabble.com.