re is no problem with missing robots.txt .
My other configuration:
1) PostgreSQL 7.0.2
2) indexer.conf: Robots yes
3) RedHat 6.2 like Linux system
4) UdmSearch 3.0.20
If someone has sugestion about how to fix the problem I'm looking forward
to hearing a
e.
Hany
--
===
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.megaloman.com/gpg/hanecak-megaloman.txt
===
__
If you want to unsubscribe se
Sincerely
Peter
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.megaloman.com/gpg/hanecak-megaloman.txt
===
__
If you want to unsubscribe send "unsubscribe udmsearch"
to [EMAIL PROTECTED]
led UdmSearch with --enable-linux-pthreads . I have glibc-2.1.3 .
Sincerely
Peter
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.megaloman.com/g
glibc-2.1.3 .
Sincerely
Peter
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.megaloman.com/gpg/hanecak-megaloman.txt
===
diff -uNr udmsearch-3.0.20.orig/src/robots.c udmsearch-3.0.20/src/
On Thu, 10 Aug 2000, Alexander Barkov wrote:
> Hello!
>
> Peter Hanecak wrote:
> >
> > Hello again,
> > > Indexer[5553]: [1] Deleting URL
> > I tried to slightly trace the problem of indexer freezing in "Deleting
> > URL" and
newly
created) database. First "Delete robots.txt" was sucessfull but
right the second or maybe later unavailable robots.txt just locked
indexer. It do not looks like too large table if there are no items, does
it?
> Peter Hanecak wrote:
> >
> > Hello again,
> >
>
indexer.conf which tells indexer not to index such URL anymore
and then when document expires and is scheduled to be reindexed, what will
indexer do?
Will it reindex the document and update database or will it remove
document from database?
Thanks in advance for reply.
Sincerely
Peter Hanecak
; URLs:
status: 200
othere values looks OK (title, keywords, ...)
(I checked just 2 URLs of both groups)
Is that some indexer error?
Sincerely
Peter Hanecak
--
=======
Peter Hanecak <[EMAIL PROTECTED]> - technology manager
al parser - to finish) and add some sleep command into
loop.
Sincerely
Peter Hanecak
p.s.: For now I'm busy but in a few days maybe I manage to look at the
problem closely.
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG
udm.aspseek.com? While I'm not DB expert I think it will help me (and
maybe not just me).
Sincerely
Peter Hanecak
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.megaloman.com
r does.
now it happens to me again: posting before reading all newer messages in
my inbox :) but back to topic:
Thank you for such information. Scarse but helps. :)
Sincerely
Petar Hanecak
--
=======
Peter Hanecak <[EMAIL PROTEC
indexing URLs like:
WWW.MEGALOMAN.SK
www.MEGALOMAN.sk
but still index URL www.megaloman.sk ?
Thanks in advance for any reply.
Sincerely
Peter Hanecak
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key:
Disallow http://[^/]*\.[sS]K/
I think it is working the way I like it.
Alexander, are there any side-effects of such patch I did not notice for
now?
Sincerely
Peter Hanecak
--
=======
Peter Hanecak <[EMAIL PROTECTED]
gt; regex match,
> the second one for insensitive.
Should I try to add some command line switch?
Peter
--
=======
Peter Hanecak <[EMAIL PROTECTED]>
GPG pub.key: http://www.m
and AllowCase.
OK
--
=======
Peter Hanecak <[EMAIL PROTECTED]> - technology manager
Mega & Loman, Stare grunty 52, 842 44 Bratislava, Slovakia
phone, fax: +421-7-654 211 52, web: http://www.megaloman.com
GPG pub.key: http://w
16 matches
Mail list logo