- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Ctrl Z suspends the program. To stop it, use Ctrl C.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforu
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
ctrl Z before I did all the other work...
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=0
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Have you stopped
/usr/local/dpsearch/sbin/indexer
?
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
I just increased max connections to 100 so it should be ok, I have 2 indexers
running now,
BUT>.. I wanted to use cache mode and
changed all dbmode multi to cache
Added this line to
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
What value for max_user_connections do you have for the User biblers_search ?
How many indexers running simultaneously do you have an ow many indexing
threads each of them have ?
By d
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
Hi,
At the end of the day this is the message
SQL-server message: MySQL driver: #1203: User biblers_search has already more
than 'max_user_connections' active connections
indexer[431
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: segfault | Can
Выглядит, как будто нет данных в лимите по категориям. Выполнялась ли команда
indexer -TW
по окончании индексирования и searchd отправлялся сигнал -HUP на перезагрузку
данных об URL и лимитов, если
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Fox
Subject: Re: segfault | Can
Limit присутствует в шаблоне search.htm и searchd.conf
файл error_log не появляется, смог вывести в syslog, следующую инфу, если это
моможет:
###
search.cgi started with '/home/indexer/dpsearch/etc/sear
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
How many indexing threads do you start at same time ? (what is the value for -N
switch for indexer ?)
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
I did that.. thanks a lot for your patience,
One thing keeps happening,
My indexer keeps freezing or something.. it starts, and then it stops after a
few minutes...
at different pages
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Once again, the
Allow *
command just after
Disallow regex amazon\.com
command allows indexing of everything except amazon.com and makes any of Allow
/ Disallow command after it. It se
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
Thats confusing, sorry
Like this , it looks silly!
Allow .html .txt .php .php* .htm */ .shtml .pl
Disallow regex amazon\.com
Allow *
Disallow *
- - - - - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Yes, it is.
Please note, the commands
Disallow regex amazon\.com
Allow *
doesn't play anything, since all documents are dissalowed by the command
Disallow *
above.
If you need to disa
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
Like this
CrossWords yes
CollectLinks yes
DoStore yes
StopwordFile stopwords/en.sl
Include stopwords.conf
Include langmap.conf
MinWordLength 1
MaxWordLength 32
#Allow *
Allow Case *.HT
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Yes, it seems you need to comment in the
Allow *
command on 31st line.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
This is my indexer.conf
Am I doing something wrong?
#VarDir /usr/local/dpsearch/var
#NewsExtensions no
#AccentExtensions no
#SyslogFacility local7
#LocalCharset iso-8859-1
#LocalChars
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Place
Allow *
command in your indexer.conf file below any of Disallow command.
All Allow/Disallow commands are trying on order of appearance in the
indexer.conf and only the first ma
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
Please show the output for the command
/usr/local/dpsearch/sbin/indexer -v5 -n1 -u http://www.amazon.com/%
Yes, it will be huge, post it anyway.
- - - - - - - - - - - - - - - - - - -
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Mike
Subject: Re: getting closer to my end result
Hi, thanks as always,
I give up on cache mode, it is too much trouble... but multi is working nicely
About the amazon exclusion, I put the line you gave me in the indexer.conf but
it
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: getting closer to my end result
When dbmode cache is used, it use caching to reduce disk usage. It looks like
the "bible" word is one of most used in your collection and its buffer have
been already flushed while o
20 matches
Mail list logo
