[dataparksearch] [Forum] Re: different search template

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: different search template

Yes, it's possible. You need to alter search.htm template accordingly. This 
template is a text file, so you can use any text editor to modify it. See 
documentation:
http://www.dataparksearch.org/dpsearch-html.en.html
http://www.dataparksearch.org/dpsearch-templates.en.html
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1232591839



[dataparksearch] [Forum] Re: Problem with install of 4.50

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: Problem with install of 4.50

Using configure conly is a valid way to configure dataparksearch. Usually you 
don't need to install jade/jadetex to build dataparksearch until you have to 
make modifications in the documentation. Please show which error is displayed 
when you run configure.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=01;topic_id=1217394663



[dataparksearch] [Forum] Re: bug in 4.52-17012009

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Fox
Subject: Re: bug in 4.52-17012009

Вот еще, это после 20 часов индексирования

#0  0x7fd520910755 in free () from /lib/libc.so.6
#1  0x7fd521c23a45 in DpsVarListFree (vars=0x7fd5109ccc40) at vars.c:308
#2  0x7fd521c23112 in DpsDocFree (Result=0x7fd5109ca8c0) at doc.c:97
#3  0x7fd521c295d2 in DpsURLAction (A=0x3efda40, D=0x7fd5109ca8c0, cmd=19) 
at db.c:620
#4  0x7fd521bd6b77 in DpsIndexNextURL (Indexer=0x3efda40) at indexer.c:2277
#5  0x00405f3c in thread_main (arg=value optimized out) at main.c:899
#6  0x7fd5216e40c0 in start_thread () from /lib/libpthread.so.0
#7  0x7fd52096490d in clone () from /lib/libc.so.6
#8  0x in ?? ()

- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=05;topic_id=1232535535



[dataparksearch] [Forum] indexer.core

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: zabar
Subject: indexer.core

сборка dpsearch-4.52-17012009
индексация в 30 нитей

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type show copying to see the conditions.
There is absolutely no warranty for GDB.  Type show warranty for details.
This GDB was configured as amd64-marcel-freebsd...(no debugging symbols 
found)...
Core was generated by `indexer'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /usr/local/lib/libdpsearch-4.so...(no debugging symbols 
found)...done.
Loaded symbols for /usr/local/lib/libdpsearch-4.so
Reading symbols from /usr/local/lib/libdpcharset-4.so...(no debugging symbols 
found)...done.
Loaded symbols for /usr/local/lib/libdpcharset-4.so
Reading symbols from /lib/libthr.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib/libthr.so.3
Reading symbols from /usr/local/lib/libcares.so.1...(no debugging symbols 
found)...done.
Loaded symbols for /usr/local/lib/libcares.so.1
Reading symbols from /usr/local/lib/mysql/libmysqlclient.so.16...(no debugging 
symbols found)...done.
Loaded symbols for /usr/local/lib/mysql/libmysqlclient.so.16
Reading symbols from /lib/libcrypt.so.4...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.4
Reading symbols from /lib/libm.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.5
Reading symbols from /lib/libz.so.4...(no debugging symbols found)...done.
Loaded symbols for /lib/libz.so.4
Reading symbols from /lib/libc.so.7...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.7
Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done.
Loaded symbols for /libexec/ld-elf.so.1
#0  0x000800683254 in DpsRobotListFree () from 
/usr/local/lib/libdpsearch-4.so
[New Thread 0x8136ac880 (LWP 100316)]
[New Thread 0x8136aca00 (LWP 100312)]
[New Thread 0x8136ac280 (LWP 100309)]
[New Thread 0x8136ac100 (LWP 100306)]
[New Thread 0x8136ac700 (LWP 100302)]
[New Thread 0x8136abb00 (LWP 100299)]
[New Thread 0x8136abc80 (LWP 100296)]
[New Thread 0x8136abf80 (LWP 100292)]
[New Thread 0x8136abe00 (LWP 100289)]
[New Thread 0x8136ab800 (LWP 100286)]
[New Thread 0x8136ab980 (LWP 100284)]
[New Thread 0x8136ab680 (LWP 100280)]
[New Thread 0x8136ab200 (LWP 100276)]
[New Thread 0x8136ab380 (LWP 100273)]
[New Thread 0x8136aad80 (LWP 100270)]
[New Thread 0x8136aa480 (LWP 100266)]
[New Thread 0x8136ab500 (LWP 100263)]
[New Thread 0x8136aaf00 (LWP 100260)]
[New Thread 0x8136aaa80 (LWP 100257)]
[New Thread 0x8136ab080 (LWP 100252)]
[New Thread 0x8136aa600 (LWP 100248)]
[New Thread 0x8136aac00 (LWP 100244)]
[New Thread 0x8136aa900 (LWP 100241)]
[New Thread 0x8136aa780 (LWP 100238)]
[New Thread 0x8136a9e80 (LWP 100236)]
[New Thread 0x801302900 (LWP 100234)]
[New Thread 0x8136aa300 (LWP 100232)]
[New Thread 0x8136aa180 (LWP 100230)]
[New Thread 0x8136aa000 (LWP 100228)]
[New Thread 0x801302600 (LWP 100226)]
[New Thread 0x801302180 (LWP 100150)]
(gdb) thread apply all bt

Thread 31 (Thread 0x801302180 (LWP 100150)):
#0  0x00080117e4cc in nanosleep () from /lib/libc.so.7
#1  0x00080115104c in sleep () from /lib/libc.so.7
#2  0x0008009ed162 in sleep () from /lib/libthr.so.3
#3  0x004060af in ?? ()
#4  0x00407186 in ?? ()
#5  0x00402dfe in ?? ()
#6  0x00080053 in ?? ()
#7  0x in ?? ()
#8  0x0005 in ?? ()
#9  0x7fffe890 in ?? ()
#10 0x7fffe898 in ?? ()
#11 0x7fffe89b in ?? ()
#12 0x7fffe89e in ?? ()
#13 0x7fffe8a1 in ?? ()
#14 0x in ?? ()
#15 0x7fffe8c6 in ?? ()
#16 0x7fffe8e0 in ?? ()
#17 0x7fffe8ec in ?? ()
#18 0x7fffe8f6 in ?? ()
#19 0x7fffe908 in ?? ()
#20 0x7fffe916 in ?? ()
#21 0x7fffecfd in ?? ()
#22 0x7fffed0b in ?? ()
#23 0x7fffed16 in ?? ()
#24 0x7fffee9b in ?? ()
#25 0x7fffeeb2 in ?? ()
#26 0x7fffeec7 in ?? ()
#27 0x7fffeed9 in ?? ()
#28 0x7fffeef6 in ?? ()
#29 0x7fffef11 in ?? ()
#30 0x7fffef28 in ?? ()
#31 0x7fffef3b in ?? ()
#32 0x7fffef5c in ?? ()
#33 0x7fffef64 in ?? ()
#34 0x7fffef83 in ?? ()
#35 0x7fffef90 in ?? ()
#36 0x7fffef99 in ?? ()
#37 0x7fffefa4 in ?? ()
#38 0x in ?? ()
#39 0x0003 in ?? ()
#40 0x00400040 in ?? ()
#41 0x0004 in ?? ()
#42 0x0038 in ?? ()
---Type return to continue, or q return to quit---q
Quit
#0  0x000800683254 in DpsRobotListFree () from 
/usr/local/lib/libdpsearch-4.so


- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:

[dataparksearch] [Forum] Re: Зависимость оперативки от кол-ва сайтов

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Михаил
Subject: Re: Зависимость оперативки от кол-ва сайтов

В dpsearch очень странно реализован алгоритм добавления новых url.
При добавлении 10 URL через файл или urldb каждый процесс начинает занимать 
по 200 метров. Мы решили проблему через ./indexer -i -f файл с записями, 
добавляем не более чем по 1 url.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=06;topic_id=1222466086



[dataparksearch] [Forum] Re: Зависимость оперативки от кол-ва сайтов

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: Зависимость оперативки от кол-ва сайтов

В принципе абсолютно новые ссылки можно добавлять напрямую в таблицу url со 
статусом=0 и next_index_time=0 минуя все проверки.
Но удалять документы таким образом противопоказано.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=06;topic_id=1222466086;page=2



[dataparksearch] [Forum] Re: vivod ssilok rezultatah poiska

2009-01-22 Пенетрантность DataparkSearchForum
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: vivod ssilok rezultatah poiska

Прямого способа получить требуемого нет, но можно извернуться:
Включить сбор ссылок командой
CollectLinks yes
тогда в таблицу links будут записываться ссылки в виде (ot,k), где в качестве 
значений ot и k будут указаны соответсвующие rec_id таблицы url.
После этого вам нужно создать CGI-скрипт, который, получив в качестве параметра 
rec_id, будет выбирать данные из таблиц links и url.
Вызов же скрипта со страницы результатов поиска можно сделать и через include и 
через iframe, или еще лучше xmlhttp (а-ля AJAX), передав нужный rec_id 
используя мете-переменную щаблона $(DP_ID).
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=06;topic_id=1231624980