- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: skyroam Subject: How to use my own crawler or ftp list file?
Can I use my own crawer to fetch directory list of ftp server and indexed by dpsearch? Can I use ls-lR or file lists ftp direcetoris in other format as source of index? (In lan, "LIST -lRa" or "LIST /dir" can give enough information for most of ftp servers . It is not necessary to do "CWD /dir&&LIST&&QUIT" slowly sometimes even in internet. So I have to use another crawler to speed up indexing.) - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;post=
