Author: Jussi Email: [EMAIL PROTECTED] Message: Defining http_user_agent variable in php, i wonder what is the proper value for Mnogo? e.g. in case of Google it is: "Googlebot/2.X (+http://www.googlebot.com/bot.html)"
previously 23 Oct: > i can't see notes of any rejection. > indexing just stops. > > > [jussi@inkkari etc]$ indexer -v6 > Indexer[8393]: indexer from mnogosearch-3.1.16/MySQL started with '/usr/etc/ind > exer.conf' > Indexer[8393]: [1] http://some.thing.fi/ > Indexer[8393]: [1] Server 'http://some.thing.fi/' > Indexer[8393]: [1] Allow by default > Indexer[8393]: [1] HTTP/1.1 200 OK > Indexer[8393]: [1] Server: Microsoft-IIS/5.0 > Indexer[8393]: [1] Content-Location: http://some.thing.fi/index.htm > Indexer[8393]: [1] Date: Tue, 23 Oct 2001 12:36:39 GMT > Indexer[8393]: [1] text/html > Indexer[8393]: [1] Accept-Ranges: bytes > Indexer[8393]: [1] Last-Modified: Fri, 20 Jul 2001 09:37:47 GMT > Indexer[8393]: [1] ETag: "40567fa2ff10c11:adb" > Indexer[8393]: [1] Content-Length: 909 > Indexer[8393]: [1] HTTP/1.1 200 OK text/html 909 > Indexer[8393]: [1] "images/Etusivu/vinkki98.gif": Allow by default > Indexer[8393]: [1] http://some.thing.fi/images/Etusivu/vinkki98.gif > Indexer[8393]: [1] Server 'http://some.thing.fi/' > Indexer[8393]: [1] Allow by default > Indexer[8393]: [1] HTTP/1.1 200 OK > Indexer[8393]: [1] Server: Microsoft-IIS/5.0 > Indexer[8393]: [1] Date: Tue, 23 Oct 2001 12:36:40 GMT > Indexer[8393]: [1] image/gif > Indexer[8393]: [1] Accept-Ranges: bytes > Indexer[8393]: [1] Last-Modified: Wed, 12 Jan 2000 14:44:47 GMT > Indexer[8393]: [1] ETag: "a0da7e92b5dbf1:adb" > Indexer[8393]: [1] Content-Length: 6974 > Indexer[8393]: [1] HTTP/1.1 200 OK image/gif 6974 > Indexer[8393]: [1] Done (2 seconds) > Indexer didn't find any links on this document. > > root page is a php-file. > it contains javascript navigation menu and some links to php-files. > can this create the problem? > javascripts are not parsed by indexer. YOu must add links to you pages using for example <NOSCRIPT> tag. You can also detect in your php file who does request page, whether robot or browser and just output different page without scripts and with links in the case of robot. User-Agent HTTP header is responsible for this. In PHP you can check HTTP_USER_AGENT variable. Reply: <http://www.mnogosearch.org/board/message.php?id=3565> ___________________________________________ If you want to unsubscribe send "unsubscribe general" to [EMAIL PROTECTED]
