Hello juan, Thursday, May 18, 2006, 10:18:36 AM, you wrote:
I don't think that such usage of html meta tag is good idea. This will lead to not valid HTML code. Google adsense bot uses <!-- ... --> <!-- ... --> HTML comments (if present) to determine which content to use for targeting. Nutch could use the same approach. However this won't be a part of any standard. > Hello, > I proposed a idea. You could use a especial tag like meta in the body. This > tag do not show in html browser and do not need HTML comment. > <html> > <body> > HELLO > <meta name="robots" content="noindex"> > <p> > HELLO NO INDEX > </p> > </meta> > </body> > </html> > > "Nutch Newbie" > <[EMAIL PROTECTED] > il.com> Para > nutch-user@lucene.apache.org > 18/05/2006 08:49 cc > > Asunto > Por favor, Re: robot exclusion portional of a > responda a document > [EMAIL PROTECTED] > .apache.org -- Best regards, Eugen mailto:[EMAIL PROTECTED]
