Hey Steven,
I often look for API docs by searching for a method name on google.
Don't think we are too worried about traffic levels so I would suggest not
doing this if it will stop the API docs being searchable with my use case.
Cheers,
Gareth
On 12 Jul 2012, at 05:14, Steve Hathaway wrote:
> Hurray!
>
> The site is now published to the mirrors for XALAN TLP
> "http://xalan.apache.org";
>
> I am now preparing a "robots.txt" file to keep web crawlers out of the program
> generated api documentation. This should limit some excessive traffic and
> still
> have the needed pages captured by internet webpage indexers.
>
> #
> # Xalan website control: robots.txt
> #
> # Keep web crawlers out of auto-generated api documentation pages
> #
> User-agent: *
> Disallow: /xalan-c/apiDocs/
> Disallow: /xalan-j/apidocs/
> Disallow: /old/xalan-c/apiDocs/
> Disallow: /old/xalan-j/apidocs/
>
> Sincerely,
> Steven J. Hathaway
>
>
> On 7/11/2012 8:56 AM, [email protected] wrote:
>> Greetings,
>>
>> I am keeping an eye on this issue!
>>
>> The new website is net yet available on the mirrors. I will check
>> in a few hours, and again tomorrow.
>>
>> Sincerely,
>> Steven J. Hathaway
>> Xalan Documentation Project
>>
>>
>> ==========================================================================
>> [
>> https://issues.apache.org/jira/browse/INFRA-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>> ]
>>
>> Joe Schaefer closed INFRA-5037.
>> -------------------------------
>>
>> Resolution: Fixed
>>
>> Done
>>
>>> XALAN TLP is ready for svnpubsub
>>> --------------------------------
>>>
>>> Key: INFRA-5037
>>> URL: https://issues.apache.org/jira/browse/INFRA-5037
>>> Project: Infrastructure
>>> Issue Type: Task
>>> Security Level: public(Regular issues)
>>> Components: SvnPubSub, Website
>>> Reporter: Steven J. Hathaway
>>>
>>> The Apache XALAN project is ready for web site maintenance using svnpubsub.
>>> Top Level = http://xalan.apache.org
>>> Repository = http://svn.apache.org/repos/asf/xalan/site/docs/xalan/
>>> The web pages in the subversion repository have been reviewed.
>>> There has also been extensive planning and review on my committer's
>>> web page and comments discussed on the developer's mail list.
>>> Sincerely,
>>> Steven J. Hathaway
>>> Xalan Documentation Project
>>> <[email protected]>
>> --
>> This message is automatically generated by JIRA.
>> If you think it was sent incorrectly, please contact your JIRA
>> administrators:
>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>> For more information on JIRA, see: http://www.atlassian.com/software/jira
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [email protected]
>> For additional commands, e-mail: [email protected]
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>
--
Gareth Reakes, CTO we7 - Great Free Music
+44-20-7117-0809 http://www.we7.com
"The music business is a cruel and shallow money trench, a long plastic hallway
where thieves and pimps run free, and good men die like dogs. There's also a
negative side." - Hunter S. Thompson
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
