mingchun-zhao opened a new pull request, #154:
URL: https://github.com/apache/manifoldcf/pull/154
Allow me to propose a new feature for crawling mobile sites which restrict
access to content based on User-Agent header.
Actually, Our customer's mobile website was failing to crawl because
mingchun-zhao closed pull request #153: CONNECTORS-1748: Add "User-Agent
platform" option for crawling mobile websites
URL: https://github.com/apache/manifoldcf/pull/153
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
mingchun-zhao opened a new pull request, #153:
URL: https://github.com/apache/manifoldcf/pull/153
Allow me to propose a new feature for crawling mobile sites which restrict
access to content based on User-Agent header.
Actually, Our customer's mobile website was failing to crawl because
