Re: ManifoldCF + Postgresql - long freeze on job

2019-02-11 Thread LIROT Daniel - SG/SPSSI/CPII/DOSO/ET
apache.org) a écrit : See: https://manifoldcf.apache.org/release/release-1.10/en_US/how-to-build-and-deploy.html#file+properties Look at the table "Advanced properties.xml properties" Karl On Mon, Feb 11, 2019 at 4:16 AM LIROT Daniel - SG/SPSSI/CPII/DOSO/ET <mailto:daniel.li...@

Re: ManifoldCF + Postgresql - long freeze on job

2019-02-11 Thread LIROT Daniel - SG/SPSSI/CPII/DOSO/ET
query plan for the query that queues documents for processing. That may mean more frequent analysis to prevent. But we cannot tell that until we understand what queries are taking a long time. Thanks, Karl On Fri, Feb 8, 2019 at 8:07 AM LIROT Daniel - SG/SPSSI/CPII/DOSO/ET <mail

ManifoldCF + Postgresql - long freeze on job

2019-02-08 Thread LIROT Daniel - SG/SPSSI/CPII/DOSO/ET
Hello, We use ManifoldCF v2.10, with postgresql (9.6) to crawl our websites. this represents approximately 1.2 million documents. We split the crawl into 4 jobs that distribute their results on 3 SOLR collections. The crawl is powerful up to 50 documents (25000 to 3 docs / hour) then