Re: Question about ManifoldCF 2.8

2017-08-30 Thread Steph van Schalkwyk
Thanks Karl.

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Furkan KAMACI
Hi Steph, Zookeeper is a coordination service for distributed systems. Having a quorum means that more than half of the number of nodes are up and running. This is for protection of brain splitting issue. Zookeeper is a distributed system and it may be down at any time. Brain splitting can be

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Karl Wright
Hi Steph, You can configure your zookeeper however you like; there is a sample configuration file included with MCF that works out of the box. But yes, we do recommend a quorum count of 3 or more. Karl On Wed, Aug 30, 2017 at 2:19 PM, Steph van Schalkwyk wrote: > Karl, > Is

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Steph van Schalkwyk
Karl, Is there a requirement for the number of ZK for MCF? I've used ZK with SOLR, and the minimum quorum count is 3. Thanks Steph

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Beelz Ryuzaki
I'm actually not using zookeeper. i want to know how is zookeeper different from file based sync? I also need a guidance on how to manage my pc's memory. How many Go should I allocate for the start-agent of ManifoldCF? Is 4Go enough in order to crawler 35K files ? Othman. On Wed, 30 Aug 2017 at

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Karl Wright
Your disk is not writable for some reason, and that's interfering with ManifoldCF 2.8 locking. I would suggest two things: (1) Use Zookeeper for sync instead of file-based sync. (2) Have a look if you still get failures after that. Thanks, Karl On Wed, Aug 30, 2017 at 9:37 AM, Beelz Ryuzaki

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Beelz Ryuzaki
Hi Mr Karl, Thank you Mr Karl for your quick response. I have looked into the ManifoldCF log file and extracted the following warnings : - Attempt to set file lock 'D:\\apache_manifoldcf-2.8\multiprocess-file-example\.\.\synch area\569\352\lock-_POOLTARGET_OUTPUTCONNECTORPOOL_ES (Lowercase)

Re: Question about ManifoldCF 2.8

2017-08-30 Thread Karl Wright
Hi Othman, ManifoldCF aborts a job if there's an error that looks like it might go away on retry, but does not. It can be either on the repository side or on the output side. If you look at the Simple History in the UI, or at the manifoldcf.log file, you should be able to get a better sense of

Question about ManifoldCF 2.8

2017-08-30 Thread Beelz Ryuzaki
Hello, I'm Othman Belhaj, a software engineer from société générale in France. I'm actually using your recent version of manifoldCF 2.8 . I'm working on an internal search engine. For this reason, I'm using manifoldcf in order to index documents on windows shares. I encountered a serious problem