Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Karl Wright
Hi Olivier, When an error is so severe that really nothing functions, the MCF process encountering it typically aborts. The jobs it is running, however, are fine because their state is contained in the database, so they will resume when the process is restarted. An example of the kind of error t

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
Hi, Thanks for your answers. OK I will definitively use Zookeeper rather file-based synchronization and let you know. For information, the syncharea folder during our crawl was not accessed by any other process. The server is dedicated to MCF. The OS is Debian 8 and the files are on standard L

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Karl Wright
In this case it's the *directory* that it doesn't find, so it can't create the file. If the syncharea is in an NFS-mounted filesystem, then you can get problems of this kind, which is why we strongly advise using Zookeeper instead of playing those kinds of games. Karl On Wed, Oct 11, 2017 at 7:

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Luis Cabaceira
I've seen similar errors (that actually seam like the file is not there or has been deleted, while in fact it exists) due to the reasons i've wrote before. On 11 October 2017 at 15:12, Karl Wright wrote: > This error: > > >> > WARN 2017-10-09 08:23:56,284 (Idle cleanup thread) - > MCF|MCF-ag

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Karl Wright
This error: >> WARN 2017-10-09 08:23:56,284 (Idle cleanup thread) - MCF|MCF-agent|apache.manifoldcf.lock|Attempt to set file lock 'mcf/mcf_home/./syncharea/551/442/lock-_POOLTARGET__ REPOSITORYCONNECTORPOOL_SmbFileShare.lock' failed: No such file or directory java.io.IOException: No such file

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Luis Cabaceira
>From the look of it, this can be coming from a limitation on the number file handles. You process can be creating too many file handles and not closing those in time, eventually preventing further file operations. I suggest you check this, in Linux run : cat /proc/sys/fs/file-max To see the har

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
Hi, Thanks for your answer. Yes I could reach the samba server from the MCF server. Indeed, the first hours after the MCF job was launched, thousands of documents were correctly accessed and processed by MCF. The mentioned errors appeared only after few hours. Before that, the indexation was do

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Cihad Guzel
Hi Olivier, Did you try to connect to samba server with any samba client app? Check Iptables on your server. Can you stop iptables on ubuntu server? Maybe, you can configure iptables. Regards, Cihad Guzel 2017-10-11 12:02 GMT+03:00 Olivier Tavard : > Hi, > > I had this error during crawling a

Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
Hi, I had this error during crawling a Samba hosted on Ubuntu Server : ERROR 2017-10-05 00:00:14,109 (Idle cleanup thread) - MCF|MCF-agent|apache.manifoldcf.crawlerthreads|Exception tossed: Service '_ANON_0' of type '_REPOSITORYCONNECTORPOOL_SmbFileShare' is not active org.apache.manifoldcf.core