Re: Solr Repository Connector

2019-08-05 Thread Olivier Tavard
Hello, We are currently working on this kind of repository connector for a customer. We plan to give the code to the MCF project if the customer lets us do it legally. We will know it at the end of the month or at the beginning of next month. In order to have this working, all the fields of th

Re: Error: Unexpected jobqueue status - record id X, expecting active status, saw 4 (MySQL compatible Database)

2019-05-21 Thread Olivier Tavard
Hi Markus, We have the same error (with postgresql database). Did the error occur again since your last mail ? Did you change something on your MCF configuration to fix this ? Thanks, Best regards, Olivier > Le 13 févr. 2019 à 13:58, Markus Schuch a > écrit : > > Hi Karl, > > we set the

Re: web connector : links extraction issues

2018-11-15 Thread Olivier Tavard
not work in MCF, am I right ? Best regards, Olivier > Le 15 nov. 2018 à 12:57, Karl Wright a écrit : > > Hi Olivier, > > You can create a ticket but I don't have a good solution for you in any case. > > Karl > > >> On Thu, Nov 15, 2018 at 6:53 AM

Re: web connector : links extraction issues

2018-11-15 Thread Olivier Tavard
Hi Karl, Do you think that I need to create a Jira issue relative to this bug ie that the links extraction does not work if inside Javascript tags some code contain special characters like '>', '< '? Thanks, Best regards, Olivier > Le 30 oct. 2018 à 12:0

Re: web connector : links extraction issues

2018-10-30 Thread Olivier Tavard
7;http://localhost:/testjs/test.html' — So special characters like the less than sign should be escaped in the code of the web connector to preserve the links extraction. Thanks, Best regards, Olivier > Le 29 oct. 2018 à 19:39, Karl Wright a écrit : > > Hi Olivier,

web connector : links extraction issues

2018-10-29 Thread Olivier Tavard
Hi, Regarding the web connector, I noticed that for specific websites, some Javascript code can prevent the web connector to fetch correctly all the links present on the page. Specifically, for websites that contain a deprecated version of New relic web agent as js-agent.newrelic.com/nr-1071.mi

Re: Logging and Document filter transformation connector

2018-10-17 Thread Olivier Tavard
that the > mechanism is different. You can turn on connector logging and that should > help figure out why the png is being rejected. Once we know that it should > be possible to consider improvements to the history. > > Karl > > On Thu, Oct 11, 2018, 10:41 AM Olivi

Logging and Document filter transformation connector

2018-10-11 Thread Olivier Tavard
Hello, I have a question regarding the Document filter transformation connector and the log about it. I would like to have a look of all the documents excluded by the rules configured in the Document filter transformation connector by looking at the Simple history or by the MCF log but it is no

Re: Debug logging properties location

2018-10-11 Thread Olivier Tavard
found > in each local properties.xml file. The debug properties for logging is, I > believe, global. > > Karl > > > On Thu, Oct 11, 2018 at 8:39 AM Olivier Tavard <mailto:olivier.tav...@francelabs.com>> wrote: > Hello, > > I have a question regarding th

Debug logging properties location

2018-10-11 Thread Olivier Tavard
Hello, I have a question regarding the debug logging properties and their location in the multi process model. If I put the properties in the properties.xml file (as org.apache.manifoldcf.connectors for example), it seems that the properties are not taken into account. In the other hand, if I p

Re: PostgreSQL version to support MCF v2.10

2018-09-04 Thread Olivier Tavard
Hello, Thanks a lot for sharing your PostgreSQL configuration (sorry for the late answer). I will test it soon. Best regards, Olivier TAVARD > Le 23 août 2018 à 19:20, Steph van Schalkwyk a écrit : > > > > These are the rpm installs: > - file:///tmp/postgres10

Re: PostgreSQL version to support MCF v2.10

2018-08-23 Thread Olivier Tavard
Hi, I am also interested by the migration to PostgreSQL 10. @Steph it would be nice if you could precise the changes you did in the configuration file when you wrote : "I'm using 10.4 with no issues. One or two of the recommended settings for MCF have changed between 9.6 and 10. Simple to res

Sharepoint 2013 indexation time performance

2018-06-13 Thread Olivier Tavard
2.8.1, multiprocess with Zookeeper Thanks, Best regards, Olivier TAVARD

Re: ZK based synchronization questions

2017-11-02 Thread Olivier Tavard
Hi Karl, OK it makes senses, thanks for the explanation ! Best regards, Olivier TAVARD > Le 31 oct. 2017 à 17:53, Karl Wright a écrit : > > Hi Olivier, > > Zookeeper connections are pooled, so they are pulled out of the pool at will > by ManifoldCF and returned when th

Re: ZK based synchronization questions

2017-10-31 Thread Olivier Tavard
oct. 2017 à 17:19, Olivier Tavard a > écrit : > > Hello, > > We configured MCF to use ZK sync instead of file sync. We noticed a huge > improvement regarding the stability of the MCF jobs in every case especially > for large data to index (15M of files using the Windows Share

ZK based synchronization questions

2017-10-23 Thread Olivier Tavard
ould it be best to use a ZK installation with version 3.4.8 only for MCF ? So far we did not see any problems using it. Thanks, Best regards, Olivier TAVARD

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
occurs ? Thanks, Olivier TAVARD > Le 11 oct. 2017 à 14:15, Karl Wright a écrit : > > In this case it's the *directory* that it doesn't find, so it can't create > the file. If the syncharea is in an NFS-mounted filesystem, then you can get > problems of this

Re: Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
done correctly. Best regards, Olivier TAVARD > Le 11 oct. 2017 à 11:21, Cihad Guzel a écrit : > > Hi Olivier, > > Did you try to connect to samba server with any samba client app? Check > Iptables on your server. Can you stop iptables on ubuntu server? Maybe, you > c

Job error during WindowsShare repository connector indexation

2017-10-11 Thread Olivier Tavard
e error was repeated indefinitely in the log. Did it mean that there was a problem with the syncharea folder at some point ? Thanks, Best regards, Olivier TAVARD

Rép : Best practices for Postgresql configuration

2017-10-09 Thread Olivier Tavard
use MCF to do it, but you should expect things to > take longer while it is running. If you do a full vacuum, however, most > operations will be blocked until it is done. > > For further optimization, please let us know how many documents you are > indexing. How big is "v

Best practices for Postgresql configuration

2017-10-09 Thread Olivier Tavard
e Postgresql configuration for increase MCF performance. So it would be great to know how MCF users optimize the Postgresql configuration for their use. Thanks, Olivier TAVARD

Windows share connector : fetch ACL for an incremental job

2017-05-02 Thread Olivier Tavard
in two steps : first check the last modified date of the document and after that only if it is different from the date stored into the MCF database, fetch ACL of the file and compare it with the ACLs stored into the MCF database ? Thanks, Olivier TAVARD