Re: PostgreSQL version to support MCF v2.10

yes On Wed, Sep 5, 2018 at 12:10 PM Steph van Schalkwyk wrote: > Thank you. So I'll stop for now? > Steph > > > > > *Steph van Schalkwyk* > Principal, Remcam Search Engines > +1.314.452. <+1+314+452+2896>2896st...@remcam.net http://remcam.net > Skype: svanschalkwyk

Re: PostgreSQL version to support MCF v2.10

Thank you. So I'll stop for now? Steph *Steph van Schalkwyk* Principal, Remcam Search Engines +1.314.452. <+1+314+452+2896>2896st...@remcam.net http://remcam.net Skype: svanschalkwyk On We

Re: PostgreSQL version to support MCF v2.10

I'm already working on the Web Connector. The UI has problems that predate this change and I've alerted Kishore about them -- he'll look into them later today. Karl On Wed, Sep 5, 2018 at 11:55 AM Steph van Schalkwyk wrote: > Thank you Karl. > You are of course correct in that the incremental

Re: PostgreSQL version to support MCF v2.10

Thank you Karl. You are of course correct in that the incremental crawl is now broken in that it does a full crawl every time. I'll jump on the Web Connector and add that functionality. Thanks for this excellent application and all the help over the years. Steph *Steph van Schalkwyk* Principal,

Re: PostgreSQL version to support MCF v2.10

The patch I uploaded doesn't work because the entire tab is broken; looks like the UI refactoring broke it and it was never reported. Fixing now. Karl On Wed, Sep 5, 2018 at 3:57 AM Karl Wright wrote: > I coded up the web connector feature I think we need. See > CONNECTORS-1528; I've attached

Re: PostgreSQL version to support MCF v2.10

I coded up the web connector feature I think we need. See CONNECTORS-1528; I've attached a patch. Please apply and test it out to see if it solves the case problem for your IIS site. For the "//" issue, can you be more specific about the mapping you need to do? Karl On Tue, Sep 4, 2018 at 4:1

Re: PostgreSQL version to support MCF v2.10

Hi Steph, Right, you wouldn't want to touch the framework. The effect of lower-casing the documentURI parameter in the addOrReplaceDocumentWithException method in an output connector would be to map multiple, independently-fetched, documents that differ only by the case of the URL together into o

Re: PostgreSQL version to support MCF v2.10

Unless I have a massive misunderstanding somewhere... *Steph van Schalkwyk* Principal, Remcam Search Engines +1.314.452. <+1+314+452+2896>2896st...@remcam.net http://remcam.net Skype: svanschalkwyk

Re: PostgreSQL version to support MCF v2.10

Hi Karl I'm addressing it in the ES Output Connector. Not touching the framework :) S *Steph van Schalkwyk* Principal, Remcam Search Engines +1.314.452. <+1+314+452+2896>2896st...@remcam.net http://remcam.net Skype: svanschalkwyk

Re: PostgreSQL version to support MCF v2.10

Let's make sure we're talking about the same thing. Here is the output connector method that receives the ID (as the documentURI parameter): public int addOrReplaceDocumentWithException(String documentURI, VersionContext pipelineDescription, RepositoryDocument document, String authorityNameStri

Re: PostgreSQL version to support MCF v2.10

Hi Karl. The issue is that the ES Output Connector uses the uri to create the _id. When used with IIS which allows case variation in the URI, it creates multiple documents. Clients on Windows IIS are rarely cognizant of that issue as IIS is so lax in policing that OTB. Currently, every case variati

Re: PostgreSQL version to support MCF v2.10

THanks for the update. Lower-casing the ID would be fine except there are some connectors that care about case. The web connector is one such because it's up to the web service to decide if case matters, so the web connector does not view urls with case differences as being the same. Other connec

Re: PostgreSQL version to support MCF v2.10

Thanks Karl. I'll look into that. Another note: Regarding the ES connector - I have made two additions to it and should probably diff them for inclusion after approval: 1. lowercased _id (the doc URI). 2. Removed dual "/" , e.g. "//" in the _id (I have sloppy sources, particularly IIS...) 3. Adde

Re: PostgreSQL version to support MCF v2.10

Hi Steph, I suspect that Jetty is leaking some resource, and we may need to upgrade it. Karl On Tue, Sep 4, 2018 at 11:26 AM Steph van Schalkwyk wrote: > Olivier > By all means. > The only issue I have seen (totally unrelated) is with Jetty, which has to > be restarted about once a week. Still

Re: PostgreSQL version to support MCF v2.10

Olivier By all means. The only issue I have seen (totally unrelated) is with Jetty, which has to be restarted about once a week. Still trying to find the issue. I may be overly sensitive, but I suspect MCF 2.10 with Postgres10 may be a bit slower. I have no empiric evidence at the moment as I'm sti

Re: PostgreSQL version to support MCF v2.10

Hello, Thanks a lot for sharing your PostgreSQL configuration (sorry for the late answer). I will test it soon. Best regards, Olivier TAVARD > Le 23 août 2018 à 19:20, Steph van Schalkwyk a écrit : > > > > These are the rpm installs: > - file:///tmp/postgres10/postgresql10-libs-1

Re: PostgreSQL version to support MCF v2.10

These are the rpm installs: - file:///tmp/postgres10/postgresql10-libs-10.4-1PGDG.rhel7.x86_64.rpm - file:///tmp/postgres10/postgresql10-10.4-1PGDG.rhel7.x86_64.rpm - file:///tmp/postgres10/postgresql10-contrib-10.4-1PGDG.rhel7.x86_64.rpm - file:///tmp/postgres10/postgresql10-devel-10.4-1PGDG.rhel7

Re: PostgreSQL version to support MCF v2.10

I'll publish them in a bit.

Re: PostgreSQL version to support MCF v2.10

ery types issued by ManifoldCF? > > Best Regards, > > > > Guy > > > > From: Karl Wright [mailto:daddy...@gmail.com <mailto:daddy...@gmail.com>] > Sent: 06 August 2018 12:16 > To: user@manifoldcf.apache.org <mailto:user@manifoldcf.apache.org>

Re: PostgreSQL version to support MCF v2.10

gt; > These errors don’t suggest a retry may sort them out - is this an issue? > > > > Many Thanks, > > > > Guy > > > > *From:* Karl Wright [mailto:daddy...@gmail.com] > *Sent:* 06 August 2018 10:52 > *To:* user@manifoldcf.apache.org > *Subject:* Re

RE: PostgreSQL version to support MCF v2.10

: Karl Wright [mailto:daddy...@gmail.com] Sent: 06 August 2018 12:16 To: user@manifoldcf.apache.org Subject: Re: PostgreSQL version to support MCF v2.10 These are exactly the same kind of issue as the first "error" reported. They will be retried. If they did not get retried, they would abo

Re: PostgreSQL version to support MCF v2.10

om:* Karl Wright [mailto:daddy...@gmail.com] > *Sent:* 06 August 2018 10:52 > *To:* user@manifoldcf.apache.org > *Subject:* Re: PostgreSQL version to support MCF v2.10 > > > > Ah, the following errors: > > >>>>>> > > 2018-08-03 15:52:25.21

RE: PostgreSQL version to support MCF v2.10

: Re: PostgreSQL version to support MCF v2.10 Ah, the following errors: >>>>>> 2018-08-03 15:52:25.218 BST [4140] ERROR: could not serialize access due to read/write dependencies among transactions 2018-08-03 15:52:25.218 BST [4140] DETAIL: Reason code: Canceled on identif

Re: PostgreSQL version to support MCF v2.10

t; >> >> >> Best Regards >> >> >> >> Guy >> >> >> >> *From:* Steph van Schalkwyk [mailto:st...@remcam.net] >> *Sent:* 03 August 2018 23:21 >> *To:* user@manifoldcf.apache.org >> *Subject:* Re: PostgreSQL

Re: PostgreSQL version to support MCF v2.10

Schalkwyk [mailto:st...@remcam.net] > *Sent:* 03 August 2018 23:21 > *To:* user@manifoldcf.apache.org > *Subject:* Re: PostgreSQL version to support MCF v2.10 > > > > I'm using 10.4 with no issues. > > One or two of the recommended settings for MCF have changed betwe

RE: PostgreSQL version to support MCF v2.10

corrected by changing some settings? Best Regards Guy From: Steph van Schalkwyk [mailto:st...@remcam.net] Sent: 03 August 2018 23:21 To: user@manifoldcf.apache.org Subject: Re: PostgreSQL version to support MCF v2.10 I'm using 10.4 with no issues. One or two of the recommended settings fo

Re: PostgreSQL version to support MCF v2.10

I'm using 10.4 with no issues. One or two of the recommended settings for MCF have changed between 9.6 and 10. Simple to resolve though. Steph On Fri, Aug 3, 2018 at 1:29 PM, Karl Wright wrote: > Hi Guy, > > I use Postgresql 9.6 myself and have found no issues with it. I don't > know about v

Re: PostgreSQL version to support MCF v2.10

Hi Guy, I use Postgresql 9.6 myself and have found no issues with it. I don't know about v 10 however. Karl On Fri, Aug 3, 2018 at 11:32 AM Standen Guy wrote: > Hi Karl/All, > >I am upgrading from MCF v2.6 supported by PostgreSQL v > 9.3.16 to MCF v2.10. I wonder if ther

PostgreSQL version to support MCF v2.10

Hi Karl/All, I am upgrading from MCF v2.6 supported by PostgreSQL v 9.3.16 to MCF v2.10. I wonder if there is any official advice as to which version of PostgreSQL will support MCF v2.10? The MCF v2.10 build and deployment instructions still suggest that PostgreSQL 9.3 is