Need a Velocity fix, then a patch release

2022-05-07 Thread Karl Wright
Hi all, The release just pushed out the door has two fatal flaws. The first one is that the new LDAP mapper has a name collision with the Regexp mapper. This makes the examples not work; the system fails while registering connectors. Already fixed on trunk. The second problem is that we had

[jira] [Commented] (CONNECTORS-1712) Broken Velocity UI

2022-05-07 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533362#comment-17533362 ] Karl Wright commented on CONNECTORS-1712: - The problem is that we allow velocity templates

[jira] [Assigned] (CONNECTORS-1712) Broken Velocity UI

2022-05-07 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright reassigned CONNECTORS-1712: --- Assignee: Karl Wright > Broken Velocity

[jira] [Commented] (CONNECTORS-1712) Broken Velocity UI

2022-05-07 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533358#comment-17533358 ] Karl Wright commented on CONNECTORS-1712: - So what changed was that Tika now requires

[jira] [Commented] (CONNECTORS-1712) Broken Velocity UI

2022-05-07 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533351#comment-17533351 ] Karl Wright commented on CONNECTORS-1712: - Looking into why the old dependency is still

[RESULT] [VOTE] Release Apache ManifoldCF 2.22, RC3

2022-05-03 Thread Karl Wright
Three +1's, >72 hrs. Vote passes. Karl On Tue, May 3, 2022 at 11:06 AM Julien Massiera < julien.massi...@francelabs.com> wrote: > Ran all tests without error. +1 > > Julien > > -Message d'origine- > De : Karl Wright > Envoyé : mardi 3 mai 2022 12:09

Re: [VOTE] Release Apache ManifoldCF 2.22, RC3

2022-05-03 Thread Karl Wright
Ran all the tests. Looks good! +1 from me. Karl On Fri, Apr 29, 2022 at 10:34 AM Piergiorgio Lucidi wrote: > Hi folks, > > ran all the tests correctly. > +1 from me > > Cheers, > PG > > Il giorno ven 29 apr 2022 alle ore 15:41 Karl Wright > ha scritto:

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-29 Thread Karl Wright
bytes 2 Dir(s) 104,271,101,952 bytes free Note the duplication here of various incompatible mongodb versions. We should fix the clean target in the mongodb/build.xml. But that's not a stop-ship. Karl On Fri, Apr 29, 2022 at 9:13 AM Karl Wright wrote: > Hmm, now I get the s

[VOTE] Release Apache ManifoldCF 2.22, RC3

2022-04-29 Thread Karl Wright
Hi, Please vote on whether to release Apache ManifoldCF 2.22, RC3. The release artifact is at https://dist.apache.org/repos/dist/dev/manifoldcf/apache-manifoldcf-2.22 . There is also a release tag at https://svn.apache.org/repos/asf/manifoldcf/tags/release-2.22-RC3 . This release contains a

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-29 Thread Karl Wright
Hmm, now I get the same thing as well. Ok, let's call this fixed. I'll spin a new RC. Karl On Fri, Apr 29, 2022 at 8:57 AM Piergiorgio Lucidi wrote: > Nope, no errors, I have a BUILD SUCCESSFUL > > Il giorno ven 29 apr 2022 alle ore 14:54 Karl Wright > ha scritto: > > &g

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-29 Thread Karl Wright
o ven 29 apr 2022 alle ore 14:48 Karl Wright > ha scritto: > > > I have same: > > > > 04/28/2022 06:24 AM . > > 04/28/2022 06:24 AM .. > > 04/28/2022 06:24 AM 189,132 > de.flapdoodle.embed.mongo-3

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-29 Thread Karl Wright
I have same: 04/28/2022 06:24 AM . 04/28/2022 06:24 AM .. 04/28/2022 06:24 AM 189,132 de.flapdoodle.embed.mongo-3.4.5.jar 04/28/2022 06:24 AM 111,113 de.flapdoodle.embed.mongo.packageresolver-1.0.3.jar 04/28/2022 06:24 AM 215,729

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-29 Thread Karl Wright
fortunately it seems that I can't reproduce this issue :-P > Any ideas? > > Cheers, > PG > > Il giorno gio 28 apr 2022 alle ore 13:12 Karl Wright > ha scritto: > > > The issue with MongoDB is a missing jar. That jar contains the classes > > used to execute MongoDB

Re: Job Service Interruption- and stops

2022-04-29 Thread Karl Wright
" repeated service interruption" means that it happens again and again. For this particular document, the problem is that the error we are seeing is: "The process cannot access the file because it is being used by another process." ManifoldCF assumes that if it retries enough it should be able

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-28 Thread Karl Wright
The issue with MongoDB is a missing jar. That jar contains the classes used to execute MongoDB locally. These are no longer found in the driver jar. I won't have time for the next week to figure out where the needed classes live now. Karl On Thu, Apr 28, 2022 at 6:37 AM Karl Wright wrote

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-28 Thread Karl Wright
^ > [javac] Note: Some messages have been simplified; recompile with > -Xdiags:verbose to get full output > [javac] 1 error > [javac] 1 warning > > BUILD FAILED > > Please let me know if I missed something > > Julien > > -M

Are we still waiting for a CMIS fix?

2022-04-28 Thread Karl Wright
The reported CMIS problem was that the ant build could not find the "*_patched" version of the file. Piergiorgio, this seemed to me like it was operator error - the user neglected to run the updated ant command "ant make deps" and thus the patched version of the CMIS jar was not available. If

Re: [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-27 Thread Karl Wright
he GitHub sync: https://issues.apache.org/jira/browse/INFRA-23212 > Somehow we have to get the big blobs out of the SVN history. Any ideas? > > Cheers, > Markus > > Am 27.04.2022 um 15:50 schrieb Karl Wright: > > Hi, > > > > Please vote on whether to release Apache Manifold

[jira] [Commented] (CONNECTORS-1622) Upgrade to Tika 1.28.x

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528999#comment-17528999 ] Karl Wright commented on CONNECTORS-1622: - yes. Resolving. > Upgrade to Tika 1.2

[jira] [Resolved] (CONNECTORS-1622) Upgrade to Tika 1.28.x

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright resolved CONNECTORS-1622. - Fix Version/s: ManifoldCF 2.21 (was: ManifoldCF next

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-27 Thread Karl Wright
e next RC WE should also check the ant precommit task. > > > > Travis Ci reports a failing task in the release branch and in trunk. > > > > Another issue i found: Changes.txt seems not reflecting all the resolved > > issues. > > > > Cheers, >

[CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-27 Thread Karl Wright
On Wed, Apr 27, 2022 at 10:21 AM Karl Wright wrote: > This is Piergiorgio's patch; I think he missed something. Piergiorgio? > > Karl > > > On Wed, Apr 27, 2022 at 10:19 AM Julien Massiera < > julien.massi...@francelabs.com> wrote: > >> Build is ok but I stil

Re: [VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-27 Thread Karl Wright
; [junit] at > org.apache.chemistry.opencmis.client.bindings.impl.RepositoryServiceImpl.getRepositoryInfos(RepositoryServiceImpl.java:92) > [junit] at > org.apache.chemistry.opencmis.client.runtime.SessionFactoryImpl.getRepositories(SessionFactoryImpl.java:120) > [junit]

[VOTE] Release Apache ManifoldCF 2.22, RC2

2022-04-27 Thread Karl Wright
Hi, Please vote on whether to release Apache ManifoldCF 2.22, RC2. The release artifact is at https://dist.apache.org/repos/dist/dev/manifoldcf/apache-manifoldcf-2.22 . There is also a release tag at https://svn.apache.org/repos/asf/manifoldcf/tags/release-2.22-RC2 . This release contains a

Re: svn commit: r1900317 - in /manifoldcf/trunk: ./ connectors/mongodb/ connectors/mongodb/connector/src/test/java/org/apache/manifoldcf/agents/output/mongodboutput/tests/

2022-04-27 Thread Karl Wright
Pulled this up (adding CHANGES.txt) to release-2.22-branch. Unless proven otherwise, I think the CXF issue is not an actual problem; it sounds like human error (failure to do ant clean-core-deps). So I will spin a new RC. Karl On Wed, Apr 27, 2022 at 8:46 AM wrote: > Author: piergiorgio >

[jira] [Commented] (CONNECTORS-1707) LiveLink Connector Ant build broken

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528703#comment-17528703 ] Karl Wright commented on CONNECTORS-1707: - Perhaps the problem seen here is simply due

[jira] [Commented] (CONNECTORS-1707) LiveLink Connector Ant build broken

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528701#comment-17528701 ] Karl Wright commented on CONNECTORS-1707: - [~julienFL], you missed doing ant clean-core-deps

[jira] [Commented] (CONNECTORS-1707) LiveLink Connector Ant build broken

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528652#comment-17528652 ] Karl Wright commented on CONNECTORS-1707: - If you want to try experimenting with the ant

[jira] [Commented] (CONNECTORS-1707) LiveLink Connector Ant build broken

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528648#comment-17528648 ] Karl Wright commented on CONNECTORS-1707: - The class in question is in: Artifact cxf-core

[jira] [Commented] (CONNECTORS-1707) LiveLink Connector Ant build broken

2022-04-27 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528645#comment-17528645 ] Karl Wright commented on CONNECTORS-1707: - On a windows system running either Java 8 or Java

[CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-26 Thread Karl Wright
updating that dependency and check if this problem will > be fixed. > > > Il giorno mar 26 apr 2022 alle ore 12:22 Karl Wright > ha scritto: > > > Sounds like a very interesting project! > > > > But we need to resolve the question of the MongoDB testing downloa

Re: [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-26 Thread Karl Wright
te you on this, I'll add this status in a new issue related to the > Docker integration. > > Cheers, > PJ > > > Il giorno lun 25 apr 2022 alle ore 23:28 Karl Wright > ha scritto: > > > Used the lib from the RC. > > > > Worked fine for me: > > >

Re: [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-25 Thread Karl Wright
Used the lib from the RC. Worked fine for me: BUILD SUCCESSFUL Total time: 2 minutes 53 seconds C:\wip\mcf\release-2.22-branch>echo %JAVA_HOME% c:\Program Files\Java\jdk-11.0.4 On Mon, Apr 25, 2022 at 5:19 PM Karl Wright wrote: > hmm, I'm having network problems today and that's block

Re: [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-25 Thread Karl Wright
hmm, I'm having network problems today and that's blocking me. This might have to wait until tomorrow. Karl On Mon, Apr 25, 2022 at 4:33 PM Karl Wright wrote: > CXF is used to produce the missing java files from the checked-in WSDLs. > In order for the binary to have built it was po

Re: [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-25 Thread Karl Wright
tatic String[] lookupTokens(final NodeRights > rights, final ObjectInformation objInfo) > [javac]^ > [javac] symbol: class NodeRights > [javac] location: class CswsConnector > [javac] > /home/francelabs/workspace/

Re: [VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-24 Thread Karl Wright
ISanityHSQLDBIT): > Caused an ERROR > [junit] null > [junit] java.lang.NullPointerException > [junit] at > > org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT.removeTestArea(APISanityHSQLDBIT.java:109) > [junit] at > java.base/jd

[VOTE] Release Apache ManifoldCF 2.22, RC1

2022-04-22 Thread Karl Wright
Hi, Please vote on whether to release Apache ManifoldCF 2.22, RC0. The release artifact is at https://dist.apache.org/repos/dist/dev/manifoldcf/apache-manifoldcf-2.22 . There is also a release tag at https://svn.apache.org/repos/asf/manifoldcf/tags/release-2.22-RC1 . This release contains a

Re: [jira] [Resolved] (CONNECTORS-1705) CMIS Integration Test suite is broken

2022-04-21 Thread Karl Wright
Thanks, Piergiorgio, I will pull this up into the release branch now. On Thu, Apr 21, 2022 at 10:40 AM Piergiorgio Lucidi (Jira) wrote: > > [ > https://issues.apache.org/jira/browse/CONNECTORS-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > ] > > Piergiorgio

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC0

2022-04-21 Thread Karl Wright
apr 2022 alle ore 12:49 Karl Wright > ha scritto: > > > Right now the war is downloaded via ant, I think. We should "patch" it > > when we download it, by unpacking, updating, and repacking. We leave it > in > > a specific place and I don't believe the pom.xml r

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC0

2022-04-21 Thread Karl Wright
t issue. > I ran tests correctly using the new WAR file. > > What could be the best way to overlay the WAR for making it available for > both Ant and Maven? > Maybe using an Ant script and then reuse the same in Maven? > > Cheers, > PJ > > Il giorno gio 21 apr 202

Re: [CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC0

2022-04-21 Thread Karl Wright
istribution WAR. > > I'll keep you updated. > > Cheers, > PJ > > Il giorno gio 21 apr 2022 alle ore 12:11 Karl Wright > ha scritto: > > > I can fix the bad pom but not the CMIS issue, which will require more > > research. > > Karl > > >

[CANCEL] [VOTE] Release Apache ManifoldCF 2.22, RC0

2022-04-21 Thread Karl Wright
gt; at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > > org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) > at > > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) > at > > org.apa

[VOTE] Release Apache ManifoldCF 2.22, RC0

2022-04-21 Thread Karl Wright
Hi, Please vote on whether to release Apache ManifoldCF 2.22, RC0. The release artifact is at https://dist.apache.org/repos/dist/dev/manifoldcf/apache-manifoldcf-2.22 . There is also a release tag at https://svn.apache.org/repos/asf/manifoldcf/tags/release-2.22-RC0 . This release contains a

Re: April release

2022-04-20 Thread Karl Wright
1.28.1 Ah, you mean from build.xml. Got it. Karl On Wed, Apr 20, 2022 at 10:27 AM Karl Wright wrote: > Hmm. From root pom.xml, tika.version is set as follows: > > > On Wed, Apr 20, 2022 at 10:25 AM Karl Wright wrote: > >> Hi, I take it you mean the pom? That w

Re: April release

2022-04-20 Thread Karl Wright
Hmm. From root pom.xml, tika.version is set as follows: On Wed, Apr 20, 2022 at 10:25 AM Karl Wright wrote: > Hi, I take it you mean the pom? That would be a trivial fix. > Karl > > > On Wed, Apr 20, 2022 at 10:00 AM Julien Massiera < > julien.massi...@francelabs.com

Re: April release

2022-04-20 Thread Karl Wright
date > tika core and tika parsers to this version, they are still in 1.21. Once > those libs are up to date everything works fine. > > How do we proceed for that issue ? > > Regards, > Julien > > On 14/04/2022 23:49, Karl Wright wrote: > > Hi all, > > > >

Re: New LDAP Mapper Connector

2022-04-19 Thread Karl Wright
omorrow. > > Regards, > Julien > > -Message d'origine- > De : Karl Wright > Envoyé : lundi 14 février 2022 17:09 > À : dev > Objet : Re: New LDAP Mapper Connector > > We have received zero comment on it. So I think we'll just have to land > it and await c

April release

2022-04-14 Thread Karl Wright
Hi all, April is now coming to an end and we are scheduled to put out a ManifoldCF release. Quite a lot has been done for this release, mainly in updating Tika and all of its myriad dependencies, so when the release is available I think we need to run our tests on as many platforms as possible,

Re: WorkerThread runtime exceptions

2022-03-23 Thread Karl Wright
at > com.francelabs.datafari.connectors.share.SharedDriveConnector.fileExists(SharedDriveConnector.java:2129) > ~[?:?] > at > com.francelabs.datafari.connectors.share.SharedDriveConnector.processDocuments(SharedDriveConnector.java:677) > ~[?:?] > at > org.apa

Re: WorkerThread runtime exceptions

2022-03-23 Thread Karl Wright
On Wed, Mar 23, 2022 at 11:27 AM Karl Wright wrote: > ' 1/ On the first and only one document of the seeding phase encountered, > a runtime exception is triggered' > > The worker threads do not handle seeding. If a runtime exception takes > place during seeding, no documents

Re: WorkerThread runtime exceptions

2022-03-23 Thread Karl Wright
> > -Message d'origine- > De : Julien Massiera > Envoyé : jeudi 24 février 2022 15:08 > À : dev@manifoldcf.apache.org > Objet : RE: WorkerThread runtime exceptions > > Yes I understand > > -Message d'origine- > De : Karl Wright > Envoyé : je

Re: Change way of logging OOM and InterruptedException in WorkerThread

2022-03-15 Thread Karl Wright
Yes, you can do that. Thanks! Karl On Tue, Mar 15, 2022 at 2:19 PM Julien Massiera < julien.massi...@francelabs.com> wrote: > Then I'll create a ticket to just add a date to the system.err.println > output of the OOM, is it ok ? > > -Message d'origine- > De :

Re: Change way of logging OOM and InterruptedException in WorkerThread

2022-03-15 Thread Karl Wright
(1) InterruptedExceptions are thrown during normal shutdown and should generally not be logged. This is by design. (2) OOM conditions can prevent logging from working. So if you want to log those, fine, but please retain the System.err output. Karl On Tue, Mar 15, 2022 at 1:51 PM Julien

Re: Log4j Update Doubt

2022-03-15 Thread Karl Wright
We cannot do back patches of older versions of ManifoldCF. There is a new release which shipped in January that addresses log4j issues. I suggest updating to that. Karl On Tue, Mar 15, 2022 at 8:59 AM ritika jain wrote: > Hi, > > How manifoldcf uses log4j files in bin

Re: WorkerThread runtime exceptions

2022-02-24 Thread Karl Wright
I'm currently completely consumed with upgrading dependencies for Tika and CXF. This is a massive job and won't be done for probably another week or two. Once that is done I can try to look into your concern. Karl On Thu, Feb 24, 2022 at 8:47 AM Julien Massiera <

[jira] [Commented] (CONNECTORS-1622) Upgrade to Tika 1.28.x

2022-02-23 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496796#comment-17496796 ] Karl Wright commented on CONNECTORS-1622: - This issue is now being worked

[jira] [Commented] (CONNECTORS-1699) Upgrade to Tika 2.x

2022-02-22 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496421#comment-17496421 ] Karl Wright commented on CONNECTORS-1699: - Attempting to find the dependencies for 2.3.0

Re: New LDAP Mapper Connector

2022-02-14 Thread Karl Wright
t; > -Message d'origine- > De : Karl Wright > Envoyé : mardi 11 janvier 2022 18:51 > À : dev > Objet : Re: New LDAP Mapper Connector > > Thank you for doing this Julien. > > Let's see what others say and if we hear nothing in a few days, onto trunk > it goe

Re: Manifoldcf freezes and sit idle

2022-01-31 Thread Karl Wright
As I've mentioned before, the best way to diagnose problems like this is to get a thread dump of the agents process. There are many potential reasons it could occur, ranging from stuck locks to resource starvation. What locking model are you using? Karl On Mon, Jan 31, 2022 at 6:02 AM ritika

[jira] [Commented] (CONNECTORS-1695) Sitemap xml not detected in version 2.17 webconnector

2022-01-25 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482114#comment-17482114 ] Karl Wright commented on CONNECTORS-1695: - The interestingMimeTypes are mime types that may

[jira] [Commented] (CONNECTORS-1695) Sitemap xml not detected in version 2.17 webconnector

2022-01-24 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17481420#comment-17481420 ] Karl Wright commented on CONNECTORS-1695: - The problem is that there is no parser in the web

[jira] [Commented] (CONNECTORS-1604) Documentation to run Manifold over SSL

2022-01-22 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480386#comment-17480386 ] Karl Wright commented on CONNECTORS-1604: - Two points: First, the standard configuration

[jira] [Assigned] (CONNECTORS-1665) WebConnector: Add activity records for excluded URLs

2022-01-21 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright reassigned CONNECTORS-1665: --- Assignee: Julien Massiera > WebConnector: Add activity records for exclu

[jira] [Commented] (CONNECTORS-1665) WebConnector: Add activity records for excluded URLs

2022-01-21 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480238#comment-17480238 ] Karl Wright commented on CONNECTORS-1665: - Please go ahead and commit this. > WebConnec

Re: Add logs to repository connectors

2022-01-18 Thread Karl Wright
Having a second log is pretty non-standard, and obscures the ordering of events that may be pertinent. So I am not thrilled with that idea. However, the current logging system does not make it easy to determine where a log message is coming from, nor can you filter log messages with grep easily.

Re: Zookeeper locks issue

2022-01-11 Thread Karl Wright
&& !fullDelta.isEmpty()) { > final boolean isFullDelta = Boolean.parseBoolean(fullDelta); > if (isFullDelta) { > connectorModel = MODEL_ADD_CHANGE; > } else { > connectorModel = MODEL_ADD_CHANGE_DELETE; > } > } else { > connectorMod

Re: New LDAP Mapper Connector

2022-01-11 Thread Karl Wright
Thank you for doing this Julien. Let's see what others say and if we hear nothing in a few days, onto trunk it goes. Karl On Tue, Jan 11, 2022 at 12:37 PM Julien Massiera < julien.massi...@francelabs.com> wrote: > Hi everyone, > > > > I have created the following issue >

[RESULT] [VOTE] Release Apache ManifoldCF 2.21, RC0

2022-01-03 Thread Karl Wright
On Mon, Jan 3, 2022 at 12:31 PM Karl Wright wrote: > Four +1's. >72hrs. Vote passes! > Karl > > > On Mon, Jan 3, 2022 at 9:41 AM Piergiorgio Lucidi > wrote: > >> Hi Karl, >> >> you are right, it's something related to system variables for the Ma

Re: [VOTE] Release Apache ManifoldCF 2.21, RC0

2022-01-03 Thread Karl Wright
run correctly, so +1 from me. > > I'll raise a new issue to work on this after the release. > Cheers, > PJ > > > Il giorno lun 3 gen 2022 alle ore 15:35 Karl Wright > ha > scritto: > > > Hi Piergiorgio - unless this is a regression, I don't think we should &

Re: [VOTE] Release Apache ManifoldCF 2.21, RC0

2022-01-03 Thread Karl Wright
n indexing of 2 websites and > a 10k files share, no problems showed up, so +1 for me > > Julien > > -Message d'origine- > De : Karl Wright > Envoyé : vendredi 31 décembre 2021 19:57 > À : dev > Objet : Re: [VOTE] Release Apache ManifoldCF 2.21, RC0 >

Re: [VOTE] Release Apache ManifoldCF 2.21, RC0

2021-12-31 Thread Karl Wright
We still need one more vote for the release to be finalized. Karl On Wed, Dec 29, 2021 at 9:28 AM Karl Wright wrote: > Ran tests; +1 from me. > Karl > > > On Wed, Dec 29, 2021 at 8:00 AM Markus Schuch > wrote: > >> Hi, >> >> +1 from me >>

Re: [VOTE] Release Apache ManifoldCF 2.21, RC0

2021-12-29 Thread Karl Wright
't think that we have to respin the release for this one (base cvss > score is 6.6). > > Many thanks for managing the release Karl and many thanks to all > contributors. > > I wish everyone a happy new year 2022. > > Markus > > Am 26.12.2021 um 12:30 schrieb Karl Wrigh

[VOTE] Release Apache ManifoldCF 2.21, RC0

2021-12-26 Thread Karl Wright
Hi, Please vote on whether to release Apache ManifoldCF 2.21, RC0. The release candidate can be found at https://dist.apache.org/repos/dist/dev/manifoldcf/apache-manifoldcf-2.21. There is also a release tag at https://svn.apache.org/repos/asf/manifoldcf/tags/release-2.21-RC0. As everyone is

Fwd: [jira] [Resolved] (CONNECTORS-1691) CMIS integration test fails on linux

2021-12-23 Thread Karl Wright
Are we now ready for RC0? Karl -- Forwarded message - From: Markus Schuch (Jira) Date: Thu, Dec 23, 2021 at 7:07 AM Subject: [jira] [Resolved] (CONNECTORS-1691) CMIS integration test fails on linux To: [

Thanks to all committers for going the extra mile to get past the log4j multiple CVEs and releases

2021-12-21 Thread Karl Wright
Marcus and Piergiorgio deserve special thanks for all their hard work. I would like soon to spin the next release of ManifoldCF containing these changes. However, for some of the work being looked at, I am unsure whether open problems still exist or everything is resolved. I'd like to wait

[jira] [Comment Edited] (CONNECTORS-1680) WebConnector: Support the Document Base URL element

2021-12-17 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461575#comment-17461575 ] Karl Wright edited comment on CONNECTORS-1680 at 12/17/21, 5:22 PM

[jira] [Commented] (CONNECTORS-1680) WebConnector: Support the Document Base URL element

2021-12-17 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461575#comment-17461575 ] Karl Wright commented on CONNECTORS-1680: - The baseDocumentIdentifier code is new for adding

Fwd: [jira] [Commented] (CONNECTORS-1686) Solr Ingester: issues with CursorMark

2021-12-15 Thread Karl Wright
Marcus, if Julien does not respond soon, please just reverse merge his commit. svn -c- https://svn.apache.org/repos/asf/manifoldcf/trunk Leaving a broken trunk around is not acceptable. Karl -- Forwarded message - From: Markus Schuch (Jira) Date: Wed, Dec 15, 2021 at 12:54 PM

[jira] [Commented] (CONNECTORS-1685) Alfresco Webscript Connector: Integration test fails on JDKs having patch level > 255

2021-12-15 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460023#comment-17460023 ] Karl Wright commented on CONNECTORS-1685: - Hi [~piergiorgioluc...@gmail.com], sorry

[jira] [Commented] (CONNECTORS-1685) Alfresco Webscript Connector: Integration test fails on JDKs having patch level > 255

2021-12-14 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459104#comment-17459104 ] Karl Wright commented on CONNECTORS-1685: - I've disabled the test conditionally, when

[jira] [Commented] (CONNECTORS-1685) Alfresco Webscript Connector: Integration test fails on JDKs having patch level > 255

2021-12-14 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459092#comment-17459092 ] Karl Wright commented on CONNECTORS-1685: - [~schuch] Our original Alfresco guy has been

Re: Log4j dependency

2021-12-14 Thread Karl Wright
ManifoldCF framework and connectors use log4j 2.x to dump information to the ManifoldCF log file. Please read the following page: https://logging.apache.org/log4j/2.x/security.html Specifically, this part: 'Descripton: Apache Log4j2 <=2.14.1 JNDI features used in configuration, log messages,

[jira] [Commented] (CONNECTORS-1685) Alfresco Webscript Connector: Integration test fails on JDKs having patch level > 255

2021-12-13 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458207#comment-17458207 ] Karl Wright commented on CONNECTORS-1685: - [~schuch], if there is a version of ICU

[jira] [Commented] (CONNECTORS-1626) CSWS Authority does not return all user permissions

2021-12-10 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457491#comment-17457491 ] Karl Wright commented on CONNECTORS-1626: - [~schuch] Please go ahead! > CSWS Authority d

Re: Zookeeper locks issue

2021-12-10 Thread Karl Wright
Hi, > > Not sure to understand what you mean by establishing a connection, what > kind of connection ? If you can explain to me when the agent needs to set > and release locks, I'll be able to better investigate. > > Julien > > -Message d'origine- > De : Karl Wright >

Re: Zookeeper locks issue

2021-12-09 Thread Karl Wright
gs in specific places in the code to try to > understand what is happening. Where would you suggest me to add log > entries to optimise our chances to spot the issue ? > > Julien > > Le 09/12/2021 à 13:27, Karl Wright a écrit : > > The large number of connections can happen bu

Re: Zookeeper locks issue

2021-12-09 Thread Karl Wright
ing the session lifetime > > would solve that particular issue, and since I have no use case to > > easily reproduct it, it is very complicated to debug. > > > > Julien > > > > Le 07/12/2021 à 19:08, Karl Wright a écrit : > >> What this code is doing is

Re: Zookeeper locks issue

2021-12-07 Thread Karl Wright
eperConnection. If you can > take a look and tell me what you think about it, it would be great ! > > Thanks, > > Julien > > Le 07/12/2021 à 14:40, Julien Massiera a écrit : > > Yes, I will then try the patch and see if it is working > > > > Regards, >

Re: Zookeeper locks issue

2021-12-07 Thread Karl Wright
Yes, this is plausible. But I'm not sure what the solution is. If a zookeeper session disappears, according to the documentation everything associated with that session should also disappear. So I guess we could catch this error and just ignore it, assuming that the session must be gone anyway?

[jira] [Commented] (CONNECTORS-1681) TikaServiceRmeta: recordActivity can cause Database exception

2021-11-24 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448749#comment-17448749 ] Karl Wright commented on CONNECTORS-1681: - [~julienFL], the database record just needs

Re: Gradual deprecation and removal of NTLM and SPNEGO support

2021-11-20 Thread Karl Wright
This is not a security issue. The implementation of NTLM is just as secure as the Microsoft implementation. That's not terribly secure but that's inherent in their design. Karl On Sat, Nov 20, 2021 at 7:02 PM larry mccay wrote: > This is a concerning statement and I need some additional

Re: Gradual deprecation and removal of NTLM and SPNEGO support

2021-11-20 Thread Karl Wright
These protocols are, unfortunately, still used. However, the projects I know that use them have not yet moved to 5.x of httpcomponents. Other projects I know of that used to use httpcomponents have since upgraded to different http libraries that supported http 2.0 early on. The hint that all it

[jira] [Resolved] (CONNECTORS-1680) WebConnector: Support the Document Base URL element

2021-11-19 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright resolved CONNECTORS-1680. - Resolution: Fixed r1895187 . Didn't add anything to the tests for this. [~schuch

[jira] [Updated] (CONNECTORS-1680) WebConnector: Support the Document Base URL element

2021-11-19 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright updated CONNECTORS-1680: Fix Version/s: ManifoldCF 2.21 > WebConnector: Support the Document Base URL elem

[jira] [Assigned] (CONNECTORS-1680) WebConnector: Support the Document Base URL element

2021-11-19 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright reassigned CONNECTORS-1680: --- Assignee: Karl Wright > WebConnector: Support the Document Base URL elem

[jira] [Commented] (CONNECTORS-1679) HTML Extractor: output has escaped entities

2021-11-18 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446210#comment-17446210 ] Karl Wright commented on CONNECTORS-1679: - Patch looks good. Would you like to commit

[jira] [Assigned] (CONNECTORS-1679) HTML Extractor: output has escaped entities

2021-11-18 Thread Karl Wright (Jira)
[ https://issues.apache.org/jira/browse/CONNECTORS-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karl Wright reassigned CONNECTORS-1679: --- Assignee: Julien Massiera > HTML Extractor: output has escaped entit

Re: Manifoldcf background process

2021-11-18 Thread Karl Wright
The degree of parallelism can be controlled in two ways. The first way is to set the number of worker threads to something reasonable. Usually, this is no more than about 2x the number of processors you have. The second way is to control the number of connections in your jcifs connector to keep

Re: Manifold Job process isssue

2021-11-15 Thread Karl Wright
T,status=0,flags=0x0000,mid=4,wordCount=0,byteCount=72 > at > jcifs.util.transport.Transport.waitForResponses(Transport.java:365) > at jcifs.util.transport.Transport.sendrecv(Transport.java:232) > at jcifs.smb.SmbTransportImpl.sendrecv(SmbTransportImpl

Re: Manifold Job process isssue

2021-11-09 Thread Karl Wright
One hour is quite a lot and will wreak havoc on the document queue. Karl On Tue, Nov 9, 2021 at 7:08 AM ritika jain wrote: > I have checked, there is only one hour time difference between docker > container and docker host > > On Tue, Nov 9, 2021 at 4:41 PM Karl Wright wrote:

<    1   2   3   4   5   6   7   8   9   10   >