Jenkins build is back to normal : ManifoldCF » ManifoldCF-ant #47

[Apache Jenkins Server]

See 

Jenkins build is back to normal : ManifoldCF » ManifoldCF-Artifacts-Ant-JDK11 #50

[Apache Jenkins Server]

See 

Re: April release

[Karl Wright]

1.28.1

Ah, you mean from build.xml.  Got it.
Karl


On Wed, Apr 20, 2022 at 10:27 AM Karl Wright  wrote:

> Hmm.  From root pom.xml, tika.version is set as follows:
>
>
> On Wed, Apr 20, 2022 at 10:25 AM Karl Wright  wrote:
>
>> Hi, I take it you mean the pom?  That would be a trivial fix.
>> Karl
>>
>>
>> On Wed, Apr 20, 2022 at 10:00 AM Julien Massiera <
>> julien.massi...@francelabs.com> wrote:
>>
>>> Hi Karl,
>>>
>>> First of all we wish you a quick recovery ! Concerning the release, we
>>> ran our tests on the 2.22 branch today, using the Web, Winshare,
>>> SharePoint repository connectors and the transformation connectors Tika
>>> and TikaServiceRmeta.
>>>
>>> There was only one problem with the Tika transformation connector, you
>>> updated the dependencies for the 1.28.1 version but you forgot to update
>>> tika core and tika parsers to this version, they are still in 1.21. Once
>>> those libs are up to date everything works fine.
>>>
>>> How do we proceed for that issue ?
>>>
>>> Regards,
>>> Julien
>>>
>>> On 14/04/2022 23:49, Karl Wright wrote:
>>> > Hi all,
>>> >
>>> > April is now coming to an end and we are scheduled to put out a
>>> ManifoldCF
>>> > release.  Quite a lot has been done for this release, mainly in
>>> updating
>>> > Tika and all of its myriad dependencies, so when the release is
>>> available I
>>> > think we need to run our tests on as many platforms as possible, and if
>>> > possible do a hand smoke test as well (build connections and a job and
>>> run
>>> > it, for as many repositories as we have access to).
>>> >
>>> > This happens at a bad time for me; I am dealing with personal medical
>>> > issues for which there is no easy solution, so my free computer time is
>>> > almost nothing right now.  If the community wants to do this release, I
>>> > have enough time to press all the buttons but I won't have time for
>>> > in-depth testing I fear.  So I am looking for a show of hands as to who
>>> > wants to do the due diligence on the release so we can be assured it's
>>> not
>>> > dead on arrival.  Thanks in advance,
>>> >
>>> > Karl
>>> >
>>> --
>>> Julien MASSIERA
>>> Directeur développement produit
>>> France Labs – Les experts du Search
>>> Datafari – Vainqueur du trophée Big Data 2018 au Digital Innovation
>>> Makers Summit
>>> www.francelabs.com
>>>
>>>

Re: April release

[Karl Wright]

Hmm.  From root pom.xml, tika.version is set as follows:


On Wed, Apr 20, 2022 at 10:25 AM Karl Wright  wrote:

> Hi, I take it you mean the pom?  That would be a trivial fix.
> Karl
>
>
> On Wed, Apr 20, 2022 at 10:00 AM Julien Massiera <
> julien.massi...@francelabs.com> wrote:
>
>> Hi Karl,
>>
>> First of all we wish you a quick recovery ! Concerning the release, we
>> ran our tests on the 2.22 branch today, using the Web, Winshare,
>> SharePoint repository connectors and the transformation connectors Tika
>> and TikaServiceRmeta.
>>
>> There was only one problem with the Tika transformation connector, you
>> updated the dependencies for the 1.28.1 version but you forgot to update
>> tika core and tika parsers to this version, they are still in 1.21. Once
>> those libs are up to date everything works fine.
>>
>> How do we proceed for that issue ?
>>
>> Regards,
>> Julien
>>
>> On 14/04/2022 23:49, Karl Wright wrote:
>> > Hi all,
>> >
>> > April is now coming to an end and we are scheduled to put out a
>> ManifoldCF
>> > release.  Quite a lot has been done for this release, mainly in updating
>> > Tika and all of its myriad dependencies, so when the release is
>> available I
>> > think we need to run our tests on as many platforms as possible, and if
>> > possible do a hand smoke test as well (build connections and a job and
>> run
>> > it, for as many repositories as we have access to).
>> >
>> > This happens at a bad time for me; I am dealing with personal medical
>> > issues for which there is no easy solution, so my free computer time is
>> > almost nothing right now.  If the community wants to do this release, I
>> > have enough time to press all the buttons but I won't have time for
>> > in-depth testing I fear.  So I am looking for a show of hands as to who
>> > wants to do the due diligence on the release so we can be assured it's
>> not
>> > dead on arrival.  Thanks in advance,
>> >
>> > Karl
>> >
>> --
>> Julien MASSIERA
>> Directeur développement produit
>> France Labs – Les experts du Search
>> Datafari – Vainqueur du trophée Big Data 2018 au Digital Innovation
>> Makers Summit
>> www.francelabs.com
>>
>>

Re: April release

[Karl Wright]

Hi, I take it you mean the pom?  That would be a trivial fix.
Karl


On Wed, Apr 20, 2022 at 10:00 AM Julien Massiera <
julien.massi...@francelabs.com> wrote:

> Hi Karl,
>
> First of all we wish you a quick recovery ! Concerning the release, we
> ran our tests on the 2.22 branch today, using the Web, Winshare,
> SharePoint repository connectors and the transformation connectors Tika
> and TikaServiceRmeta.
>
> There was only one problem with the Tika transformation connector, you
> updated the dependencies for the 1.28.1 version but you forgot to update
> tika core and tika parsers to this version, they are still in 1.21. Once
> those libs are up to date everything works fine.
>
> How do we proceed for that issue ?
>
> Regards,
> Julien
>
> On 14/04/2022 23:49, Karl Wright wrote:
> > Hi all,
> >
> > April is now coming to an end and we are scheduled to put out a
> ManifoldCF
> > release.  Quite a lot has been done for this release, mainly in updating
> > Tika and all of its myriad dependencies, so when the release is
> available I
> > think we need to run our tests on as many platforms as possible, and if
> > possible do a hand smoke test as well (build connections and a job and
> run
> > it, for as many repositories as we have access to).
> >
> > This happens at a bad time for me; I am dealing with personal medical
> > issues for which there is no easy solution, so my free computer time is
> > almost nothing right now.  If the community wants to do this release, I
> > have enough time to press all the buttons but I won't have time for
> > in-depth testing I fear.  So I am looking for a show of hands as to who
> > wants to do the due diligence on the release so we can be assured it's
> not
> > dead on arrival.  Thanks in advance,
> >
> > Karl
> >
> --
> Julien MASSIERA
> Directeur développement produit
> France Labs – Les experts du Search
> Datafari – Vainqueur du trophée Big Data 2018 au Digital Innovation Makers
> Summit
> www.francelabs.com
>
>

Re: April release

[Julien Massiera]

Hi Karl,

First of all we wish you a quick recovery ! Concerning the release, we 
ran our tests on the 2.22 branch today, using the Web, Winshare, 
SharePoint repository connectors and the transformation connectors Tika 
and TikaServiceRmeta.


There was only one problem with the Tika transformation connector, you 
updated the dependencies for the 1.28.1 version but you forgot to update 
tika core and tika parsers to this version, they are still in 1.21. Once 
those libs are up to date everything works fine.


How do we proceed for that issue ?

Regards,
Julien

On 14/04/2022 23:49, Karl Wright wrote:

Hi all,

April is now coming to an end and we are scheduled to put out a ManifoldCF
release.  Quite a lot has been done for this release, mainly in updating
Tika and all of its myriad dependencies, so when the release is available I
think we need to run our tests on as many platforms as possible, and if
possible do a hand smoke test as well (build connections and a job and run
it, for as many repositories as we have access to).

This happens at a bad time for me; I am dealing with personal medical
issues for which there is no easy solution, so my free computer time is
almost nothing right now.  If the community wants to do this release, I
have enough time to press all the buttons but I won't have time for
in-depth testing I fear.  So I am looking for a show of hands as to who
wants to do the due diligence on the release so we can be assured it's not
dead on arrival.  Thanks in advance,

Karl


--
Julien MASSIERA
Directeur développement produit
France Labs – Les experts du Search
Datafari – Vainqueur du trophée Big Data 2018 au Digital Innovation Makers 
Summit
www.francelabs.com

[CONNECTORS-1492] - Add support for Docker - Update

[Piergiorgio Lucidi]

Hi folks,

I have just shared some initial commits for adding Docker support to
ManifoldCF (branch CONNECTORS-1492):

https://svn.apache.org/viewvc/manifoldcf/branches/CONNECTORS-1492/?pathrev=1900067

In this branch you will find the following new artifacts:

   - /Dockerfile: build the container from the source, very useful for
   development purpose
   - /src/main/docker/Dockerfile: build the container using the
   distribution package after the build this file will be in the final dist
   folder
   - /src/main/docker/compose: a complete Docker Compose example building
   the container from the online ManifoldCF distribution and using a
   PostgreSQL database as database storage. It doesn't need the local packages
   and it is self-consistent. After the build it will create a new
   example-docker-compose folder in the distribution package

Please let me know what you think.
Thanks.

Cheers,
PJ

-- 
Piergiorgio

[jira] [Resolved] (CONNECTORS-1651) ElasticSearch server is not starting during integration test

[Piergiorgio Lucidi (Jira)]

 [ 
https://issues.apache.org/jira/browse/CONNECTORS-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Piergiorgio Lucidi resolved CONNECTORS-1651.

Resolution: Fixed

r1881393.

> ElasticSearch server is not starting during integration test
> 
>
> Key: CONNECTORS-1651
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1651
> Project: ManifoldCF
>  Issue Type: Bug
>  Components: Elastic Search connector
>Reporter: Piergiorgio Lucidi
>Assignee: Piergiorgio Lucidi
>Priority: Major
>
> Trying to run the test suite on my Mac (with JDK 1.8 but also with JDK 11), 
> ElasticSearch server is not starting properly:
> {noformat}
> [INFO] -< org.apache.manifoldcf:mcf-elasticsearch-connector 
> >--
> [INFO] Building ManifoldCF - Connectors - ElasticSearch 2.17            
> [39/64]
> [INFO] [ jar 
> ]-
> [INFO]
> [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ 
> mcf-elasticsearch-connector ---
> [INFO]
> [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
> mcf-elasticsearch-connector ---
> [INFO]
> [INFO] --- maven-dependency-plugin:2.8:copy (copy-war) @ 
> mcf-elasticsearch-connector ---
> [INFO] Configured Artifact: org.apache.manifoldcf:mcf-api-service:2.17:war
> [INFO] Configured Artifact: 
> org.apache.manifoldcf:mcf-authority-service:2.17:war
> [INFO] Configured Artifact: org.apache.manifoldcf:mcf-crawler-ui:2.17:war
> [INFO] Copying mcf-api-service-2.17.war to 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-api-service.war
> [INFO] Copying mcf-authority-service-2.17.war to 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-authority-service.war
> [INFO] Copying mcf-crawler-ui-2.17.war to 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/dependency/mcf-crawler-ui.war
> [INFO]
> [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
> mcf-elasticsearch-connector ---
> [debug] execute contextualize
> [INFO] Using 'UTF-8' encoding to copy filtered resources.
> [INFO] Copying 5 resources
> [INFO] Copying 4 resources
> [INFO] Copying 3 resources
> [INFO]
> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
> mcf-elasticsearch-connector ---
> [INFO] Compiling 8 source files to 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes
> [INFO]
> [INFO] --- native2ascii-maven-plugin:1.0-beta-1:native2ascii 
> (native2ascii-utf8) @ mcf-elasticsearch-connector ---
> [INFO] Includes: [**/*.properties]
> [INFO] Excludes: []
> [INFO] Processing 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_en_US.properties
> [INFO] Processing 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_ja_JP.properties
> [INFO] Processing 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_zh_CN.properties
> [INFO] Processing 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_fr_FR.properties
> [INFO] Processing 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/classes/org/apache/manifoldcf/agents/output/elasticsearch/common_es_ES.properties
> [INFO]
> [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
> mcf-elasticsearch-connector ---
> [debug] execute contextualize
> [INFO] Using 'UTF-8' encoding to copy filtered resources.
> [INFO] skip non existing resourceDirectory 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/connector/src/test/resources
> [INFO] Copying 3 resources
> [INFO]
> [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
> mcf-elasticsearch-connector ---
> [INFO] Compiling 6 source files to 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/test-classes
> [INFO]
> [INFO] --- maven-surefire-plugin:2.17:test (default-test) @ 
> mcf-elasticsearch-connector ---
> [INFO]
> [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ 
> mcf-elasticsearch-connector ---
> [INFO] Building jar: 
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.17/connectors/elasticsearch/target/mcf-elasticsearch-connector-2.17.jar
> [INFO]
> [INFO] --- maven-site-plugin:3.4:attach-descriptor