subject:"Re\: \[CANCEL\]\[VOTE\] Release ManifoldCF 2.26, RC0"

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-28 Thread Mingchun Zhao

Hi There,
In order to resolve junit test failure with Solr 9.x Output connector, I
modified MockSolrService to support HTTP2C.
I prepared a PR for this: https://github.com/apache/manifoldcf/pull/157
I confirmed that all test cases of ant test passed.
```
test:
BUILD SUCCESSFUL
Total time: 51 minutes 37 seconds
```

Regards,
Mingchun

2023年10月28日(土) 1:50 Guylaine BASSETTE :

> Just a precision about the Solr NavigationHSQLDBUI test was talking
> about, my problem is about the test environment I failed to configure
> properly in the time I got to work on it. So I don't know if it could
> succeed or not.
>
> Guylaine
> Le 27/10/2023 à 17:34, Guylaine BASSETTE a écrit :
>
> Hi Karl,
>
> The errors shown by Mingchun were puzzling me, so I did some more testing:
> actually, if we set up a real solr 9 server, and modify the Solr test to
> point to it rather than to the mockupsolr, then everything runs fine, the
> tests ends successfully and the data are actually uploaded into solr 9. My
> conclusion is that the error is therefore not at all related to conflicting
> libraries, but probably to the mockupsolrservice that is now somehow
> outdated in the way that it interacts with the jetty client.
>
>
> Joint to this mail, the logs in Solr server and the test results (I have
> added extra logs on job status when I tested)
>
> Here are the modification I have made:
> Remove Mock server launch in SolrCrawlHSQLDBIT class:
>
> public class SolrCrawlHSQLDBIT extends BaseITHSQLDB
> {
>
>   protected SolrTester tester;
>   protected MockSolrService solrService = null;
>
>   public SolrCrawlHSQLDBIT()
>   {
> tester = new SolrTester(mcfInstance);
>   }
>
>   @Test
>   public void simpleCrawl()
> throws Exception
>   {
> tester.executeTest();
>   }
> }
>
>
> In SolrTester:
>
> configParams.setParameter(SolrConfig.PARAM_SERVER,"IP_SOLR_SERVER");
> // To be replaced with the Solr server IP
> configParams.setParameter(SolrConfig.PARAM_PORT,"8983");
>
> configParams.setParameter(SolrConfig.PARAM_WEBAPPNAME,"solr/techproducts");
> configParams.setParameter(SolrConfig.PARAM_COLLECTION, "solr");
>
> I was not able to pass the NavigationHSQLDBUI test.
>
> Sorry, I won't be available next week to go further. I hope this will help
> !
>
> Guylaine
> Le 27/10/2023 à 13:40, Karl Wright a écrit :
>
> That is indeed reassuring.  It probably means that the test needs some
> changes, is all.  But we cannot be sure the newer Zookeeper wouldn't mess
> things up without having the test be successful at least with the older
> zookeeper.
>
> Karl
>
>
> On Fri, Oct 27, 2023 at 7:32 AM Guylaine BASSETTE 
>  wrote:
>
>
> Sorry for not executing all of the tests: I'm quite new to the MCF
> project, and I focused only on the core-framework tests as it was the
> key aspect highlighted in the related jira issue. I didn't know I had to
> run other tests such as the IT ones. It is to be noted that we tested
> the MCF with Solr 9 embedded in our Datafari, and after quite some
> indexing, we have seen no problems at all, which sounds quite reassuring
>
> Le 27/10/2023 à 12:49, Karl Wright a écrit :
>
> Okay, well I wouldnt have approved the upgrade had I known that the tests
> didn't pass!  So we need to understand the problem as soon as possible.
>
> Karl
>
>
> On Fri, Oct 27, 2023 at 2:50 AM Guylaine BASSETTE 
>  wrote:
>
>
> Hello all,
>
> Sadly, the error remains the same even with the previous Zookeeper
> version (3.8.0). Actually, I'm not able to pass the test since we have
> passed to Solr 9.
>
> Le 27/10/2023 à 01:51, Karl Wright a écrit :
>
> It is possible that Solr needs the older version of Zookeeper. If you
> swap out the current one and replace it with the one the version of
> SolrJ we use references, does the test pass then? If it does, we're
> going to have to figure out how to address the fact that we have two
> connectors that each depend on a different version of zookeeper. But
> first please let me know if it works. I'll suggest a way of
> reconciling these once I know.
>
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our
>
> version
>
> 5www.datafari.com   
>
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our version
> 5www.datafari.com  
>
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our version
> 5
> www.datafari.com
>
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our version
> 5
> www.datafari.com
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-27 Thread Karl Wright

That is indeed reassuring.  It probably means that the test needs some
changes, is all.  But we cannot be sure the newer Zookeeper wouldn't mess
things up without having the test be successful at least with the older
zookeeper.

Karl


On Fri, Oct 27, 2023 at 7:32 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> Sorry for not executing all of the tests: I'm quite new to the MCF
> project, and I focused only on the core-framework tests as it was the
> key aspect highlighted in the related jira issue. I didn't know I had to
> run other tests such as the IT ones. It is to be noted that we tested
> the MCF with Solr 9 embedded in our Datafari, and after quite some
> indexing, we have seen no problems at all, which sounds quite reassuring
>
> Le 27/10/2023 à 12:49, Karl Wright a écrit :
> > Okay, well I wouldnt have approved the upgrade had I known that the tests
> > didn't pass!  So we need to understand the problem as soon as possible.
> >
> > Karl
> >
> >
> > On Fri, Oct 27, 2023 at 2:50 AM Guylaine BASSETTE <
> > guylaine.basse...@francelabs.com> wrote:
> >
> >> Hello all,
> >>
> >> Sadly, the error remains the same even with the previous Zookeeper
> >> version (3.8.0). Actually, I'm not able to pass the test since we have
> >> passed to Solr 9.
> >>
> >> Le 27/10/2023 à 01:51, Karl Wright a écrit :
> >>> It is possible that Solr needs the older version of Zookeeper. If you
> >>> swap out the current one and replace it with the one the version of
> >>> SolrJ we use references, does the test pass then? If it does, we're
> >>> going to have to figure out how to address the fact that we have two
> >>> connectors that each depend on a different version of zookeeper. But
> >>> first please let me know if it works. I'll suggest a way of
> >>> reconciling these once I know.
> >> --
> >> Cordialement,
> >> Guylaine
> >>
> >> France Labs – Your knowledge, now
> >> Datafari Enterprise Search – Découvrez la version 5 / Discover our
> version
> >> 5
> >> www.datafari.com  
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our version
> 5
> www.datafari.com

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-27 Thread Guylaine BASSETTE

Sorry for not executing all of the tests: I'm quite new to the MCF 
project, and I focused only on the core-framework tests as it was the 
key aspect highlighted in the related jira issue. I didn't know I had to 
run other tests such as the IT ones. It is to be noted that we tested 
the MCF with Solr 9 embedded in our Datafari, and after quite some 
indexing, we have seen no problems at all, which sounds quite reassuring


Le 27/10/2023 à 12:49, Karl Wright a écrit :

Okay, well I wouldnt have approved the upgrade had I known that the tests
didn't pass!  So we need to understand the problem as soon as possible.

Karl


On Fri, Oct 27, 2023 at 2:50 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:


Hello all,

Sadly, the error remains the same even with the previous Zookeeper
version (3.8.0). Actually, I'm not able to pass the test since we have
passed to Solr 9.

Le 27/10/2023 à 01:51, Karl Wright a écrit :

It is possible that Solr needs the older version of Zookeeper. If you
swap out the current one and replace it with the one the version of
SolrJ we use references, does the test pass then? If it does, we're
going to have to figure out how to address the fact that we have two
connectors that each depend on a different version of zookeeper. But
first please let me know if it works. I'll suggest a way of
reconciling these once I know.

--
Cordialement,
Guylaine

France Labs – Your knowledge, now
Datafari Enterprise Search – Découvrez la version 5 / Discover our version
5
www.datafari.com  

--
Cordialement,
Guylaine

France Labs – Your knowledge, now
Datafari Enterprise Search – Découvrez la version 5 / Discover our version 5
www.datafari.com

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-27 Thread Karl Wright

Okay, well I wouldnt have approved the upgrade had I known that the tests
didn't pass!  So we need to understand the problem as soon as possible.

Karl


On Fri, Oct 27, 2023 at 2:50 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> Hello all,
>
> Sadly, the error remains the same even with the previous Zookeeper
> version (3.8.0). Actually, I'm not able to pass the test since we have
> passed to Solr 9.
>
> Le 27/10/2023 à 01:51, Karl Wright a écrit :
> > It is possible that Solr needs the older version of Zookeeper. If you
> > swap out the current one and replace it with the one the version of
> > SolrJ we use references, does the test pass then? If it does, we're
> > going to have to figure out how to address the fact that we have two
> > connectors that each depend on a different version of zookeeper. But
> > first please let me know if it works. I'll suggest a way of
> > reconciling these once I know.
> --
> Cordialement,
> Guylaine
>
> France Labs – Your knowledge, now
> Datafari Enterprise Search – Découvrez la version 5 / Discover our version
> 5
> www.datafari.com

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-27 Thread Guylaine BASSETTE


Hello all,

Sadly, the error remains the same even with the previous Zookeeper 
version (3.8.0). Actually, I'm not able to pass the test since we have 
passed to Solr 9.


Le 27/10/2023 à 01:51, Karl Wright a écrit :
It is possible that Solr needs the older version of Zookeeper. If you 
swap out the current one and replace it with the one the version of 
SolrJ we use references, does the test pass then? If it does, we're 
going to have to figure out how to address the fact that we have two 
connectors that each depend on a different version of zookeeper. But 
first please let me know if it works. I'll suggest a way of 
reconciling these once I know.

--
Cordialement,
Guylaine

France Labs – Your knowledge, now
Datafari Enterprise Search – Découvrez la version 5 / Discover our version 5
www.datafari.com

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Karl Wright

It is possible that Solr needs the older version of Zookeeper.
If you swap out the current one and replace it with the one the version of
SolrJ we use references, does the test pass then?  If it does, we're going
to have to figure out how to address the fact that we have two connectors
that each depend on a different version of zookeeper.  But first please let
me know if it works.  I'll suggest a way of reconciling these once I know.

Karl


On Thu, Oct 26, 2023 at 7:37 PM Mingchun Zhao 
wrote:

> I ran the ant test using Guylaine's patch and the Kafka IT test passed!
> However, the Solr IT test failure still occurs.
> ```
> run-IT-HSQLDB:
> [junit] Testsuite:
> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> [junit] Configuration file successfully read
> [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
> @6974ms to org.eclipse.jetty.util.log.Slf4jLog
> [junit] [main] INFO org.eclipse.jetty.server.Server -
> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
> [junit] [main] INFO org.eclipse.jetty.server.session -
> DefaultSessionIdManager workerName=node0
> [junit] [main] INFO org.eclipse.jetty.server.session - No
> SessionScavenger set, using defaults
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
> every 66ms
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@4565a70a{ManifoldCF Crawler
>
> Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-3250496980318085250/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-crawler-ui.war}
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@a0a9fa5{ManifoldCF Authorities API
>
> Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-6182863812882423778/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-authority-service.war}
> [junit] Creating mock service
> [junit] Mock service created
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@15723761{ManifoldCF General API
>
> Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-14231646742487500933/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-api-service.war}
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Started ServerConnector@6f63c44f{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9062ms
> [junit] [main] INFO org.eclipse.jetty.server.Server -
> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
> [junit] [main] INFO org.eclipse.jetty.server.session -
> DefaultSessionIdManager workerName=node0
> [junit] [main] INFO org.eclipse.jetty.server.session - No
> SessionScavenger set, using defaults
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
> every 66ms
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.s.ServletContextHandler@6b2e0f78{/solr,null,AVAILABLE}
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Started ServerConnector@3ec2ecea{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9071ms
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Stopped ServerConnector@3ec2ecea{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
> scavenging
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Stopped o.e.j.s.ServletContextHandler@6b2e0f78{/solr,null,STOPPED}
> ```
>
> 2023年10月27日(金) 0:35 Guylaine BASSETTE :
>
> > Hi Mingchun,
> >
> > If you want, you can access my repository directly:
> > https://github.com/guylaine-bassette/manifoldcf
> >
> > I have made a Fork of Github ManifoldCF. Use the branch:
> > Fix-kafka-IT-tests. It is up to date with the last trunk commit.
> >
> > Le 26/10/2023 à 17:13, Mingchun Zhao a écrit :
> > > Sorry, there was a typo: track -> trunk
> > >
> > > 2023年10月27日(金) 0:12 Mingchun Zhao:
> > >
> > >> Hi Guylaine, Thanks!
> > >> Was your patch based on the latest track? Unfortunately, I was unable
> to
> > >> apply your patch in my environment.
> > >>
> > >> 2023年10月26日(木) 20:44 Guylaine BASSETTE<
> guylaine.basse...@francelabs.com
> > >:
> > >>
> > >>> Hello Mingchun,
> > >>>
> > >>> As mentioned in my previous e-mail to Karl, my

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Mingchun Zhao

I ran the ant test using Guylaine's patch and the Kafka IT test passed!
However, the Solr IT test failure still occurs.
```
run-IT-HSQLDB:
[junit] Testsuite:
org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
[junit] Configuration file successfully read
[junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
@6974ms to org.eclipse.jetty.util.log.Slf4jLog
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 66ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@4565a70a{ManifoldCF Crawler
Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-3250496980318085250/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-crawler-ui.war}
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@a0a9fa5{ManifoldCF Authorities API
Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-6182863812882423778/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-authority-service.war}
[junit] Creating mock service
[junit] Mock service created
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@15723761{ManifoldCF General API
Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-14231646742487500933/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/guylaine/manifoldcf/dist/web/war/mcf-api-service.war}
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@6f63c44f{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9062ms
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 66ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.s.ServletContextHandler@6b2e0f78{/solr,null,AVAILABLE}
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@3ec2ecea{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9071ms
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Stopped ServerConnector@3ec2ecea{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
scavenging
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Stopped o.e.j.s.ServletContextHandler@6b2e0f78{/solr,null,STOPPED}
```

2023年10月27日(金) 0:35 Guylaine BASSETTE :

> Hi Mingchun,
>
> If you want, you can access my repository directly:
> https://github.com/guylaine-bassette/manifoldcf
>
> I have made a Fork of Github ManifoldCF. Use the branch:
> Fix-kafka-IT-tests. It is up to date with the last trunk commit.
>
> Le 26/10/2023 à 17:13, Mingchun Zhao a écrit :
> > Sorry, there was a typo: track -> trunk
> >
> > 2023年10月27日(金) 0:12 Mingchun Zhao:
> >
> >> Hi Guylaine, Thanks!
> >> Was your patch based on the latest track? Unfortunately, I was unable to
> >> apply your patch in my environment.
> >>
> >> 2023年10月26日(木) 20:44 Guylaine BASSETTE >:
> >>
> >>> Hello Mingchun,
> >>>
> >>> As mentioned in my previous e-mail to Karl, my patch contained other
> >>> files to be updated. I don't know why they don't have been taken into
> >>> account, but would you be interested in trying my patch? I have fixed
> the
> >>> spots I had missed... (joint with this mail)
> >>>
> >>> With these modifications I went through all tests of kafka.
> >>> Le 26/10/2023 à 03:47, Mingchun Zhao a écrit :
> >>>
> >>> Hi there, Allow me to share my `ant test` result using the latest
> Github
> >>> trunk.
> >>> I got a lot of `Broker may not be available` warnings in the Kafka IT
> test
> >>> and it eventually failed.
> >>>
> >>> ```
> >>> ...
> >>>  [junit] [kafka-producer-network-thread | producer-3] INFO
> >>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Guylaine BASSETTE


Hi Mingchun,

If you want, you can access my repository directly: 
https://github.com/guylaine-bassette/manifoldcf


I have made a Fork of Github ManifoldCF. Use the branch: 
Fix-kafka-IT-tests. It is up to date with the last trunk commit.


Le 26/10/2023 à 17:13, Mingchun Zhao a écrit :

Sorry, there was a typo: track -> trunk

2023年10月27日(金) 0:12 Mingchun Zhao:


Hi Guylaine, Thanks!
Was your patch based on the latest track? Unfortunately, I was unable to
apply your patch in my environment.

2023年10月26日(木) 20:44 Guylaine BASSETTE:


Hello Mingchun,

As mentioned in my previous e-mail to Karl, my patch contained other
files to be updated. I don't know why they don't have been taken into
account, but would you be interested in trying my patch? I have fixed the
spots I had missed... (joint with this mail)

With these modifications I went through all tests of kafka.
Le 26/10/2023 à 03:47, Mingchun Zhao a écrit :

Hi there, Allow me to share my `ant test` result using the latest Github
trunk.
I got a lot of `Broker may not be available` warnings in the Kafka IT test
and it eventually failed.

```
...
 [junit] [kafka-producer-network-thread | producer-3] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Node 0 disconnected.
 [junit] [kafka-producer-network-thread | producer-3] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
 [junit] [kafka-producer-network-thread | producer-1] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
Node 0 disconnected.
 [junit] [kafka-producer-network-thread | producer-1] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
 [junit] [kafka-producer-network-thread | producer-2] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
Node 0 disconnected.
 [junit] [kafka-producer-network-thread | producer-2] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
 [junit] [kafka-producer-network-thread | producer-3] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Node 0 disconnected.
 [junit] [kafka-producer-network-thread | producer-3] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
 [junit] -  ---
 [junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
Caused an ERROR
 [junit] ManifoldCF did not terminate in the allotted time of 12
milliseconds
 [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException:
ManifoldCF did not terminate in the allotted time of 12 milliseconds
 [junit] at
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.waitJobInactive(APISanityHSQLDBIT.java:289)
 [junit] at
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.sanityCheck(APISanityHSQLDBIT.java:177)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 [junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 [junit]
 [junit]

BUILD FAILED
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1104:
Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed

Total time: 38 minutes 13 seconds
```


2023年10月26日(木) 5:42 Karl Wright  :


I see you have committed this.  You missed a few spots; the extra jar was
mentioned in multiple places.  I committed another fix to correct that.

Karl


On Wed, Oct 25, 2023 at 10:46 AM Guylaine 
BASSETTE  wrote:


Hello Karl,

Thank you very much for this update! I have tested your suggestions and
kafka ITs tests ended successfully. :-)

Here you can find the patch.

My only doubt is this warning I had in some parts of the kafka test:

```

 [junit] [Controller-0-to-broker-0-send-thread] INFO
org.apache.kafka.clients.NetworkClient - [Controller id=0,
targetBrokerId=0] Node 0 disconnected.
 [junit] [Controller-0-to-broker-0-send-thread] WARN
org.apache.kafka.clients.NetworkClient - [Controller id=0,
targetBrokerId=0] Connection to node 0 
(guylaine-virtual-machine/127.0.1.1:9092) could not be established. Broker may 
not be

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Mingchun Zhao

Sorry, there was a typo: track -> trunk

2023年10月27日(金) 0:12 Mingchun Zhao :

> Hi Guylaine, Thanks!
> Was your patch based on the latest track? Unfortunately, I was unable to
> apply your patch in my environment.
>
> 2023年10月26日(木) 20:44 Guylaine BASSETTE :
>
>> Hello Mingchun,
>>
>> As mentioned in my previous e-mail to Karl, my patch contained other
>> files to be updated. I don't know why they don't have been taken into
>> account, but would you be interested in trying my patch? I have fixed the
>> spots I had missed... (joint with this mail)
>>
>> With these modifications I went through all tests of kafka.
>> Le 26/10/2023 à 03:47, Mingchun Zhao a écrit :
>>
>> Hi there, Allow me to share my `ant test` result using the latest Github
>> trunk.
>> I got a lot of `Broker may not be available` warnings in the Kafka IT test
>> and it eventually failed.
>>
>> ```
>> ...
>> [junit] [kafka-producer-network-thread | producer-3] INFO
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
>> Node 0 disconnected.
>> [junit] [kafka-producer-network-thread | producer-3] WARN
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
>> Connection to node 0 (/192.168.10.103:9092) could not be established.
>> Broker may not be available.
>> [junit] [kafka-producer-network-thread | producer-1] INFO
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
>> Node 0 disconnected.
>> [junit] [kafka-producer-network-thread | producer-1] WARN
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
>> Connection to node 0 (/192.168.10.103:9092) could not be established.
>> Broker may not be available.
>> [junit] [kafka-producer-network-thread | producer-2] INFO
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
>> Node 0 disconnected.
>> [junit] [kafka-producer-network-thread | producer-2] WARN
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
>> Connection to node 0 (/192.168.10.103:9092) could not be established.
>> Broker may not be available.
>> [junit] [kafka-producer-network-thread | producer-3] INFO
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
>> Node 0 disconnected.
>> [junit] [kafka-producer-network-thread | producer-3] WARN
>> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
>> Connection to node 0 (/192.168.10.103:9092) could not be established.
>> Broker may not be available.
>> [junit] -  ---
>> [junit] Testcase:
>> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
>> Caused an ERROR
>> [junit] ManifoldCF did not terminate in the allotted time of 12
>> milliseconds
>> [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException:
>> ManifoldCF did not terminate in the allotted time of 12 milliseconds
>> [junit] at
>> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.waitJobInactive(APISanityHSQLDBIT.java:289)
>> [junit] at
>> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.sanityCheck(APISanityHSQLDBIT.java:177)
>> [junit] at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> [junit] at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> [junit] at
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> [junit]
>> [junit]
>>
>> BUILD FAILED
>> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
>> error occurred while executing this line:
>> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
>> error occurred while executing this line:
>> /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1104:
>> Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
>>
>> Total time: 38 minutes 13 seconds
>> ```
>>
>>
>> 2023年10月26日(木) 5:42 Karl Wright  :
>>
>>
>> I see you have committed this.  You missed a few spots; the extra jar was
>> mentioned in multiple places.  I committed another fix to correct that.
>>
>> Karl
>>
>>
>> On Wed, Oct 25, 2023 at 10:46 AM Guylaine BASSETTE 
>>  wrote:
>>
>>
>> Hello Karl,
>>
>> Thank you very much for this update! I have tested your suggestions and
>> kafka ITs tests ended successfully. :-)
>>
>> Here you can find the patch.
>>
>> My only doubt is this warning I had in some parts of the kafka test:
>>
>> ```
>>
>> [junit] [Controller-0-to-broker-0-send-thread] INFO
>> org.apache.kafka.clients.NetworkClient - [Controller id=0,
>> targetBrokerId=0] Node 0 disconnected.
>> [junit] [Controller-0-to-broker-0-send-thread] WARN
>> org.apache.kafka.clients.NetworkClient - [Controller id=0,
>> targetBrokerId=0] Connection to node 0 
>> (guylaine-virtual-machine/127.0.1.1:9092) could not be established. Broker 
>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Mingchun Zhao

Hi Guylaine, Thanks!
Was your patch based on the latest track? Unfortunately, I was unable to
apply your patch in my environment.

2023年10月26日(木) 20:44 Guylaine BASSETTE :

> Hello Mingchun,
>
> As mentioned in my previous e-mail to Karl, my patch contained other files
> to be updated. I don't know why they don't have been taken into account,
> but would you be interested in trying my patch? I have fixed the spots I
> had missed... (joint with this mail)
>
> With these modifications I went through all tests of kafka.
> Le 26/10/2023 à 03:47, Mingchun Zhao a écrit :
>
> Hi there, Allow me to share my `ant test` result using the latest Github
> trunk.
> I got a lot of `Broker may not be available` warnings in the Kafka IT test
> and it eventually failed.
>
> ```
> ...
> [junit] [kafka-producer-network-thread | producer-3] INFO
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
> Node 0 disconnected.
> [junit] [kafka-producer-network-thread | producer-3] WARN
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
> Connection to node 0 (/192.168.10.103:9092) could not be established.
> Broker may not be available.
> [junit] [kafka-producer-network-thread | producer-1] INFO
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
> Node 0 disconnected.
> [junit] [kafka-producer-network-thread | producer-1] WARN
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
> Connection to node 0 (/192.168.10.103:9092) could not be established.
> Broker may not be available.
> [junit] [kafka-producer-network-thread | producer-2] INFO
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
> Node 0 disconnected.
> [junit] [kafka-producer-network-thread | producer-2] WARN
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
> Connection to node 0 (/192.168.10.103:9092) could not be established.
> Broker may not be available.
> [junit] [kafka-producer-network-thread | producer-3] INFO
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
> Node 0 disconnected.
> [junit] [kafka-producer-network-thread | producer-3] WARN
> org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
> Connection to node 0 (/192.168.10.103:9092) could not be established.
> Broker may not be available.
> [junit] -  ---
> [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> Caused an ERROR
> [junit] ManifoldCF did not terminate in the allotted time of 12
> milliseconds
> [junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException:
> ManifoldCF did not terminate in the allotted time of 12 milliseconds
> [junit] at
> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.waitJobInactive(APISanityHSQLDBIT.java:289)
> [junit] at
> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.sanityCheck(APISanityHSQLDBIT.java:177)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit] at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit]
> [junit]
>
> BUILD FAILED
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1104:
> Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
>
> Total time: 38 minutes 13 seconds
> ```
>
>
> 2023年10月26日(木) 5:42 Karl Wright  :
>
>
> I see you have committed this.  You missed a few spots; the extra jar was
> mentioned in multiple places.  I committed another fix to correct that.
>
> Karl
>
>
> On Wed, Oct 25, 2023 at 10:46 AM Guylaine BASSETTE 
>  wrote:
>
>
> Hello Karl,
>
> Thank you very much for this update! I have tested your suggestions and
> kafka ITs tests ended successfully. :-)
>
> Here you can find the patch.
>
> My only doubt is this warning I had in some parts of the kafka test:
>
> ```
>
> [junit] [Controller-0-to-broker-0-send-thread] INFO
> org.apache.kafka.clients.NetworkClient - [Controller id=0,
> targetBrokerId=0] Node 0 disconnected.
> [junit] [Controller-0-to-broker-0-send-thread] WARN
> org.apache.kafka.clients.NetworkClient - [Controller id=0,
> targetBrokerId=0] Connection to node 0 
> (guylaine-virtual-machine/127.0.1.1:9092) could not be established. Broker 
> may not be available.
> [junit] [Controller-0-to-broker-0-send-thread] WARN
> kafka.controller.RequestSendThread - [RequestSendThread controllerId=0]
> Controller 0's connection to broker

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-26 Thread Guylaine BASSETTE


Oh yes sorry, when I made the patch, I put a bad version of the build.xml.

But I see you didn't take the other files I have modified... Is it 
because they was bad according to you?



Le 25/10/2023 à 22:42, Karl Wright a écrit :

I see you have committed this.  You missed a few spots; the extra jar was
mentioned in multiple places.  I committed another fix to correct that.

Karl


On Wed, Oct 25, 2023 at 10:46 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:


Hello Karl,

Thank you very much for this update! I have tested your suggestions and
kafka ITs tests ended successfully. :-)

Here you can find the patch.

My only doubt is this warning I had in some parts of the kafka test:

```

 [junit] [Controller-0-to-broker-0-send-thread] INFO
org.apache.kafka.clients.NetworkClient - [Controller id=0,
targetBrokerId=0] Node 0 disconnected.
 [junit] [Controller-0-to-broker-0-send-thread] WARN
org.apache.kafka.clients.NetworkClient - [Controller id=0,
targetBrokerId=0] Connection to node 0 (guylaine-virtual-machine/
127.0.1.1:9092) could not be established. Broker may not be available.
 [junit] [Controller-0-to-broker-0-send-thread] WARN
kafka.controller.RequestSendThread - [RequestSendThread controllerId=0]
Controller 0's connection to broker guylaine-virtual-machine:9092 (id: 0
rack: null) was unsuccessful
 [junit] java.io.IOException: Connection to
guylaine-virtual-machine:9092 (id: 0 rack: null) failed.
 [junit] at
org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:70)
 [junit] at
kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:298)
 [junit] at
kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:251)
 [junit] at
org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:130)
 [junit] [Controller-0-to-broker-0-send-thread] INFO
org.apache.kafka.clients.NetworkClient - [Controller id=0,
targetBrokerId=0] Client requested connection close from node 0
 [junit] [controller-event-thread] INFO state.change.logger -
[Controller id=0 epoch=2] Sending LeaderAndIsr request to broker 0 with 1
become-leader and 0 become-follower partitions
```

I have also ran an "ant test". It run core-framework and ITs tests until
mongoDB connector with this fail:
```
 [junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT):
Caused an ERROR
 [junit] Could not start process: 
 [junit] java.lang.RuntimeException: Could not start process: 
 [junit] at
de.flapdoodle.embed.mongo.AbstractMongoProcess.onAfterProcessStart(AbstractMongoProcess.java:81)
 [junit] at
de.flapdoodle.embed.process.runtime.AbstractProcess.(AbstractProcess.java:115)
 [junit] at
de.flapdoodle.embed.mongo.AbstractMongoProcess.(AbstractMongoProcess.java:54)
 [junit] at
de.flapdoodle.embed.mongo.MongodProcess.(MongodProcess.java:50)
 [junit] at
de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:44)
 [junit] at
de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:34)
 [junit] at
de.flapdoodle.embed.process.runtime.Executable.start(Executable.java:109)
 [junit] at
org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:72)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 [junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 [junit]
 [junit]
 [junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT):
Caused an ERROR
 [junit] null
 [junit] java.lang.NullPointerException
 [junit] at
org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT.removeTestArea(APISanityHSQLDBIT.java:109)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 [junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

```

And no more success for the ITs tests of Solr connector...

Guylaine
Le 25/10/2023 à 12:52, Karl Wright a écrit :

I was able to reproduce the problem last night.  I believe the cause may
well be that we've moved too many dependencies to the framework level.
Specifically, I think perhaps only zookeeper and netty should run there,
but the Scala library probably needs to run at the same classloader level
as the other Scala jars, so it should be moved back into connectors/kafka
and removed from framework/build.xml and from build.xml and from
connector-build.xml.

Sadly

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-25 Thread Mingchun Zhao

Hi there, Allow me to share my `ant test` result using the latest Github
trunk.
I got a lot of `Broker may not be available` warnings in the Kafka IT test
and it eventually failed.

```
...
[junit] [kafka-producer-network-thread | producer-3] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Node 0 disconnected.
[junit] [kafka-producer-network-thread | producer-3] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
[junit] [kafka-producer-network-thread | producer-1] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
Node 0 disconnected.
[junit] [kafka-producer-network-thread | producer-1] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
[junit] [kafka-producer-network-thread | producer-2] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
Node 0 disconnected.
[junit] [kafka-producer-network-thread | producer-2] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
[junit] [kafka-producer-network-thread | producer-3] INFO
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Node 0 disconnected.
[junit] [kafka-producer-network-thread | producer-3] WARN
org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-3]
Connection to node 0 (/192.168.10.103:9092) could not be established.
Broker may not be available.
[junit] -  ---
[junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
Caused an ERROR
[junit] ManifoldCF did not terminate in the allotted time of 12
milliseconds
[junit] org.apache.manifoldcf.core.interfaces.ManifoldCFException:
ManifoldCF did not terminate in the allotted time of 12 milliseconds
[junit] at
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.waitJobInactive(APISanityHSQLDBIT.java:289)
[junit] at
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT.sanityCheck(APISanityHSQLDBIT.java:177)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit]
[junit]

BUILD FAILED
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1104:
Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed

Total time: 38 minutes 13 seconds
```

2023年10月26日(木) 5:42 Karl Wright :

> I see you have committed this.  You missed a few spots; the extra jar was
> mentioned in multiple places.  I committed another fix to correct that.
>
> Karl
>
>
> On Wed, Oct 25, 2023 at 10:46 AM Guylaine BASSETTE <
> guylaine.basse...@francelabs.com> wrote:
>
> > Hello Karl,
> >
> > Thank you very much for this update! I have tested your suggestions and
> > kafka ITs tests ended successfully. :-)
> >
> > Here you can find the patch.
> >
> > My only doubt is this warning I had in some parts of the kafka test:
> >
> > ```
> >
> > [junit] [Controller-0-to-broker-0-send-thread] INFO
> > org.apache.kafka.clients.NetworkClient - [Controller id=0,
> > targetBrokerId=0] Node 0 disconnected.
> > [junit] [Controller-0-to-broker-0-send-thread] WARN
> > org.apache.kafka.clients.NetworkClient - [Controller id=0,
> > targetBrokerId=0] Connection to node 0 (guylaine-virtual-machine/
> > 127.0.1.1:9092) could not be established. Broker may not be available.
> > [junit] [Controller-0-to-broker-0-send-thread] WARN
> > kafka.controller.RequestSendThread - [RequestSendThread controllerId=0]
> > Controller 0's connection to broker guylaine-virtual-machine:9092 (id: 0
> > rack: null) was unsuccessful
> > [junit] java.io.IOException: Connection to
> > guylaine-virtual-machine:9092 (id: 0 rack: null) failed.
> > [junit] at
> >
> org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:70)
> > [junit] at
> >
> kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:298)
> > [junit] at
> >
> kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:251)
> > [junit] at
> >
> org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:130)
> > [junit]

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-25 Thread Karl Wright

I see you have committed this.  You missed a few spots; the extra jar was
mentioned in multiple places.  I committed another fix to correct that.

Karl


On Wed, Oct 25, 2023 at 10:46 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> Hello Karl,
>
> Thank you very much for this update! I have tested your suggestions and
> kafka ITs tests ended successfully. :-)
>
> Here you can find the patch.
>
> My only doubt is this warning I had in some parts of the kafka test:
>
> ```
>
> [junit] [Controller-0-to-broker-0-send-thread] INFO
> org.apache.kafka.clients.NetworkClient - [Controller id=0,
> targetBrokerId=0] Node 0 disconnected.
> [junit] [Controller-0-to-broker-0-send-thread] WARN
> org.apache.kafka.clients.NetworkClient - [Controller id=0,
> targetBrokerId=0] Connection to node 0 (guylaine-virtual-machine/
> 127.0.1.1:9092) could not be established. Broker may not be available.
> [junit] [Controller-0-to-broker-0-send-thread] WARN
> kafka.controller.RequestSendThread - [RequestSendThread controllerId=0]
> Controller 0's connection to broker guylaine-virtual-machine:9092 (id: 0
> rack: null) was unsuccessful
> [junit] java.io.IOException: Connection to
> guylaine-virtual-machine:9092 (id: 0 rack: null) failed.
> [junit] at
> org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:70)
> [junit] at
> kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:298)
> [junit] at
> kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:251)
> [junit] at
> org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:130)
> [junit] [Controller-0-to-broker-0-send-thread] INFO
> org.apache.kafka.clients.NetworkClient - [Controller id=0,
> targetBrokerId=0] Client requested connection close from node 0
> [junit] [controller-event-thread] INFO state.change.logger -
> [Controller id=0 epoch=2] Sending LeaderAndIsr request to broker 0 with 1
> become-leader and 0 become-follower partitions
> ```
>
> I have also ran an "ant test". It run core-framework and ITs tests until
> mongoDB connector with this fail:
> ```
> [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT):
> Caused an ERROR
> [junit] Could not start process: 
> [junit] java.lang.RuntimeException: Could not start process: 
> [junit] at
> de.flapdoodle.embed.mongo.AbstractMongoProcess.onAfterProcessStart(AbstractMongoProcess.java:81)
> [junit] at
> de.flapdoodle.embed.process.runtime.AbstractProcess.(AbstractProcess.java:115)
> [junit] at
> de.flapdoodle.embed.mongo.AbstractMongoProcess.(AbstractMongoProcess.java:54)
> [junit] at
> de.flapdoodle.embed.mongo.MongodProcess.(MongodProcess.java:50)
> [junit] at
> de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:44)
> [junit] at
> de.flapdoodle.embed.mongo.MongodExecutable.start(MongodExecutable.java:34)
> [junit] at
> de.flapdoodle.embed.process.runtime.Executable.start(Executable.java:109)
> [junit] at
> org.apache.manifoldcf.agents.output.mongodboutput.tests.BaseITHSQLDB.setUpMongoDB(BaseITHSQLDB.java:72)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit] at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit]
> [junit]
> [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT):
> Caused an ERROR
> [junit] null
> [junit] java.lang.NullPointerException
> [junit] at
> org.apache.manifoldcf.agents.output.mongodboutput.tests.APISanityHSQLDBIT.removeTestArea(APISanityHSQLDBIT.java:109)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit] at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> ```
>
> And no more success for the ITs tests of Solr connector...
>
> Guylaine
> Le 25/10/2023 à 12:52, Karl Wright a écrit :
>
> I was able to reproduce the problem last night.  I believe the cause may
> well be that we've moved too many dependencies to the framework level.
> Specifically, I think perhaps only zookeeper and netty should run there,
> but the Scala library probably needs to run at the same classloader level
> as the other Scala jars, so it should be moved back into connectors/kafka
> and removed from framework/build.xml and from build.xml and from
> connector-build.xml.
>
> Sadly I'm completely snowed under until the weekend so it will need to wait

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-25 Thread Karl Wright

I was able to reproduce the problem last night.  I believe the cause may
well be that we've moved too many dependencies to the framework level.
Specifically, I think perhaps only zookeeper and netty should run there,
but the Scala library probably needs to run at the same classloader level
as the other Scala jars, so it should be moved back into connectors/kafka
and removed from framework/build.xml and from build.xml and from
connector-build.xml.

Sadly I'm completely snowed under until the weekend so it will need to wait
until then unless someone else wants to try this.

Karl


On Tue, Oct 24, 2023 at 9:12 AM Karl Wright  wrote:

> Try doing svn update and deleting your test-materials directory contents.
> Then ant download-dependencies.  You don't get a link error after that when
> you do run-IT-HSQLDB .
>
> Karl
>
> On Tue, Oct 24, 2023 at 9:10 AM Guylaine BASSETTE <
> guylaine.basse...@francelabs.com> wrote:
>
>> Hi Karl and Mingchun,
>>
>> Thanks again !
>>
>> My bad for the Zookeeper dependencies. Actually I've made a mistake
>> using in my IDE dependencies analyzer.
>>
>> Regarding Kafka tests, a light search brings me to the
>> "spark-streaming-kafka" dependency that might be missing...
>>
>> At the mean time, I continue my effort on Solr connector tests.
>>
>>
>> For any use, here is the errors I get:
>>
>> ```
>>
>>[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Stopped o.e.j.w.WebAppContext@7c28c1{ManifoldCF General API
>>
>> Webapp,/mcf-api-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-api-service.war}
>>  [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler
>> - Stopped o.e.j.w.WebAppContext@588ffeb{ManifoldCF Authorities API
>>
>> Webapp,/mcf-authority-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-authority-service.war}
>>  [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler
>> - Stopped o.e.j.w.WebAppContext@71a3a190{ManifoldCF Crawler
>>
>> Interface,/mcf-crawler-ui,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-crawler-ui.war}
>>  [junit] -  ---
>>  [junit] Testcase:
>> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
>> Caused an ERROR
>>  [junit] 'scala.collection.immutable.ArraySeq
>> scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
>>  [junit] java.lang.NoSuchMethodError:
>> 'scala.collection.immutable.ArraySeq
>> scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
>>  [junit] at
>> kafka.server.KafkaConfig$.(KafkaConfig.scala:338)
>>  [junit] at
>> kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
>>  [junit] at
>>
>> org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
>>  [junit] at
>>
>> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
>>  [junit] at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>>  [junit] at
>>
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>  [junit] at
>>
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>  [junit]
>>  [junit]
>>  [junit] Testcase:
>> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
>> Caused an ERROR
>>  [junit] null
>>  [junit] java.lang.NullPointerException
>>  [junit] at
>>
>> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.cleanUpKafka(BaseITHSQLDB.java:92)
>>  [junit] at
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>>  [junit] at
>>
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>  [junit] at
>>
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>
>> ```
>>
>> Le 24/10/2023 à 12:30, Karl Wright a écrit :
>> > I missed a place - connector-build.xml.  Updated now.
>> >
>> > Now we don't get a link exception, but neither does the kafka test work.
>> > It seems to be unable to start zookeeper even though all the
>> dependencies
>> > are now there.  Will need to look at this after work.
>> >
>> > Karl
>> >
>> >
>> > On Mon, Oct 23, 2023 at 11:32 PM Mingchun Zhao<
>> mingchun.zha...@gmail.com>
>> > wrote:
>> >
>> >> Thanks. I've tried `ant test` with the latest trunk. As a result, the
>> kafka
>> >> test failed as below.
>> >> ```
>> >>  [junit] Testcase:
>> >>
>> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
>> >> Caused an ERROR
>> >>  [junit] io/netty/handler/ssl/SslContext
>> >>  [junit] java.lang.NoClassDefFoundError:
>> io/netty/handler/ssl/SslContext
>> >>  [junit] at
>> >>
>> >>
>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-24 Thread Karl Wright

Try doing svn update and deleting your test-materials directory contents.
Then ant download-dependencies.  You don't get a link error after that when
you do run-IT-HSQLDB .

Karl

On Tue, Oct 24, 2023 at 9:10 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> Hi Karl and Mingchun,
>
> Thanks again !
>
> My bad for the Zookeeper dependencies. Actually I've made a mistake
> using in my IDE dependencies analyzer.
>
> Regarding Kafka tests, a light search brings me to the
> "spark-streaming-kafka" dependency that might be missing...
>
> At the mean time, I continue my effort on Solr connector tests.
>
>
> For any use, here is the errors I get:
>
> ```
>
>[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Stopped o.e.j.w.WebAppContext@7c28c1{ManifoldCF General API
>
> Webapp,/mcf-api-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-api-service.war}
>  [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler
> - Stopped o.e.j.w.WebAppContext@588ffeb{ManifoldCF Authorities API
>
> Webapp,/mcf-authority-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-authority-service.war}
>  [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler
> - Stopped o.e.j.w.WebAppContext@71a3a190{ManifoldCF Crawler
>
> Interface,/mcf-crawler-ui,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-crawler-ui.war}
>  [junit] -  ---
>  [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> Caused an ERROR
>  [junit] 'scala.collection.immutable.ArraySeq
> scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
>  [junit] java.lang.NoSuchMethodError:
> 'scala.collection.immutable.ArraySeq
> scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
>  [junit] at
> kafka.server.KafkaConfig$.(KafkaConfig.scala:338)
>  [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
>  [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
>  [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
>  [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>  [junit] at
>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  [junit]
>  [junit]
>  [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> Caused an ERROR
>  [junit] null
>  [junit] java.lang.NullPointerException
>  [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.cleanUpKafka(BaseITHSQLDB.java:92)
>  [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>  [junit] at
>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> ```
>
> Le 24/10/2023 à 12:30, Karl Wright a écrit :
> > I missed a place - connector-build.xml.  Updated now.
> >
> > Now we don't get a link exception, but neither does the kafka test work.
> > It seems to be unable to start zookeeper even though all the dependencies
> > are now there.  Will need to look at this after work.
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 11:32 PM Mingchun Zhao >
> > wrote:
> >
> >> Thanks. I've tried `ant test` with the latest trunk. As a result, the
> kafka
> >> test failed as below.
> >> ```
> >>  [junit] Testcase:
> >>
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> >> Caused an ERROR
> >>  [junit] io/netty/handler/ssl/SslContext
> >>  [junit] java.lang.NoClassDefFoundError:
> io/netty/handler/ssl/SslContext
> >>  [junit] at
> >>
> >>
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> >>  [junit] at
> >>
> >>
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> >>  [junit] at
> >> org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> >>  [junit] at
> >> org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> >>  [junit] at
> >>
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> >>  [junit] at
> kafka.server.KafkaConfig.(KafkaConfig.scala:1620)
> >>  [junit] at
> kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
> >>  [junit] at
> >>
> >>
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-24 Thread Guylaine BASSETTE


Hi Karl and Mingchun,

Thanks again !

My bad for the Zookeeper dependencies. Actually I've made a mistake 
using in my IDE dependencies analyzer.


Regarding Kafka tests, a light search brings me to the 
"spark-streaming-kafka" dependency that might be missing...


At the mean time, I continue my effort on Solr connector tests.


For any use, here is the errors I get:

```

  [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler - 
Stopped o.e.j.w.WebAppContext@7c28c1{ManifoldCF General API 
Webapp,/mcf-api-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-api-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler 
- Stopped o.e.j.w.WebAppContext@588ffeb{ManifoldCF Authorities API 
Webapp,/mcf-authority-service,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-authority-service.war}
    [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler 
- Stopped o.e.j.w.WebAppContext@71a3a190{ManifoldCF Crawler 
Interface,/mcf-crawler-ui,null,STOPPED}{/home/guylaine/IdeaProjects/mon-manifoldcf/dist/web/war/mcf-crawler-ui.war}

    [junit] -  ---
    [junit] Testcase: 
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT): 
Caused an ERROR
    [junit] 'scala.collection.immutable.ArraySeq 
scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
    [junit] java.lang.NoSuchMethodError: 
'scala.collection.immutable.ArraySeq 
scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'
    [junit] at 
kafka.server.KafkaConfig$.(KafkaConfig.scala:338)

    [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
    [junit] at 
org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
    [junit] at 
org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
    [junit] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
    [junit] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    [junit]
    [junit]
    [junit] Testcase: 
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT): 
Caused an ERROR

    [junit] null
    [junit] java.lang.NullPointerException
    [junit] at 
org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.cleanUpKafka(BaseITHSQLDB.java:92)
    [junit] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
    [junit] at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    [junit] at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)


```

Le 24/10/2023 à 12:30, Karl Wright a écrit :

I missed a place - connector-build.xml.  Updated now.

Now we don't get a link exception, but neither does the kafka test work.
It seems to be unable to start zookeeper even though all the dependencies
are now there.  Will need to look at this after work.

Karl


On Mon, Oct 23, 2023 at 11:32 PM Mingchun Zhao
wrote:


Thanks. I've tried `ant test` with the latest trunk. As a result, the kafka
test failed as below.
```
 [junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
Caused an ERROR
 [junit] io/netty/handler/ssl/SslContext
 [junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
 [junit] at

org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
 [junit] at

org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
 [junit] at
org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
 [junit] at
org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
 [junit] at
org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
 [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1620)
 [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
 [junit] at

org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
 [junit] at

org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
 [junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
 [junit] at

java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 [junit] at

java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 [junit] Caused by: java.lang.ClassNotFoundException:
io.netty.handler.ssl.SslContext
 [junit] at

java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
 [junit] at

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-24 Thread Karl Wright

I missed a place - connector-build.xml.  Updated now.

Now we don't get a link exception, but neither does the kafka test work.
It seems to be unable to start zookeeper even though all the dependencies
are now there.  Will need to look at this after work.

Karl


On Mon, Oct 23, 2023 at 11:32 PM Mingchun Zhao 
wrote:

> Thanks. I've tried `ant test` with the latest trunk. As a result, the kafka
> test failed as below.
> ```
> [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> Caused an ERROR
> [junit] io/netty/handler/ssl/SslContext
> [junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
> [junit] at
>
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> [junit] at
>
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> [junit] at
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1620)
> [junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
> [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
> [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] Caused by: java.lang.ClassNotFoundException:
> io.netty.handler.ssl.SslContext
> [junit] at
>
> java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
> [junit] at
>
> java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
> [junit] at
> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
> [junit]
> [junit]
> [junit] Testcase:
> sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
> Caused an ERROR
> [junit] null
> [junit] java.lang.NullPointerException
> [junit] at
>
> org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.cleanUpKafka(BaseITHSQLDB.java:92)
> [junit] at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> [junit] at
>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit]
> [junit]
>
> BUILD FAILED
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
> Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
> ```
>
> 2023年10月24日(火) 11:00 Karl Wright :
>
> > Okay, I updated zookeeper properly in build.xml and framework/build.xml,
> > with the two new dependencies, and the zookeeper tests pass.  I haven't
> > tried the kafka or solr tests yet.
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 9:29 PM Karl Wright  wrote:
> >
> > > Unless I know what kafka is using zookeeper for, this would seem risky
> to
> > > me.  Zookeeper is meant to coordinate processes; it may not work for
> one
> > > process to be using different versions of zookeeper than the others.
> > >
> > > It looks like the original change to kafka you reverted had the proper
> > > dependencies but they absolutely needed to be included in the right
> > > classpaths and they weren't - they were only included in the kafka
> tests.
> > > I will look at this perhaps at the latest this weekend, but I won't
> > commit
> > > this patch.
> > >
> > >
> > > Karl
> > >
> > >
> > > On Mon, Oct 23, 2023 at 5:14 PM Mingchun Zhao <
> mingchun.zha...@gmail.com
> > >
> > > wrote:
> > >
> > >> I reverted zookeeper version to 3.8.0 to avoid linkage error on the
> > >> multiThreadZooKeeperLockTest:
> > >> [junit] Caused by: java.lang.ClassNotFoundException:
> > >> io.netty.handler.ssl.SslContext
> > >>
> > >> I've prepared a PR here:
> > >> https://github.com/apache/manifoldcf/pull/156
> > >>
> > >> Just a heads up, `ant test` still hangs on the Solr Output connector
> > test:
> > >> ```
> > >> run-IT-HSQLDB:
> > >> [junit] Testsuite:
> > >> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> > >> [junit] Configuration file

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

Thanks. I've tried `ant test` with the latest trunk. As a result, the kafka
test failed as below.
```
[junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
Caused an ERROR
[junit] io/netty/handler/ssl/SslContext
[junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
[junit] at
org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
[junit] at
org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
[junit] at
org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
[junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1620)
[junit] at kafka.server.KafkaConfig.(KafkaConfig.scala:1603)
[junit] at
org.apache.manifoldcf.agents.output.kafka.KafkaLocal.(KafkaLocal.java:31)
[junit] at
org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.setupKafka(BaseITHSQLDB.java:86)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] Caused by: java.lang.ClassNotFoundException:
io.netty.handler.ssl.SslContext
[junit] at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
[junit] at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
[junit] at
java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
[junit]
[junit]
[junit] Testcase:
sanityCheck(org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT):
Caused an ERROR
[junit] null
[junit] java.lang.NullPointerException
[junit] at
org.apache.manifoldcf.agents.output.kafka.BaseITHSQLDB.cleanUpKafka(BaseITHSQLDB.java:92)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
[junit] at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit]
[junit]

BUILD FAILED
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
```

2023年10月24日(火) 11:00 Karl Wright :

> Okay, I updated zookeeper properly in build.xml and framework/build.xml,
> with the two new dependencies, and the zookeeper tests pass.  I haven't
> tried the kafka or solr tests yet.
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 9:29 PM Karl Wright  wrote:
>
> > Unless I know what kafka is using zookeeper for, this would seem risky to
> > me.  Zookeeper is meant to coordinate processes; it may not work for one
> > process to be using different versions of zookeeper than the others.
> >
> > It looks like the original change to kafka you reverted had the proper
> > dependencies but they absolutely needed to be included in the right
> > classpaths and they weren't - they were only included in the kafka tests.
> > I will look at this perhaps at the latest this weekend, but I won't
> commit
> > this patch.
> >
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 5:14 PM Mingchun Zhao  >
> > wrote:
> >
> >> I reverted zookeeper version to 3.8.0 to avoid linkage error on the
> >> multiThreadZooKeeperLockTest:
> >> [junit] Caused by: java.lang.ClassNotFoundException:
> >> io.netty.handler.ssl.SslContext
> >>
> >> I've prepared a PR here:
> >> https://github.com/apache/manifoldcf/pull/156
> >>
> >> Just a heads up, `ant test` still hangs on the Solr Output connector
> test:
> >> ```
> >> run-IT-HSQLDB:
> >> [junit] Testsuite:
> >> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> >> [junit] Configuration file successfully read
> >> [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
> >> @7027ms to org.eclipse.jetty.util.log.Slf4jLog
> >> [junit] [main] INFO org.eclipse.jetty.server.Server -
> >> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
> >> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
> >> [junit] [main] INFO org.eclipse.jetty.server.session -
> >> DefaultSessionIdManager workerName=node0
> >> [junit] [main] INFO org.eclipse.jetty.server.session - No
> >> SessionScavenger set, using defaults
> >> [junit] [main] INFO

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

Okay, I updated zookeeper properly in build.xml and framework/build.xml,
with the two new dependencies, and the zookeeper tests pass.  I haven't
tried the kafka or solr tests yet.

Karl


On Mon, Oct 23, 2023 at 9:29 PM Karl Wright  wrote:

> Unless I know what kafka is using zookeeper for, this would seem risky to
> me.  Zookeeper is meant to coordinate processes; it may not work for one
> process to be using different versions of zookeeper than the others.
>
> It looks like the original change to kafka you reverted had the proper
> dependencies but they absolutely needed to be included in the right
> classpaths and they weren't - they were only included in the kafka tests.
> I will look at this perhaps at the latest this weekend, but I won't commit
> this patch.
>
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 5:14 PM Mingchun Zhao 
> wrote:
>
>> I reverted zookeeper version to 3.8.0 to avoid linkage error on the
>> multiThreadZooKeeperLockTest:
>> [junit] Caused by: java.lang.ClassNotFoundException:
>> io.netty.handler.ssl.SslContext
>>
>> I've prepared a PR here:
>> https://github.com/apache/manifoldcf/pull/156
>>
>> Just a heads up, `ant test` still hangs on the Solr Output connector test:
>> ```
>> run-IT-HSQLDB:
>> [junit] Testsuite:
>> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
>> [junit] Configuration file successfully read
>> [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
>> @7027ms to org.eclipse.jetty.util.log.Slf4jLog
>> [junit] [main] INFO org.eclipse.jetty.server.Server -
>> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
>> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
>> [junit] [main] INFO org.eclipse.jetty.server.session -
>> DefaultSessionIdManager workerName=node0
>> [junit] [main] INFO org.eclipse.jetty.server.session - No
>> SessionScavenger set, using defaults
>> [junit] [main] INFO org.eclipse.jetty.server.session - node0
>> Scavenging
>> every 66ms
>> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Started o.e.j.w.WebAppContext@1517f633{ManifoldCF Crawler
>>
>> Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-7554899724821045499/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-crawler-ui.war}
>> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Started o.e.j.w.WebAppContext@4fe01803{ManifoldCF Authorities API
>>
>> Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-7701836901953162228/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-authority-service.war}
>> [junit] Creating mock service
>> [junit] Mock service created
>> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Started o.e.j.w.WebAppContext@13d186db{ManifoldCF General API
>>
>> Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-2609388202403972652/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-api-service.war}
>> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
>> Started ServerConnector@3bd55d8{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
>> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9054ms
>> [junit] [main] INFO org.eclipse.jetty.server.Server -
>> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
>> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
>> [junit] [main] INFO org.eclipse.jetty.server.session -
>> DefaultSessionIdManager workerName=node0
>> [junit] [main] INFO org.eclipse.jetty.server.session - No
>> SessionScavenger set, using defaults
>> [junit] [main] INFO org.eclipse.jetty.server.session - node0
>> Scavenging
>> every 60ms
>> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Started o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,AVAILABLE}
>> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
>> Started ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
>> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9064ms
>> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
>> Stopped ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
>> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
>> scavenging
>> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
>> Stopped o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,STOPPED}
>> ```
>>
>> 2023年10月24日(火) 1:40 Karl Wright :
>>
>> > The dependencies would be in the zookeeper pom.  Maven would follow them
>> > automatically which is why it is insufficient to assume that if maven

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

Unless I know what kafka is using zookeeper for, this would seem risky to
me.  Zookeeper is meant to coordinate processes; it may not work for one
process to be using different versions of zookeeper than the others.

It looks like the original change to kafka you reverted had the proper
dependencies but they absolutely needed to be included in the right
classpaths and they weren't - they were only included in the kafka tests.
I will look at this perhaps at the latest this weekend, but I won't commit
this patch.


Karl


On Mon, Oct 23, 2023 at 5:14 PM Mingchun Zhao 
wrote:

> I reverted zookeeper version to 3.8.0 to avoid linkage error on the
> multiThreadZooKeeperLockTest:
> [junit] Caused by: java.lang.ClassNotFoundException:
> io.netty.handler.ssl.SslContext
>
> I've prepared a PR here:
> https://github.com/apache/manifoldcf/pull/156
>
> Just a heads up, `ant test` still hangs on the Solr Output connector test:
> ```
> run-IT-HSQLDB:
> [junit] Testsuite:
> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> [junit] Configuration file successfully read
> [junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
> @7027ms to org.eclipse.jetty.util.log.Slf4jLog
> [junit] [main] INFO org.eclipse.jetty.server.Server -
> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
> [junit] [main] INFO org.eclipse.jetty.server.session -
> DefaultSessionIdManager workerName=node0
> [junit] [main] INFO org.eclipse.jetty.server.session - No
> SessionScavenger set, using defaults
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
> every 66ms
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@1517f633{ManifoldCF Crawler
>
> Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-7554899724821045499/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-crawler-ui.war}
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@4fe01803{ManifoldCF Authorities API
>
> Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-7701836901953162228/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-authority-service.war}
> [junit] Creating mock service
> [junit] Mock service created
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.w.WebAppContext@13d186db{ManifoldCF General API
>
> Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-2609388202403972652/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-api-service.war}
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Started ServerConnector@3bd55d8{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9054ms
> [junit] [main] INFO org.eclipse.jetty.server.Server -
> jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
> 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
> [junit] [main] INFO org.eclipse.jetty.server.session -
> DefaultSessionIdManager workerName=node0
> [junit] [main] INFO org.eclipse.jetty.server.session - No
> SessionScavenger set, using defaults
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
> every 60ms
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Started o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,AVAILABLE}
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Started ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
> [junit] [main] INFO org.eclipse.jetty.server.Server - Started @9064ms
> [junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
> Stopped ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
> [junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
> scavenging
> [junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
> Stopped o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,STOPPED}
> ```
>
> 2023年10月24日(火) 1:40 Karl Wright :
>
> > The dependencies would be in the zookeeper pom.  Maven would follow them
> > automatically which is why it is insufficient to assume that if maven
> works
> > so will ant.
> >
> > You can use mvn dependency:tree to find what Maven is actually pulling
> in.
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 11:04 AM Guylaine BASSETTE <
> > guylaine.basse...@francelabs.com> wrote:
> >
> > > I launch these tests with a Maven build and everything is OK. Yet no
> > > netty dependencies are

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

I reverted zookeeper version to 3.8.0 to avoid linkage error on the
multiThreadZooKeeperLockTest:
[junit] Caused by: java.lang.ClassNotFoundException:
io.netty.handler.ssl.SslContext

I've prepared a PR here:
https://github.com/apache/manifoldcf/pull/156

Just a heads up, `ant test` still hangs on the Solr Output connector test:
```
run-IT-HSQLDB:
[junit] Testsuite:
org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
[junit] Configuration file successfully read
[junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
@7027ms to org.eclipse.jetty.util.log.Slf4jLog
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 66ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@1517f633{ManifoldCF Crawler
Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-7554899724821045499/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-crawler-ui.war}
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@4fe01803{ManifoldCF Authorities API
Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-7701836901953162228/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-authority-service.war}
[junit] Creating mock service
[junit] Mock service created
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@13d186db{ManifoldCF General API
Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-2609388202403972652/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-api-service.war}
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@3bd55d8{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9054ms
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 60ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,AVAILABLE}
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9064ms
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Stopped ServerConnector@30e6a763{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
scavenging
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Stopped o.e.j.s.ServletContextHandler@6f4ade6e{/solr,null,STOPPED}
```

2023年10月24日(火) 1:40 Karl Wright :

> The dependencies would be in the zookeeper pom.  Maven would follow them
> automatically which is why it is insufficient to assume that if maven works
> so will ant.
>
> You can use mvn dependency:tree to find what Maven is actually pulling in.
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 11:04 AM Guylaine BASSETTE <
> guylaine.basse...@francelabs.com> wrote:
>
> > I launch these tests with a Maven build and everything is OK. Yet no
> > netty dependencies are requiered... I don't understand were this
> > SslContext is called...
> >
> > Le 23/10/2023 à 16:25, Karl Wright a écrit :
> > > Yes, that is indicating that zookeeper is looking for a specific netty
> > > class that it isn't finding.  That is why I think there is now a
> > zookeeper
> > > dependency we aren't including in the classpaths that include
> zookeeper.
> > >
> > > Karl
> > >
> > >
> > > On Mon, Oct 23, 2023 at 10:23 AM Mingchun Zhao<
> mingchun.zha...@gmail.com
> > >
> > > wrote:
> > >
> > >> Karl, Thanks!
> > >> I think I reproduced that multiThreadZooKeeperLockTest error when I
> > >> running `ant test`, will look into this.
> > >> ```
> > >>  [junit] -  ---
> > >>  [junit]

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

The dependencies would be in the zookeeper pom.  Maven would follow them
automatically which is why it is insufficient to assume that if maven works
so will ant.

You can use mvn dependency:tree to find what Maven is actually pulling in.

Karl


On Mon, Oct 23, 2023 at 11:04 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> I launch these tests with a Maven build and everything is OK. Yet no
> netty dependencies are requiered... I don't understand were this
> SslContext is called...
>
> Le 23/10/2023 à 16:25, Karl Wright a écrit :
> > Yes, that is indicating that zookeeper is looking for a specific netty
> > class that it isn't finding.  That is why I think there is now a
> zookeeper
> > dependency we aren't including in the classpaths that include zookeeper.
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 10:23 AM Mingchun Zhao >
> > wrote:
> >
> >> Karl, Thanks!
> >> I think I reproduced that multiThreadZooKeeperLockTest error when I
> >> running `ant test`, will look into this.
> >> ```
> >>  [junit] -  ---
> >>  [junit] Testcase:
> >>
> >>
> multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
> >>  Caused an ERROR
> >>  [junit] io/netty/handler/ssl/SslContext
> >>  [junit] java.lang.NoClassDefFoundError:
> io/netty/handler/ssl/SslContext
> >>  [junit] at
> >>
> >>
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> >>  [junit] at
> >>
> >>
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> >>  [junit] at
> >> org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> >>  [junit] at
> >> org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> >>  [junit] at
> >>
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> >>  [junit] at
> >> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
> >>  [junit] at
> >> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
> >>  [junit] at
> >> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
> >>  [junit] at
> >> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnectionPool.grab(ZooKeeperConnectionPool.java:48)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperLockObject.obtainGlobalReadLock(ZooKeeperLockObject.java:190)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.LockObject.enterReadLock(LockObject.java:310)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.LockGate.enterReadLock(LockGate.java:271)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks.enterReadLock(TestZooKeeperLocks.java:125)
> >>  [junit] at
> >>
> >>
> org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks$ReaderThread.run(TestZooKeeperLocks.java:204)
> >>  [junit] Caused by: java.lang.ClassNotFoundException:
> >> io.netty.handler.ssl.SslContext
> >>  [junit] at
> >>
> >>
> java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
> >>  [junit] at
> >>
> >>
> java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
> >>  [junit] at
> >> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
> >>  [junit]
> >>  [junit]
> >>
> >> BUILD FAILED
> >> ```
> >>
> >> 2023年10月23日(月) 23:02 Karl Wright:
> >>
> >>> This is all you need to do:
> >>>
> >>> ant clean-core-deps
> >>> ant make-core-deps
> >>> ant clean
> >>> ant test
> >>>
> >>> Karl
> >>>
> >>>
> >>> On Mon, Oct 23, 2023 at 9:55 AM Mingchun Zhao <
> mingchun.zha...@gmail.com
> >>>
> >>> wrote:
> >>>
>  Hi Guylaine, Thanks!
> 
> > Thanks for all your sharing, it's very helpful! I'll continue...
>  I'll look into it some more too. If I have any other information I'll
> >>> share
>  it with you.
> 
>  2023年10月23日(月) 22:49 Guylaine BASSETTE <
> >> guylaine.basse...@francelabs.com
>  :
> 
> > Thanks for all your sharing, it's very helpful! I'll continue...
> >
> > Sorry, French and English mixed up!
> >
> > Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :
> >> Hi all,
> >>
> >> Thanks for all your shares, it's very helpfull! Merci pour tous vos
> >> partages, c'est très utile ! Je poursuis...
> >>
> >> Le 23/10/2023 à 15:31, Karl Wright a écrit :
> >>> I can't give advice on the test; this is something FranceLabs
> >> should
> >>> look
> >>> at.
> >>> However,

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Guylaine BASSETTE

I launch these tests with a Maven build and everything is OK. Yet no 
netty dependencies are requiered... I don't understand were this 
SslContext is called...


Le 23/10/2023 à 16:25, Karl Wright a écrit :

Yes, that is indicating that zookeeper is looking for a specific netty
class that it isn't finding.  That is why I think there is now a zookeeper
dependency we aren't including in the classpaths that include zookeeper.

Karl


On Mon, Oct 23, 2023 at 10:23 AM Mingchun Zhao
wrote:


Karl, Thanks!
I think I reproduced that multiThreadZooKeeperLockTest error when I
running `ant test`, will look into this.
```
 [junit] -  ---
 [junit] Testcase:

multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
 Caused an ERROR
 [junit] io/netty/handler/ssl/SslContext
 [junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
 [junit] at

org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
 [junit] at

org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
 [junit] at
org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
 [junit] at
org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
 [junit] at
org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
 [junit] at
org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
 [junit] at
org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
 [junit] at
org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
 [junit] at
org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
 [junit] at

org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
 [junit] at

org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
 [junit] at

org.apache.manifoldcf.core.lockmanager.ZooKeeperConnectionPool.grab(ZooKeeperConnectionPool.java:48)
 [junit] at

org.apache.manifoldcf.core.lockmanager.ZooKeeperLockObject.obtainGlobalReadLock(ZooKeeperLockObject.java:190)
 [junit] at

org.apache.manifoldcf.core.lockmanager.LockObject.enterReadLock(LockObject.java:310)
 [junit] at

org.apache.manifoldcf.core.lockmanager.LockGate.enterReadLock(LockGate.java:271)
 [junit] at

org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks.enterReadLock(TestZooKeeperLocks.java:125)
 [junit] at

org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks$ReaderThread.run(TestZooKeeperLocks.java:204)
 [junit] Caused by: java.lang.ClassNotFoundException:
io.netty.handler.ssl.SslContext
 [junit] at

java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
 [junit] at

java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
 [junit] at
java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
 [junit]
 [junit]

BUILD FAILED
```

2023年10月23日(月) 23:02 Karl Wright:


This is all you need to do:

ant clean-core-deps
ant make-core-deps
ant clean
ant test

Karl


On Mon, Oct 23, 2023 at 9:55 AM Mingchun Zhao 
Hi Guylaine, Thanks!


Thanks for all your sharing, it's very helpful! I'll continue...

I'll look into it some more too. If I have any other information I'll

share

it with you.

2023年10月23日(月) 22:49 Guylaine BASSETTE <

guylaine.basse...@francelabs.com

:


Thanks for all your sharing, it's very helpful! I'll continue...

Sorry, French and English mixed up!

Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :

Hi all,

Thanks for all your shares, it's very helpfull! Merci pour tous vos
partages, c'est très utile ! Je poursuis...

Le 23/10/2023 à 15:31, Karl Wright a écrit :

I can't give advice on the test; this is something FranceLabs

should

look
at.
However, nothing of what you are doing will affect the zookeeper
tests in
framework.  That's a totally different issue.

Karl


On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao<

mingchun.zha...@gmail.com

wrote:


Hi Karl and Guylaine,


I hope and think it's just a problem specific to the test.

Missing

updates or incompatible dependencies...

Allow me to share with you what I'm working on.  I've tried to

support

http2C within the Solr output connector junit test, but got

another

unhandled solr exception when I ran `ant run-IT-HSQLDB`.

- source code change
```
diff --git



a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests

/MockSolrService.java



b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output

/solr/tests/MockSolrService.java
index 237ade09c..3fb558f52 100644
---



a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo

lrService.java
+++



b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo

lrService.java
@@

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

Yes, that is indicating that zookeeper is looking for a specific netty
class that it isn't finding.  That is why I think there is now a zookeeper
dependency we aren't including in the classpaths that include zookeeper.

Karl


On Mon, Oct 23, 2023 at 10:23 AM Mingchun Zhao 
wrote:

> Karl, Thanks!
> I think I reproduced that multiThreadZooKeeperLockTest error when I
> running `ant test`, will look into this.
> ```
> [junit] -  ---
> [junit] Testcase:
>
> multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
> Caused an ERROR
> [junit] io/netty/handler/ssl/SslContext
> [junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
> [junit] at
>
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> [junit] at
>
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> [junit] at
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnectionPool.grab(ZooKeeperConnectionPool.java:48)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperLockObject.obtainGlobalReadLock(ZooKeeperLockObject.java:190)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.LockObject.enterReadLock(LockObject.java:310)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.LockGate.enterReadLock(LockGate.java:271)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks.enterReadLock(TestZooKeeperLocks.java:125)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks$ReaderThread.run(TestZooKeeperLocks.java:204)
> [junit] Caused by: java.lang.ClassNotFoundException:
> io.netty.handler.ssl.SslContext
> [junit] at
>
> java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
> [junit] at
>
> java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
> [junit] at
> java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
> [junit]
> [junit]
>
> BUILD FAILED
> ```
>
> 2023年10月23日(月) 23:02 Karl Wright :
>
> > This is all you need to do:
> >
> > ant clean-core-deps
> > ant make-core-deps
> > ant clean
> > ant test
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 9:55 AM Mingchun Zhao  >
> > wrote:
> >
> > > Hi Guylaine, Thanks!
> > >
> > > > Thanks for all your sharing, it's very helpful! I'll continue...
> > >
> > > I'll look into it some more too. If I have any other information I'll
> > share
> > > it with you.
> > >
> > > 2023年10月23日(月) 22:49 Guylaine BASSETTE <
> guylaine.basse...@francelabs.com
> > >:
> > >
> > > > Thanks for all your sharing, it's very helpful! I'll continue...
> > > >
> > > > Sorry, French and English mixed up!
> > > >
> > > > Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :
> > > > > Hi all,
> > > > >
> > > > > Thanks for all your shares, it's very helpfull! Merci pour tous vos
> > > > > partages, c'est très utile ! Je poursuis...
> > > > >
> > > > > Le 23/10/2023 à 15:31, Karl Wright a écrit :
> > > > >> I can't give advice on the test; this is something FranceLabs
> should
> > > > >> look
> > > > >> at.
> > > > >> However, nothing of what you are doing will affect the zookeeper
> > > > >> tests in
> > > > >> framework.  That's a totally different issue.
> > > > >>
> > > > >> Karl
> > > > >>
> > > > >>
> > > > >> On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao<
> > > mingchun.zha...@gmail.com
> > > > >
> > > > >> wrote:
> > > > >>
> > > > >>> Hi Karl and Guylaine,
> > > > >>>
> > > >  I hope and think it's just a problem specific to the test.
> Missing
> > > > >>> updates or incompatible dependencies...
> > > > >>>
> > > > >>> Allow me to share with you what I'm working on.  I've tried to
> > > support
> > > > >>> http2C within the Solr output connector junit test, but got
> another
> > > > >>> unhandled solr exception when I ran `ant run-IT-HSQLDB`.
> > > > >>>
> > > > >>> - source code change
> > > > >>> ```
> > > > >>> diff --git
> > > > >>>
> > > > >>>
> > > >
> > >
> >
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

Karl, Thanks!
I think I reproduced that multiThreadZooKeeperLockTest error when I
running `ant test`, will look into this.
```
[junit] -  ---
[junit] Testcase:
multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
Caused an ERROR
[junit] io/netty/handler/ssl/SslContext
[junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
[junit] at
org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
[junit] at
org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
[junit] at
org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperConnectionPool.grab(ZooKeeperConnectionPool.java:48)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperLockObject.obtainGlobalReadLock(ZooKeeperLockObject.java:190)
[junit] at
org.apache.manifoldcf.core.lockmanager.LockObject.enterReadLock(LockObject.java:310)
[junit] at
org.apache.manifoldcf.core.lockmanager.LockGate.enterReadLock(LockGate.java:271)
[junit] at
org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks.enterReadLock(TestZooKeeperLocks.java:125)
[junit] at
org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks$ReaderThread.run(TestZooKeeperLocks.java:204)
[junit] Caused by: java.lang.ClassNotFoundException:
io.netty.handler.ssl.SslContext
[junit] at
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
[junit] at
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
[junit] at
java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
[junit]
[junit]

BUILD FAILED
```

2023年10月23日(月) 23:02 Karl Wright :

> This is all you need to do:
>
> ant clean-core-deps
> ant make-core-deps
> ant clean
> ant test
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 9:55 AM Mingchun Zhao 
> wrote:
>
> > Hi Guylaine, Thanks!
> >
> > > Thanks for all your sharing, it's very helpful! I'll continue...
> >
> > I'll look into it some more too. If I have any other information I'll
> share
> > it with you.
> >
> > 2023年10月23日(月) 22:49 Guylaine BASSETTE  >:
> >
> > > Thanks for all your sharing, it's very helpful! I'll continue...
> > >
> > > Sorry, French and English mixed up!
> > >
> > > Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :
> > > > Hi all,
> > > >
> > > > Thanks for all your shares, it's very helpfull! Merci pour tous vos
> > > > partages, c'est très utile ! Je poursuis...
> > > >
> > > > Le 23/10/2023 à 15:31, Karl Wright a écrit :
> > > >> I can't give advice on the test; this is something FranceLabs should
> > > >> look
> > > >> at.
> > > >> However, nothing of what you are doing will affect the zookeeper
> > > >> tests in
> > > >> framework.  That's a totally different issue.
> > > >>
> > > >> Karl
> > > >>
> > > >>
> > > >> On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao<
> > mingchun.zha...@gmail.com
> > > >
> > > >> wrote:
> > > >>
> > > >>> Hi Karl and Guylaine,
> > > >>>
> > >  I hope and think it's just a problem specific to the test. Missing
> > > >>> updates or incompatible dependencies...
> > > >>>
> > > >>> Allow me to share with you what I'm working on.  I've tried to
> > support
> > > >>> http2C within the Solr output connector junit test, but got another
> > > >>> unhandled solr exception when I ran `ant run-IT-HSQLDB`.
> > > >>>
> > > >>> - source code change
> > > >>> ```
> > > >>> diff --git
> > > >>>
> > > >>>
> > >
> >
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
> > >
> > > >>>
> > > >>> /MockSolrService.java
> > > >>>
> > > >>>
> > >
> >
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
> > >
> > > >>>
> > > >>> /solr/tests/MockSolrService.java
> > > >>> index 237ade09c..3fb558f52 100644
> > > >>> ---
> > > >>>
> > > >>>
> > >
> >
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
> > >
> > > >>>
> > > >>> lrService.java
> > > >>> +++
> > > >>>
> > > >>>
> > >
> >
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

This is all you need to do:

ant clean-core-deps
ant make-core-deps
ant clean
ant test

Karl


On Mon, Oct 23, 2023 at 9:55 AM Mingchun Zhao 
wrote:

> Hi Guylaine, Thanks!
>
> > Thanks for all your sharing, it's very helpful! I'll continue...
>
> I'll look into it some more too. If I have any other information I'll share
> it with you.
>
> 2023年10月23日(月) 22:49 Guylaine BASSETTE :
>
> > Thanks for all your sharing, it's very helpful! I'll continue...
> >
> > Sorry, French and English mixed up!
> >
> > Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :
> > > Hi all,
> > >
> > > Thanks for all your shares, it's very helpfull! Merci pour tous vos
> > > partages, c'est très utile ! Je poursuis...
> > >
> > > Le 23/10/2023 à 15:31, Karl Wright a écrit :
> > >> I can't give advice on the test; this is something FranceLabs should
> > >> look
> > >> at.
> > >> However, nothing of what you are doing will affect the zookeeper
> > >> tests in
> > >> framework.  That's a totally different issue.
> > >>
> > >> Karl
> > >>
> > >>
> > >> On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao<
> mingchun.zha...@gmail.com
> > >
> > >> wrote:
> > >>
> > >>> Hi Karl and Guylaine,
> > >>>
> >  I hope and think it's just a problem specific to the test. Missing
> > >>> updates or incompatible dependencies...
> > >>>
> > >>> Allow me to share with you what I'm working on.  I've tried to
> support
> > >>> http2C within the Solr output connector junit test, but got another
> > >>> unhandled solr exception when I ran `ant run-IT-HSQLDB`.
> > >>>
> > >>> - source code change
> > >>> ```
> > >>> diff --git
> > >>>
> > >>>
> >
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
> >
> > >>>
> > >>> /MockSolrService.java
> > >>>
> > >>>
> >
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
> >
> > >>>
> > >>> /solr/tests/MockSolrService.java
> > >>> index 237ade09c..3fb558f52 100644
> > >>> ---
> > >>>
> > >>>
> >
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
> >
> > >>>
> > >>> lrService.java
> > >>> +++
> > >>>
> > >>>
> >
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
> >
> > >>>
> > >>> lrService.java
> > >>> @@ -18,7 +18,10 @@
> > >>>   */
> > >>>   package org.apache.manifoldcf.agents.output.solr.tests;
> > >>>
> > >>> +import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
> > >>>   import org.eclipse.jetty.servlet.ServletHolder;
> > >>> +import org.eclipse.jetty.server.HttpConfiguration;
> > >>> +import org.eclipse.jetty.server.HttpConnectionFactory;
> > >>>   import org.eclipse.jetty.server.Server;
> > >>>   import org.eclipse.jetty.server.ServerConnector;
> > >>>   import org.eclipse.jetty.servlet.ServletContextHandler;
> > >>> @@ -40,7 +43,10 @@ public class MockSolrService
> > >>> public MockSolrService()
> > >>> {
> > >>>   server = new Server(new QueuedThreadPool(35));
> > >>> -ServerConnector connector = new ServerConnector(server);
> > >>> +HttpConfiguration config = new HttpConfiguration();
> > >>> +HttpConnectionFactory http1 = new HttpConnectionFactory(config);
> > >>> +HTTP2CServerConnectionFactory http2c = new
> > >>> HTTP2CServerConnectionFactory(config);
> > >>> +ServerConnector connector = new ServerConnector(server, http1,
> > >>> http2c);
> > >>>   connector.setPort(8188);
> > >>>   server.addConnector(connector);
> > >>>   servlet = new SolrServlet();
> > >>> @@ -111,6 +117,7 @@ public class MockSolrService
> > >>> res.getWriter().printf(Locale.ROOT, "\n");
> > >>> res.getWriter().printf(Locale.ROOT, "\n");
> > >>> res.getWriter().flush();
> > >>>   }
> > >>> ```
> > >>>
> > >>> - run Junit test
> > >>> ```
> > >>> ~manifoldcf/connectors/solr% ant run-IT-HSQLDB
> > >>> ```
> > >>>
> > >>> - confirm test-HSQLDB-output/manifoldcf.log
> > >>> ```
> > >>> ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception
> tossed:
> > >>> Unhandled Solr exception during indexinghttp://test70.txt (200):
> Error
> > >>> from server athttp://localhost:8188/solr: Expected mime type
> > >>> application/octet-stream but got application/xml. 
> > >>>
> > >>> 
> > >>>
> > >>> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled
> > >>> Solr
> > >>> exception during indexinghttp://test70.txt  (200): Error from server
> at
> > >>> http://localhost:8188/solr: Expected mime type
> > application/octet-stream
> > >>> but
> > >>> got application/xml. 
> > >>>
> > >>> 
> > >>>
> > >>> at
> > >>>
> > >>>
> >
> org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389)
> >
> > >>>
> > >>> ~[classes/:?]
> > >>> at
> > >>>
> > >>>
> >
> org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544)
> >
> > >>>
> > >>> ~[classes/:?]
> > >>> at
> > >>>
> > >>>
> >
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

Hi Guylaine, Thanks!

> Thanks for all your sharing, it's very helpful! I'll continue...

I'll look into it some more too. If I have any other information I'll share
it with you.

2023年10月23日(月) 22:49 Guylaine BASSETTE :

> Thanks for all your sharing, it's very helpful! I'll continue...
>
> Sorry, French and English mixed up!
>
> Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :
> > Hi all,
> >
> > Thanks for all your shares, it's very helpfull! Merci pour tous vos
> > partages, c'est très utile ! Je poursuis...
> >
> > Le 23/10/2023 à 15:31, Karl Wright a écrit :
> >> I can't give advice on the test; this is something FranceLabs should
> >> look
> >> at.
> >> However, nothing of what you are doing will affect the zookeeper
> >> tests in
> >> framework.  That's a totally different issue.
> >>
> >> Karl
> >>
> >>
> >> On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao >
> >> wrote:
> >>
> >>> Hi Karl and Guylaine,
> >>>
>  I hope and think it's just a problem specific to the test. Missing
> >>> updates or incompatible dependencies...
> >>>
> >>> Allow me to share with you what I'm working on.  I've tried to support
> >>> http2C within the Solr output connector junit test, but got another
> >>> unhandled solr exception when I ran `ant run-IT-HSQLDB`.
> >>>
> >>> - source code change
> >>> ```
> >>> diff --git
> >>>
> >>>
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
>
> >>>
> >>> /MockSolrService.java
> >>>
> >>>
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
>
> >>>
> >>> /solr/tests/MockSolrService.java
> >>> index 237ade09c..3fb558f52 100644
> >>> ---
> >>>
> >>>
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
>
> >>>
> >>> lrService.java
> >>> +++
> >>>
> >>>
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
>
> >>>
> >>> lrService.java
> >>> @@ -18,7 +18,10 @@
> >>>   */
> >>>   package org.apache.manifoldcf.agents.output.solr.tests;
> >>>
> >>> +import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
> >>>   import org.eclipse.jetty.servlet.ServletHolder;
> >>> +import org.eclipse.jetty.server.HttpConfiguration;
> >>> +import org.eclipse.jetty.server.HttpConnectionFactory;
> >>>   import org.eclipse.jetty.server.Server;
> >>>   import org.eclipse.jetty.server.ServerConnector;
> >>>   import org.eclipse.jetty.servlet.ServletContextHandler;
> >>> @@ -40,7 +43,10 @@ public class MockSolrService
> >>> public MockSolrService()
> >>> {
> >>>   server = new Server(new QueuedThreadPool(35));
> >>> -ServerConnector connector = new ServerConnector(server);
> >>> +HttpConfiguration config = new HttpConfiguration();
> >>> +HttpConnectionFactory http1 = new HttpConnectionFactory(config);
> >>> +HTTP2CServerConnectionFactory http2c = new
> >>> HTTP2CServerConnectionFactory(config);
> >>> +ServerConnector connector = new ServerConnector(server, http1,
> >>> http2c);
> >>>   connector.setPort(8188);
> >>>   server.addConnector(connector);
> >>>   servlet = new SolrServlet();
> >>> @@ -111,6 +117,7 @@ public class MockSolrService
> >>> res.getWriter().printf(Locale.ROOT, "\n");
> >>> res.getWriter().printf(Locale.ROOT, "\n");
> >>> res.getWriter().flush();
> >>>   }
> >>> ```
> >>>
> >>> - run Junit test
> >>> ```
> >>> ~manifoldcf/connectors/solr% ant run-IT-HSQLDB
> >>> ```
> >>>
> >>> - confirm test-HSQLDB-output/manifoldcf.log
> >>> ```
> >>> ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception tossed:
> >>> Unhandled Solr exception during indexinghttp://test70.txt (200): Error
> >>> from server athttp://localhost:8188/solr: Expected mime type
> >>> application/octet-stream but got application/xml. 
> >>>
> >>> 
> >>>
> >>> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled
> >>> Solr
> >>> exception during indexinghttp://test70.txt  (200): Error from server at
> >>> http://localhost:8188/solr: Expected mime type
> application/octet-stream
> >>> but
> >>> got application/xml. 
> >>>
> >>> 
> >>>
> >>> at
> >>>
> >>>
> org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389)
>
> >>>
> >>> ~[classes/:?]
> >>> at
> >>>
> >>>
> org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544)
>
> >>>
> >>> ~[classes/:?]
> >>> at
> >>>
> >>>
> org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocumentWithException(SolrConnector.java:522)
>
> >>>
> >>> ~[classes/:?]
> >>> at
> >>>
> >>>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3214)
>
> >>>
> >>> ~[mcf-agents.jar:?]
> >>> at
> >>>
> >>>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$OutputAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3395)
>
> >>>
> >>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Guylaine BASSETTE


Thanks for all your sharing, it's very helpful! I'll continue...

Sorry, French and English mixed up!

Le 23/10/2023 à 15:46, Guylaine BASSETTE a écrit :

Hi all,

Thanks for all your shares, it's very helpfull! Merci pour tous vos 
partages, c'est très utile ! Je poursuis...


Le 23/10/2023 à 15:31, Karl Wright a écrit :
I can't give advice on the test; this is something FranceLabs should 
look

at.
However, nothing of what you are doing will affect the zookeeper 
tests in

framework.  That's a totally different issue.

Karl


On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao
wrote:


Hi Karl and Guylaine,


I hope and think it's just a problem specific to the test. Missing

updates or incompatible dependencies...

Allow me to share with you what I'm working on.  I've tried to support
http2C within the Solr output connector junit test, but got another
unhandled solr exception when I ran `ant run-IT-HSQLDB`.

- source code change
```
diff --git

a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests 


/MockSolrService.java

b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output 


/solr/tests/MockSolrService.java
index 237ade09c..3fb558f52 100644
---

a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo 


lrService.java
+++

b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo 


lrService.java
@@ -18,7 +18,10 @@
  */
  package org.apache.manifoldcf.agents.output.solr.tests;

+import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
  import org.eclipse.jetty.servlet.ServletHolder;
+import org.eclipse.jetty.server.HttpConfiguration;
+import org.eclipse.jetty.server.HttpConnectionFactory;
  import org.eclipse.jetty.server.Server;
  import org.eclipse.jetty.server.ServerConnector;
  import org.eclipse.jetty.servlet.ServletContextHandler;
@@ -40,7 +43,10 @@ public class MockSolrService
    public MockSolrService()
    {
  server = new Server(new QueuedThreadPool(35));
-    ServerConnector connector = new ServerConnector(server);
+    HttpConfiguration config = new HttpConfiguration();
+    HttpConnectionFactory http1 = new HttpConnectionFactory(config);
+    HTTP2CServerConnectionFactory http2c = new
HTTP2CServerConnectionFactory(config);
+    ServerConnector connector = new ServerConnector(server, http1,
http2c);
  connector.setPort(8188);
  server.addConnector(connector);
  servlet = new SolrServlet();
@@ -111,6 +117,7 @@ public class MockSolrService
    res.getWriter().printf(Locale.ROOT, "\n");
    res.getWriter().printf(Locale.ROOT, "\n");
    res.getWriter().flush();
  }
```

- run Junit test
```
~manifoldcf/connectors/solr% ant run-IT-HSQLDB
```

- confirm test-HSQLDB-output/manifoldcf.log
```
ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception tossed:
Unhandled Solr exception during indexinghttp://test70.txt (200): Error
from server athttp://localhost:8188/solr: Expected mime type
application/octet-stream but got application/xml. 
   


org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled 
Solr

exception during indexinghttp://test70.txt  (200): Error from server at
http://localhost:8188/solr: Expected mime type application/octet-stream
but
got application/xml. 
   


at

org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389) 


~[classes/:?]
at

org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544) 


~[classes/:?]
at

org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocumentWithException(SolrConnector.java:522) 


~[classes/:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3214) 


~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$OutputAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3395) 


~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddFanout.sendDocument(IncrementalIngester.java:3065) 


~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineObjectWithVersions.addOrReplaceDocumentWithException(IncrementalIngester.java:2696) 


~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:750) 


~[mcf-agents.jar:?]
at

org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1585) 


~[mcf-pull-agent.jar:?]
at

org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1550) 


~[mcf-pull-agent.jar:?]
at

org.apache.manifoldcf.crawler.tests.TestingRepositoryConnector.processDocuments(TestingRepositoryConnector.java:84) 


~[mcf-pull-agent-tests.jar:?]
at

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Guylaine BASSETTE


Hi all,

Thanks for all your shares, it's very helpfull! Merci pour tous vos 
partages, c'est très utile ! Je poursuis...


Le 23/10/2023 à 15:31, Karl Wright a écrit :

I can't give advice on the test; this is something FranceLabs should look
at.
However, nothing of what you are doing will affect the zookeeper tests in
framework.  That's a totally different issue.

Karl


On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao
wrote:


Hi Karl and Guylaine,


I hope and think it's just a problem specific to the test. Missing

updates or incompatible dependencies...

Allow me to share with you what I'm working on.  I've tried to support
http2C within the Solr output connector junit test, but got another
unhandled solr exception when I ran `ant run-IT-HSQLDB`.

- source code change
```
diff --git

a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
/MockSolrService.java

b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
/solr/tests/MockSolrService.java
index 237ade09c..3fb558f52 100644
---

a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
lrService.java
+++

b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
lrService.java
@@ -18,7 +18,10 @@
  */
  package org.apache.manifoldcf.agents.output.solr.tests;

+import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
  import org.eclipse.jetty.servlet.ServletHolder;
+import org.eclipse.jetty.server.HttpConfiguration;
+import org.eclipse.jetty.server.HttpConnectionFactory;
  import org.eclipse.jetty.server.Server;
  import org.eclipse.jetty.server.ServerConnector;
  import org.eclipse.jetty.servlet.ServletContextHandler;
@@ -40,7 +43,10 @@ public class MockSolrService
public MockSolrService()
{
  server = new Server(new QueuedThreadPool(35));
-ServerConnector connector = new ServerConnector(server);
+HttpConfiguration config = new HttpConfiguration();
+HttpConnectionFactory http1 = new HttpConnectionFactory(config);
+HTTP2CServerConnectionFactory http2c = new
HTTP2CServerConnectionFactory(config);
+ServerConnector connector = new ServerConnector(server, http1,
http2c);
  connector.setPort(8188);
  server.addConnector(connector);
  servlet = new SolrServlet();
@@ -111,6 +117,7 @@ public class MockSolrService
res.getWriter().printf(Locale.ROOT, "\n");
res.getWriter().printf(Locale.ROOT, "\n");
res.getWriter().flush();
  }
```

- run Junit test
```
~manifoldcf/connectors/solr% ant run-IT-HSQLDB
```

- confirm test-HSQLDB-output/manifoldcf.log
```
ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception tossed:
Unhandled Solr exception during indexinghttp://test70.txt  (200): Error
from server athttp://localhost:8188/solr: Expected mime type
application/octet-stream but got application/xml. 
   


org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled Solr
exception during indexinghttp://test70.txt  (200): Error from server at
http://localhost:8188/solr: Expected mime type application/octet-stream
but
got application/xml. 
   


at

org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389)
~[classes/:?]
at

org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544)
~[classes/:?]
at

org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocumentWithException(SolrConnector.java:522)
~[classes/:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3214)
~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$OutputAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3395)
~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddFanout.sendDocument(IncrementalIngester.java:3065)
~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineObjectWithVersions.addOrReplaceDocumentWithException(IncrementalIngester.java:2696)
~[mcf-agents.jar:?]
at

org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:750)
~[mcf-agents.jar:?]
at

org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1585)
~[mcf-pull-agent.jar:?]
at

org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1550)
~[mcf-pull-agent.jar:?]
at

org.apache.manifoldcf.crawler.tests.TestingRepositoryConnector.processDocuments(TestingRepositoryConnector.java:84)
~[mcf-pull-agent-tests.jar:?]
at

org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:402)
~[mcf-pull-agent.jar:?]
ERROR 2023-10-23T22:10:29,902 (Worker thread '10') - Exception tossed:
Unhandled Solr exception during

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

I can't give advice on the test; this is something FranceLabs should look
at.
However, nothing of what you are doing will affect the zookeeper tests in
framework.  That's a totally different issue.

Karl


On Mon, Oct 23, 2023 at 9:20 AM Mingchun Zhao 
wrote:

> Hi Karl and Guylaine,
>
> > I hope and think it's just a problem specific to the test. Missing
> updates or incompatible dependencies...
>
> Allow me to share with you what I'm working on.  I've tried to support
> http2C within the Solr output connector junit test, but got another
> unhandled solr exception when I ran `ant run-IT-HSQLDB`.
>
> - source code change
> ```
> diff --git
>
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
> /MockSolrService.java
>
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
> /solr/tests/MockSolrService.java
> index 237ade09c..3fb558f52 100644
> ---
>
> a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
> lrService.java
> +++
>
> b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
> lrService.java
> @@ -18,7 +18,10 @@
>  */
>  package org.apache.manifoldcf.agents.output.solr.tests;
>
> +import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
>  import org.eclipse.jetty.servlet.ServletHolder;
> +import org.eclipse.jetty.server.HttpConfiguration;
> +import org.eclipse.jetty.server.HttpConnectionFactory;
>  import org.eclipse.jetty.server.Server;
>  import org.eclipse.jetty.server.ServerConnector;
>  import org.eclipse.jetty.servlet.ServletContextHandler;
> @@ -40,7 +43,10 @@ public class MockSolrService
>public MockSolrService()
>{
>  server = new Server(new QueuedThreadPool(35));
> -ServerConnector connector = new ServerConnector(server);
> +HttpConfiguration config = new HttpConfiguration();
> +HttpConnectionFactory http1 = new HttpConnectionFactory(config);
> +HTTP2CServerConnectionFactory http2c = new
> HTTP2CServerConnectionFactory(config);
> +ServerConnector connector = new ServerConnector(server, http1,
> http2c);
>  connector.setPort(8188);
>  server.addConnector(connector);
>  servlet = new SolrServlet();
> @@ -111,6 +117,7 @@ public class MockSolrService
>res.getWriter().printf(Locale.ROOT, "\n");
>res.getWriter().printf(Locale.ROOT, "\n");
>res.getWriter().flush();
>  }
> ```
>
> - run Junit test
> ```
> ~manifoldcf/connectors/solr% ant run-IT-HSQLDB
> ```
>
> - confirm test-HSQLDB-output/manifoldcf.log
> ```
> ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception tossed:
> Unhandled Solr exception during indexing http://test70.txt (200): Error
> from server at http://localhost:8188/solr: Expected mime type
> application/octet-stream but got application/xml. 
>   
> 
>
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled Solr
> exception during indexing http://test70.txt (200): Error from server at
> http://localhost:8188/solr: Expected mime type application/octet-stream
> but
> got application/xml. 
>   
> 
>
> at
>
> org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389)
> ~[classes/:?]
> at
>
> org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544)
> ~[classes/:?]
> at
>
> org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocumentWithException(SolrConnector.java:522)
> ~[classes/:?]
> at
>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3214)
> ~[mcf-agents.jar:?]
> at
>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$OutputAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3395)
> ~[mcf-agents.jar:?]
> at
>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddFanout.sendDocument(IncrementalIngester.java:3065)
> ~[mcf-agents.jar:?]
> at
>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineObjectWithVersions.addOrReplaceDocumentWithException(IncrementalIngester.java:2696)
> ~[mcf-agents.jar:?]
> at
>
> org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:750)
> ~[mcf-agents.jar:?]
> at
>
> org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1585)
> ~[mcf-pull-agent.jar:?]
> at
>
> org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1550)
> ~[mcf-pull-agent.jar:?]
> at
>
> org.apache.manifoldcf.crawler.tests.TestingRepositoryConnector.processDocuments(TestingRepositoryConnector.java:84)
> ~[mcf-pull-agent-tests.jar:?]
> at
>
> org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:402)
> ~[mcf-pull-agent.jar:?]
> ERROR 2023-10-23T22:10:29,902 (Worker thread '10') - Exception

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

Hi Karl and Guylaine,

> I hope and think it's just a problem specific to the test. Missing
updates or incompatible dependencies...

Allow me to share with you what I'm working on.  I've tried to support
http2C within the Solr output connector junit test, but got another
unhandled solr exception when I ran `ant run-IT-HSQLDB`.

- source code change
```
diff --git
a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests
/MockSolrService.java
b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output
/solr/tests/MockSolrService.java
index 237ade09c..3fb558f52 100644
---
a/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
lrService.java
+++
b/connectors/solr/connector/src/test/java/org/apache/manifoldcf/agents/output/solr/tests/MockSo
lrService.java
@@ -18,7 +18,10 @@
 */
 package org.apache.manifoldcf.agents.output.solr.tests;

+import org.eclipse.jetty.http2.server.HTTP2CServerConnectionFactory;
 import org.eclipse.jetty.servlet.ServletHolder;
+import org.eclipse.jetty.server.HttpConfiguration;
+import org.eclipse.jetty.server.HttpConnectionFactory;
 import org.eclipse.jetty.server.Server;
 import org.eclipse.jetty.server.ServerConnector;
 import org.eclipse.jetty.servlet.ServletContextHandler;
@@ -40,7 +43,10 @@ public class MockSolrService
   public MockSolrService()
   {
 server = new Server(new QueuedThreadPool(35));
-ServerConnector connector = new ServerConnector(server);
+HttpConfiguration config = new HttpConfiguration();
+HttpConnectionFactory http1 = new HttpConnectionFactory(config);
+HTTP2CServerConnectionFactory http2c = new
HTTP2CServerConnectionFactory(config);
+ServerConnector connector = new ServerConnector(server, http1, http2c);
 connector.setPort(8188);
 server.addConnector(connector);
 servlet = new SolrServlet();
@@ -111,6 +117,7 @@ public class MockSolrService
   res.getWriter().printf(Locale.ROOT, "\n");
   res.getWriter().printf(Locale.ROOT, "\n");
   res.getWriter().flush();
 }
```

- run Junit test
```
~manifoldcf/connectors/solr% ant run-IT-HSQLDB
```

- confirm test-HSQLDB-output/manifoldcf.log
```
ERROR 2023-10-23T22:10:29,902 (Worker thread '24') - Exception tossed:
Unhandled Solr exception during indexing http://test70.txt (200): Error
from server at http://localhost:8188/solr: Expected mime type
application/octet-stream but got application/xml. 
  


org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unhandled Solr
exception during indexing http://test70.txt (200): Error from server at
http://localhost:8188/solr: Expected mime type application/octet-stream but
got application/xml. 
  


at
org.apache.manifoldcf.agents.output.solr.HttpPoster.handleSolrException(HttpPoster.java:389)
~[classes/:?]
at
org.apache.manifoldcf.agents.output.solr.HttpPoster.indexPost(HttpPoster.java:544)
~[classes/:?]
at
org.apache.manifoldcf.agents.output.solr.SolrConnector.addOrReplaceDocumentWithException(SolrConnector.java:522)
~[classes/:?]
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3214)
~[mcf-agents.jar:?]
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$OutputAddEntryPoint.addOrReplaceDocumentWithException(IncrementalIngester.java:3395)
~[mcf-agents.jar:?]
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineAddFanout.sendDocument(IncrementalIngester.java:3065)
~[mcf-agents.jar:?]
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester$PipelineObjectWithVersions.addOrReplaceDocumentWithException(IncrementalIngester.java:2696)
~[mcf-agents.jar:?]
at
org.apache.manifoldcf.agents.incrementalingest.IncrementalIngester.documentIngest(IncrementalIngester.java:750)
~[mcf-agents.jar:?]
at
org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1585)
~[mcf-pull-agent.jar:?]
at
org.apache.manifoldcf.crawler.system.WorkerThread$ProcessActivity.ingestDocumentWithException(WorkerThread.java:1550)
~[mcf-pull-agent.jar:?]
at
org.apache.manifoldcf.crawler.tests.TestingRepositoryConnector.processDocuments(TestingRepositoryConnector.java:84)
~[mcf-pull-agent-tests.jar:?]
at
org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:402)
~[mcf-pull-agent.jar:?]
ERROR 2023-10-23T22:10:29,902 (Worker thread '10') - Exception tossed:
Unhandled Solr exception during indexing http://test72.txt (200): Error
from server at http://localhost:8188/solr: Expected mime type
application/octet-stream but got application/xml. 
  

```

Could you give me some advice?

2023年10月23日(月) 22:01 Mingchun Zhao :

> > Then, wherever zookeeper is mentioned in framework/build.xml, a
> reference to those dependencies must also be included.
>
> It looks like zookeeper*.jar was already included in
> connector-test-classpath within kafka/build.xml.
> ```
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

> Then, wherever zookeeper is mentioned in framework/build.xml, a
reference to those dependencies must also be included.

It looks like zookeeper*.jar was already included in
connector-test-classpath within kafka/build.xml.
```









```


2023年10月23日(月) 21:50 Karl Wright :

> Hi,
>
> That just downloads zookeeper.  But apparently the zookeeper version
> required by Kafka now has dependencies of its own.  Otherwise the zookeeper
> tests wouldn't fail with linkage errors.
>
> The dependencies need to be identified and added in several places.  The
> first place is to the download-zookeeper part of the root build.xml
> script.  Then, wherever zookeeper is mentioned in framework/build.xml, a
> reference to those dependencies must also be included.
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 8:32 AM Mingchun Zhao 
> wrote:
>
> > Hi Karl,
> >
> > > Mingchun, did you add the jar(s) that the new zookeeper needs to the
> > build.xml download section?
> >
> > Are the following settings correct? Or do you have an old version of
> > zookeeper-*.jar left in your environment?
> >
> > ```build.xml
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > ... ...
> > ```
> >
> > Regards,
> > Mingchun
> >
> >
> > 2023年10月23日(月) 21:19 Karl Wright :
> >
> > > Well, that was interesting.
> > >
> > > Didn't get very far, because the dependency updates committed broke
> > > Zookeeper again:
> > >
> > > [junit] Testcase:
> > >
> > >
> >
> multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
> > >  Caused an ERROR
> > > [junit] io/netty/handler/ssl/SslContext
> > > [junit] java.lang.NoClassDefFoundError:
> > io/netty/handler/ssl/SslContext
> > > [junit] at
> > >
> > >
> >
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> > > [junit] at
> > >
> > >
> >
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> > > [junit] at
> > > org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> > > [junit] at
> > > org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> > > [junit] at
> > >
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> > > [junit] at
> > > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
> > > [junit] at
> > > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
> > > [junit] at
> > > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
> > > [junit] at
> > > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
> > > [junit] at
> > >
> > >
> >
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
> > > [junit] at
> > >
> > >
> >
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
> > >
> > > It looks like the even newer Zookeeper version has a newer dependency
> > that
> > > isn't being included in the basic classpath, but should be.  Mingchun,
> > did
> > > you add the jar(s) that the new zookeeper needs to the build.xml
> download
> > > section?  If so, can you remind me what they were?
> > >
> > > Karl
> > >
> > >
> > > On Mon, Oct 23, 2023 at 8:11 AM Karl Wright 
> wrote:
> > >
> > > > I begin to suspect that the problem may be human error.
> > > > If you don't do "ant clean-core-deps; ant make-core-deps", but
> instead
> > > > just use "ant make-core-deps", you could have incompatible versions
> of
> > > > several libraries in your classpath for the tests.  I'll try today to
> > > > verify whether that might be happening by trying the tests locally
> > > myself.
> > > >
> > > > Karl
> > > >
> > > >
> > > > On Mon, Oct 23, 2023 at 7:57 AM Guylaine BASSETTE <
> > > > guylaine.basse...@francelabs.com> wrote:
> > > >
> > > >> Hi Karl and Mingchun,
> > > >>
> > > >> Thanks for your work on the last few issues. I join you on this Solr
> > > >> testing problem.
> > > >>
> > > >> That said, we've tested this new connector in our application, with
> a
> > > >> FileShare job and everything was OK.
> > > >>
> > > >> I hope and think it's just a problem specific to the test. Missing
> > > >> updates or incompatible dependencies...
> > > >>
> > > >> Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :
> > > >> > Hi Karl, Thanks!
> > > >> >
> > > >> >> so I wonder if, once again, there's a problem with dependencies
> for
> > > the
> > > >> > version of Solr they chose.
> > > >> >
> > > >> > I'll take a look at this issue.
> > > >> >
> > > >> > 2023年10月20日(金) 9:50 Karl Wright:
> > > >> >
> > > >> >> This connector FranceLabs updated.  The problem seems to occur
> at a
> > > >> basic
> > > >> >> level during http2 communication, so I wonder if, once again,
> > > there's a
> > > >> >> problem with dependencies for the version of Solr they chose.

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

Hi,

That just downloads zookeeper.  But apparently the zookeeper version
required by Kafka now has dependencies of its own.  Otherwise the zookeeper
tests wouldn't fail with linkage errors.

The dependencies need to be identified and added in several places.  The
first place is to the download-zookeeper part of the root build.xml
script.  Then, wherever zookeeper is mentioned in framework/build.xml, a
reference to those dependencies must also be included.

Karl


On Mon, Oct 23, 2023 at 8:32 AM Mingchun Zhao 
wrote:

> Hi Karl,
>
> > Mingchun, did you add the jar(s) that the new zookeeper needs to the
> build.xml download section?
>
> Are the following settings correct? Or do you have an old version of
> zookeeper-*.jar left in your environment?
>
> ```build.xml
> 
> 
> 
> 
> 
> 
> 
> 
> 
> ... ...
> ```
>
> Regards,
> Mingchun
>
>
> 2023年10月23日(月) 21:19 Karl Wright :
>
> > Well, that was interesting.
> >
> > Didn't get very far, because the dependency updates committed broke
> > Zookeeper again:
> >
> > [junit] Testcase:
> >
> >
> multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
> >  Caused an ERROR
> > [junit] io/netty/handler/ssl/SslContext
> > [junit] java.lang.NoClassDefFoundError:
> io/netty/handler/ssl/SslContext
> > [junit] at
> >
> >
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> > [junit] at
> >
> >
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> > [junit] at
> > org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> > [junit] at
> > org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> > [junit] at
> > org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> > [junit] at
> > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
> > [junit] at
> > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
> > [junit] at
> > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
> > [junit] at
> > org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
> > [junit] at
> >
> >
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
> > [junit] at
> >
> >
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
> >
> > It looks like the even newer Zookeeper version has a newer dependency
> that
> > isn't being included in the basic classpath, but should be.  Mingchun,
> did
> > you add the jar(s) that the new zookeeper needs to the build.xml download
> > section?  If so, can you remind me what they were?
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 8:11 AM Karl Wright  wrote:
> >
> > > I begin to suspect that the problem may be human error.
> > > If you don't do "ant clean-core-deps; ant make-core-deps", but instead
> > > just use "ant make-core-deps", you could have incompatible versions of
> > > several libraries in your classpath for the tests.  I'll try today to
> > > verify whether that might be happening by trying the tests locally
> > myself.
> > >
> > > Karl
> > >
> > >
> > > On Mon, Oct 23, 2023 at 7:57 AM Guylaine BASSETTE <
> > > guylaine.basse...@francelabs.com> wrote:
> > >
> > >> Hi Karl and Mingchun,
> > >>
> > >> Thanks for your work on the last few issues. I join you on this Solr
> > >> testing problem.
> > >>
> > >> That said, we've tested this new connector in our application, with a
> > >> FileShare job and everything was OK.
> > >>
> > >> I hope and think it's just a problem specific to the test. Missing
> > >> updates or incompatible dependencies...
> > >>
> > >> Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :
> > >> > Hi Karl, Thanks!
> > >> >
> > >> >> so I wonder if, once again, there's a problem with dependencies for
> > the
> > >> > version of Solr they chose.
> > >> >
> > >> > I'll take a look at this issue.
> > >> >
> > >> > 2023年10月20日(金) 9:50 Karl Wright:
> > >> >
> > >> >> This connector FranceLabs updated.  The problem seems to occur at a
> > >> basic
> > >> >> level during http2 communication, so I wonder if, once again,
> > there's a
> > >> >> problem with dependencies for the version of Solr they chose.
> > >> >>
> > >> >> Karl
> > >> >>
> > >> >>
> > >> >> On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao<
> > >> mingchun.zha...@gmail.com>
> > >> >> wrote:
> > >> >>
> > >> >>> About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO
> > >> exception
> > >> >>> during indexinghttp://test58.txt:
> > >> >> frame_size_error/invalid_frame_length"
> > >> >>> error is occurring on the ManifoldCF side.
> > >> >>>
> > >> >>> - command:
> > >> >>> ```
> > >> >>> manifoldcf/connectors/solr% ant run-IT-HSQLDB
> > >> >>>
> > >> >>> run-IT-HSQLDB:
> > >> >>>  [junit] Testsuite:
> > >> >>> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> > >> >>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Mingchun Zhao

Hi Karl,

> Mingchun, did you add the jar(s) that the new zookeeper needs to the
build.xml download section?

Are the following settings correct? Or do you have an old version of
zookeeper-*.jar left in your environment?

```build.xml









... ...
```

Regards,
Mingchun


2023年10月23日(月) 21:19 Karl Wright :

> Well, that was interesting.
>
> Didn't get very far, because the dependency updates committed broke
> Zookeeper again:
>
> [junit] Testcase:
>
> multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
>  Caused an ERROR
> [junit] io/netty/handler/ssl/SslContext
> [junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
> [junit] at
>
> org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
> [junit] at
>
> org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
> [junit] at
> org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
> [junit] at
> org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
> [junit] at
> org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
> [junit] at
>
> org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)
>
> It looks like the even newer Zookeeper version has a newer dependency that
> isn't being included in the basic classpath, but should be.  Mingchun, did
> you add the jar(s) that the new zookeeper needs to the build.xml download
> section?  If so, can you remind me what they were?
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 8:11 AM Karl Wright  wrote:
>
> > I begin to suspect that the problem may be human error.
> > If you don't do "ant clean-core-deps; ant make-core-deps", but instead
> > just use "ant make-core-deps", you could have incompatible versions of
> > several libraries in your classpath for the tests.  I'll try today to
> > verify whether that might be happening by trying the tests locally
> myself.
> >
> > Karl
> >
> >
> > On Mon, Oct 23, 2023 at 7:57 AM Guylaine BASSETTE <
> > guylaine.basse...@francelabs.com> wrote:
> >
> >> Hi Karl and Mingchun,
> >>
> >> Thanks for your work on the last few issues. I join you on this Solr
> >> testing problem.
> >>
> >> That said, we've tested this new connector in our application, with a
> >> FileShare job and everything was OK.
> >>
> >> I hope and think it's just a problem specific to the test. Missing
> >> updates or incompatible dependencies...
> >>
> >> Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :
> >> > Hi Karl, Thanks!
> >> >
> >> >> so I wonder if, once again, there's a problem with dependencies for
> the
> >> > version of Solr they chose.
> >> >
> >> > I'll take a look at this issue.
> >> >
> >> > 2023年10月20日(金) 9:50 Karl Wright:
> >> >
> >> >> This connector FranceLabs updated.  The problem seems to occur at a
> >> basic
> >> >> level during http2 communication, so I wonder if, once again,
> there's a
> >> >> problem with dependencies for the version of Solr they chose.
> >> >>
> >> >> Karl
> >> >>
> >> >>
> >> >> On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao<
> >> mingchun.zha...@gmail.com>
> >> >> wrote:
> >> >>
> >> >>> About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO
> >> exception
> >> >>> during indexinghttp://test58.txt:
> >> >> frame_size_error/invalid_frame_length"
> >> >>> error is occurring on the ManifoldCF side.
> >> >>>
> >> >>> - command:
> >> >>> ```
> >> >>> manifoldcf/connectors/solr% ant run-IT-HSQLDB
> >> >>>
> >> >>> run-IT-HSQLDB:
> >> >>>  [junit] Testsuite:
> >> >>> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> >> >>> ... ...
> >> >>> ```
> >> >>>
> >> >>> - I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
> >> >>> ```
> >> >>>   WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception
> >> during
> >> >>> indexinghttp://test58.txt: frame_size_error/invalid_frame_length
> >> >>> java.io.IOException: frame_size_error/invalid_frame_length
> >> >>> at
> >> org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
> >> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >> >>> at
> >> org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
> >> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >> >>> at
> >> >>>
> >> >>>
> >> >>
> >>
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
> >> >>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

Well, that was interesting.

Didn't get very far, because the dependency updates committed broke
Zookeeper again:

[junit] Testcase:
multiThreadZooKeeperLockTest(org.apache.manifoldcf.core.lockmanager.TestZooKeeperLocks):
 Caused an ERROR
[junit] io/netty/handler/ssl/SslContext
[junit] java.lang.NoClassDefFoundError: io/netty/handler/ssl/SslContext
[junit] at
org.apache.zookeeper.common.ZKConfig.handleBackwardCompatibility(ZKConfig.java:106)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.handleBackwardCompatibility(ZKClientConfig.java:96)
[junit] at
org.apache.zookeeper.common.ZKConfig.init(ZKConfig.java:92)
[junit] at
org.apache.zookeeper.common.ZKConfig.(ZKConfig.java:61)
[junit] at
org.apache.zookeeper.client.ZKClientConfig.(ZKClientConfig.java:69)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:643)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:567)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:734)
[junit] at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:448)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.createSession(ZooKeeperConnection.java:74)
[junit] at
org.apache.manifoldcf.core.lockmanager.ZooKeeperConnection.(ZooKeeperConnection.java:66)

It looks like the even newer Zookeeper version has a newer dependency that
isn't being included in the basic classpath, but should be.  Mingchun, did
you add the jar(s) that the new zookeeper needs to the build.xml download
section?  If so, can you remind me what they were?

Karl


On Mon, Oct 23, 2023 at 8:11 AM Karl Wright  wrote:

> I begin to suspect that the problem may be human error.
> If you don't do "ant clean-core-deps; ant make-core-deps", but instead
> just use "ant make-core-deps", you could have incompatible versions of
> several libraries in your classpath for the tests.  I'll try today to
> verify whether that might be happening by trying the tests locally myself.
>
> Karl
>
>
> On Mon, Oct 23, 2023 at 7:57 AM Guylaine BASSETTE <
> guylaine.basse...@francelabs.com> wrote:
>
>> Hi Karl and Mingchun,
>>
>> Thanks for your work on the last few issues. I join you on this Solr
>> testing problem.
>>
>> That said, we've tested this new connector in our application, with a
>> FileShare job and everything was OK.
>>
>> I hope and think it's just a problem specific to the test. Missing
>> updates or incompatible dependencies...
>>
>> Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :
>> > Hi Karl, Thanks!
>> >
>> >> so I wonder if, once again, there's a problem with dependencies for the
>> > version of Solr they chose.
>> >
>> > I'll take a look at this issue.
>> >
>> > 2023年10月20日(金) 9:50 Karl Wright:
>> >
>> >> This connector FranceLabs updated.  The problem seems to occur at a
>> basic
>> >> level during http2 communication, so I wonder if, once again, there's a
>> >> problem with dependencies for the version of Solr they chose.
>> >>
>> >> Karl
>> >>
>> >>
>> >> On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao<
>> mingchun.zha...@gmail.com>
>> >> wrote:
>> >>
>> >>> About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO
>> exception
>> >>> during indexinghttp://test58.txt:
>> >> frame_size_error/invalid_frame_length"
>> >>> error is occurring on the ManifoldCF side.
>> >>>
>> >>> - command:
>> >>> ```
>> >>> manifoldcf/connectors/solr% ant run-IT-HSQLDB
>> >>>
>> >>> run-IT-HSQLDB:
>> >>>  [junit] Testsuite:
>> >>> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
>> >>> ... ...
>> >>> ```
>> >>>
>> >>> - I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
>> >>> ```
>> >>>   WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception
>> during
>> >>> indexinghttp://test58.txt: frame_size_error/invalid_frame_length
>> >>> java.io.IOException: frame_size_error/invalid_frame_length
>> >>> at
>> org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> >>>
>> >>>
>> >>
>> org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> >>>
>> >>>
>> >>
>> org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> >>>
>> >>>
>> >>
>> org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> >>>
>> >>>
>> >>
>> org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)
>> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
>> >>> at
>> >>>
>> >>>
>> >>
>>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Karl Wright

I begin to suspect that the problem may be human error.
If you don't do "ant clean-core-deps; ant make-core-deps", but instead just
use "ant make-core-deps", you could have incompatible versions of several
libraries in your classpath for the tests.  I'll try today to verify
whether that might be happening by trying the tests locally myself.

Karl


On Mon, Oct 23, 2023 at 7:57 AM Guylaine BASSETTE <
guylaine.basse...@francelabs.com> wrote:

> Hi Karl and Mingchun,
>
> Thanks for your work on the last few issues. I join you on this Solr
> testing problem.
>
> That said, we've tested this new connector in our application, with a
> FileShare job and everything was OK.
>
> I hope and think it's just a problem specific to the test. Missing
> updates or incompatible dependencies...
>
> Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :
> > Hi Karl, Thanks!
> >
> >> so I wonder if, once again, there's a problem with dependencies for the
> > version of Solr they chose.
> >
> > I'll take a look at this issue.
> >
> > 2023年10月20日(金) 9:50 Karl Wright:
> >
> >> This connector FranceLabs updated.  The problem seems to occur at a
> basic
> >> level during http2 communication, so I wonder if, once again, there's a
> >> problem with dependencies for the version of Solr they chose.
> >>
> >> Karl
> >>
> >>
> >> On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao >
> >> wrote:
> >>
> >>> About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO exception
> >>> during indexinghttp://test58.txt:
> >> frame_size_error/invalid_frame_length"
> >>> error is occurring on the ManifoldCF side.
> >>>
> >>> - command:
> >>> ```
> >>> manifoldcf/connectors/solr% ant run-IT-HSQLDB
> >>>
> >>> run-IT-HSQLDB:
> >>>  [junit] Testsuite:
> >>> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> >>> ... ...
> >>> ```
> >>>
> >>> - I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
> >>> ```
> >>>   WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception
> during
> >>> indexinghttp://test58.txt: frame_size_error/invalid_frame_length
> >>> java.io.IOException: frame_size_error/invalid_frame_length
> >>> at
> org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.parser.Parser$Listener$Wrapper.onConnectionFailure(Parser.java:414)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Connection$ParserListener.onConnectionFailure(HTTP2Connection.java:397)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.parser.BodyParser.notifyConnectionFailure(BodyParser.java:223)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.parser.BodyParser.connectionFailure(BodyParser.java:215)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >> org.eclipse.jetty.http2.parser.Parser.connectionFailure(Parser.java:209)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at org.eclipse.jetty.http2.parser.Parser.parseHeader(Parser.java:155)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at org.eclipse.jetty.http2.parser.Parser.parse(Parser.java:121)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.http2.HTTP2Connection$HTTP2Producer.produce(HTTP2Connection.java:261)
> >>> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> >>> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> >>> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> >>> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> >>> at
> >>>
> >>>
> >>
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-23 Thread Guylaine BASSETTE


Hi Karl and Mingchun,

Thanks for your work on the last few issues. I join you on this Solr 
testing problem.


That said, we've tested this new connector in our application, with a 
FileShare job and everything was OK.


I hope and think it's just a problem specific to the test. Missing 
updates or incompatible dependencies...


Le 20/10/2023 à 02:58, Mingchun Zhao a écrit :

Hi Karl, Thanks!


so I wonder if, once again, there's a problem with dependencies for the

version of Solr they chose.

I'll take a look at this issue.

2023年10月20日(金) 9:50 Karl Wright:


This connector FranceLabs updated.  The problem seems to occur at a basic
level during http2 communication, so I wonder if, once again, there's a
problem with dependencies for the version of Solr they chose.

Karl


On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao
wrote:


About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO exception
during indexinghttp://test58.txt:

frame_size_error/invalid_frame_length"

error is occurring on the ManifoldCF side.

- command:
```
manifoldcf/connectors/solr% ant run-IT-HSQLDB

run-IT-HSQLDB:
 [junit] Testsuite:
org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
... ...
```

- I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
```
  WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception during
indexinghttp://test58.txt: frame_size_error/invalid_frame_length
java.io.IOException: frame_size_error/invalid_frame_length
at org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.parser.Parser$Listener$Wrapper.onConnectionFailure(Parser.java:414)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Connection$ParserListener.onConnectionFailure(HTTP2Connection.java:397)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.parser.BodyParser.notifyConnectionFailure(BodyParser.java:223)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.parser.BodyParser.connectionFailure(BodyParser.java:215)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at

org.eclipse.jetty.http2.parser.Parser.connectionFailure(Parser.java:209)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.parser.Parser.parseHeader(Parser.java:155)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.parser.Parser.parse(Parser.java:121)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Connection$HTTP2Producer.produce(HTTP2Connection.java:261)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection.produce(HTTP2Connection.java:183)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Connection.onFillable(HTTP2Connection.java:138)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.http2.HTTP2Connection$FillableCallback.succeeded(HTTP2Connection.java:361)

~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.Invocable.invokeNonBlocking(Invocable.java:69)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at



org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.invokeTask(EatWhatYouKill.java:350)

~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-19 Thread Mingchun Zhao

Hi Karl, Thanks!

> so I wonder if, once again, there's a problem with dependencies for the
version of Solr they chose.

I'll take a look at this issue.

2023年10月20日(金) 9:50 Karl Wright :

> This connector FranceLabs updated.  The problem seems to occur at a basic
> level during http2 communication, so I wonder if, once again, there's a
> problem with dependencies for the version of Solr they chose.
>
> Karl
>
>
> On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao 
> wrote:
>
> > About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO exception
> > during indexing http://test58.txt:
> frame_size_error/invalid_frame_length"
> > error is occurring on the ManifoldCF side.
> >
> > - command:
> > ```
> > manifoldcf/connectors/solr% ant run-IT-HSQLDB
> >
> > run-IT-HSQLDB:
> > [junit] Testsuite:
> > org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> > ... ...
> > ```
> >
> > - I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
> > ```
> >  WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception during
> > indexing http://test58.txt: frame_size_error/invalid_frame_length
> > java.io.IOException: frame_size_error/invalid_frame_length
> > at org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.parser.Parser$Listener$Wrapper.onConnectionFailure(Parser.java:414)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Connection$ParserListener.onConnectionFailure(HTTP2Connection.java:397)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.parser.BodyParser.notifyConnectionFailure(BodyParser.java:223)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.parser.BodyParser.connectionFailure(BodyParser.java:215)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> org.eclipse.jetty.http2.parser.Parser.connectionFailure(Parser.java:209)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at org.eclipse.jetty.http2.parser.Parser.parseHeader(Parser.java:155)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at org.eclipse.jetty.http2.parser.Parser.parse(Parser.java:121)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Connection$HTTP2Producer.produce(HTTP2Connection.java:261)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> > org.eclipse.jetty.http2.HTTP2Connection.produce(HTTP2Connection.java:183)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Connection.onFillable(HTTP2Connection.java:138)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.http2.HTTP2Connection$FillableCallback.succeeded(HTTP2Connection.java:361)
> > ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
> > ~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
> > ~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.Invocable.invokeNonBlocking(Invocable.java:69)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> > at
> >
> >
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.invokeTask(EatWhatYouKill.java:350)
> > ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> >

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-19 Thread Karl Wright

This connector FranceLabs updated.  The problem seems to occur at a basic
level during http2 communication, so I wonder if, once again, there's a
problem with dependencies for the version of Solr they chose.

Karl


On Thu, Oct 19, 2023 at 8:32 PM Mingchun Zhao 
wrote:

> About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO exception
> during indexing http://test58.txt: frame_size_error/invalid_frame_length"
> error is occurring on the ManifoldCF side.
>
> - command:
> ```
> manifoldcf/connectors/solr% ant run-IT-HSQLDB
>
> run-IT-HSQLDB:
> [junit] Testsuite:
> org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
> ... ...
> ```
>
> - I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
> ```
>  WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception during
> indexing http://test58.txt: frame_size_error/invalid_frame_length
> java.io.IOException: frame_size_error/invalid_frame_length
> at org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.parser.Parser$Listener$Wrapper.onConnectionFailure(Parser.java:414)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Connection$ParserListener.onConnectionFailure(HTTP2Connection.java:397)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.parser.BodyParser.notifyConnectionFailure(BodyParser.java:223)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.parser.BodyParser.connectionFailure(BodyParser.java:215)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.http2.parser.Parser.connectionFailure(Parser.java:209)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.http2.parser.Parser.parseHeader(Parser.java:155)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.http2.parser.Parser.parse(Parser.java:121)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Connection$HTTP2Producer.produce(HTTP2Connection.java:261)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
> org.eclipse.jetty.http2.HTTP2Connection.produce(HTTP2Connection.java:183)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Connection.onFillable(HTTP2Connection.java:138)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.http2.HTTP2Connection$FillableCallback.succeeded(HTTP2Connection.java:361)
> ~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
> ~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
> at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
> ~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.Invocable.invokeNonBlocking(Invocable.java:69)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.invokeTask(EatWhatYouKill.java:350)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:305)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
> at
>
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> ~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-19 Thread Mingchun Zhao

About the test "SolrCrawlHSQLDBIT" failure, it seems that "IO exception
during indexing http://test58.txt: frame_size_error/invalid_frame_length"
error is occurring on the ManifoldCF side.

- command:
```
manifoldcf/connectors/solr% ant run-IT-HSQLDB

run-IT-HSQLDB:
[junit] Testsuite:
org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
... ...
```

- I checked "connectors/solr/test-HSQLDB-output/manifoldcf.log":
```
 WARN 2023-10-20T09:14:56,635 (Worker thread '18') - IO exception during
indexing http://test58.txt: frame_size_error/invalid_frame_length
java.io.IOException: frame_size_error/invalid_frame_length
at org.eclipse.jetty.http2.HTTP2Session.toFailure(HTTP2Session.java:566)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.HTTP2Session.access$2700(HTTP2Session.java:80)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Session$StreamsState.onSessionFailure(HTTP2Session.java:1857)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Session$StreamsState.access$400(HTTP2Session.java:1436)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Session.onSessionFailure(HTTP2Session.java:511)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Session.onConnectionFailure(HTTP2Session.java:506)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.parser.Parser$Listener$Wrapper.onConnectionFailure(Parser.java:414)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection$ParserListener.onConnectionFailure(HTTP2Connection.java:397)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.parser.BodyParser.notifyConnectionFailure(BodyParser.java:223)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.parser.BodyParser.connectionFailure(BodyParser.java:215)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.parser.Parser.connectionFailure(Parser.java:209)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.parser.Parser.parseHeader(Parser.java:155)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.http2.parser.Parser.parse(Parser.java:121)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection$HTTP2Producer.produce(HTTP2Connection.java:261)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection.produce(HTTP2Connection.java:183)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection.onFillable(HTTP2Connection.java:138)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.http2.HTTP2Connection$FillableCallback.succeeded(HTTP2Connection.java:361)
~[http2-common-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
~[jetty-io-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.Invocable.invokeNonBlocking(Invocable.java:69)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.invokeTask(EatWhatYouKill.java:350)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:305)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
~[jetty-util-9.4.48.v20220622.jar:9.4.48.v20220622]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:271)
~[solr-solrj-9.1.0.jar:9.1.0 aa4f3d98ab19c201e7f3c74cd14c99174148616d -
ishan - 2022-11-11 13:00:47]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
~[?:?]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
~[?:?]
at java.lang.Thread.run(Thread.java:829) ~[?:?]
```

2023年10月19日(木) 20:37 Mingchun Zhao :

> I'm having

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-19 Thread Mingchun Zhao

I'm having trouble with the Solr test `ant run-IT-HSQLDB`.
It's been over an hour since I ran the test and it still doesn't finish.
It seems that the problem is probably due to the Manifold job not finishing.
Do you have any ideas or advice? Thanks!

```
~/ManifoldCF/manifoldcf/connectors/solr% ant run-IT-HSQLDB
Buildfile:
/Users/zhaomingchun/ManifoldCF/manifoldcf/connectors/solr/build.xml

... ...
run-IT-HSQLDB:
[junit] Testsuite:
org.apache.manifoldcf.agents.output.solr.tests.SolrCrawlHSQLDBIT
[junit] Configuration file successfully read
[junit] [main] INFO org.eclipse.jetty.util.log - Logging initialized
@7416ms to org.eclipse.jetty.util.log.Slf4jLog
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 60ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@4bdc8b5d{ManifoldCF Crawler
Interface,/mcf-crawler-ui,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-crawler-ui_war-_mcf-crawler-ui-any-17189990303852051874/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-crawler-ui.war}
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@3bcd426c{ManifoldCF Authorities API
Webapp,/mcf-authority-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-authority-service_war-_mcf-authority-service-any-1541416273384984853/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-authority-service.war}
[junit] Creating mock service
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.w.WebAppContext@5f14a673{ManifoldCF General API
Webapp,/mcf-api-service,file:///private/var/folders/zh/mx4q_qh93cv6jtp13ht8b1frgn/T/jetty-0_0_0_0-8346-mcf-api-service_war-_mcf-api-service-any-12421572948842353797/webapp/,AVAILABLE}{/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/web/war/mcf-api-service.war}
[junit] Mock service created
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@70325d20{HTTP/1.1, (http/1.1)}{0.0.0.0:8346}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9616ms
[junit] [main] INFO org.eclipse.jetty.server.Server -
jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git:
6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 11.0.11+9
[junit] [main] INFO org.eclipse.jetty.server.session -
DefaultSessionIdManager workerName=node0
[junit] [main] INFO org.eclipse.jetty.server.session - No
SessionScavenger set, using defaults
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Scavenging
every 60ms
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Started o.e.j.s.ServletContextHandler@7808f638{/solr,null,AVAILABLE}
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Started ServerConnector@2ab5afc7{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.Server - Started @9626ms
[junit] [main] INFO org.eclipse.jetty.server.AbstractConnector -
Stopped ServerConnector@2ab5afc7{HTTP/1.1, (http/1.1)}{0.0.0.0:8188}
[junit] [main] INFO org.eclipse.jetty.server.session - node0 Stopped
scavenging
[junit] [main] INFO org.eclipse.jetty.server.handler.ContextHandler -
Stopped o.e.j.s.ServletContextHandler@7808f638{/solr,null,STOPPED}
```

2023年10月19日(木) 20:05 Mingchun Zhao :

> Hi Karl,
>
> I've tried to update Kafka and its dependencies to the latest version
> including zookeeper,
> and confirmed tha kafka test run-IT-HSQLDB passed as below:
>
> ```
> ~manifoldcf% cd connectors/kafka
> ~manifoldcf/connectors/kafka/% ant run-IT-HSQLDB
>
> BUILD SUCCESSFUL
> Total time: 1 minute 19 seconds
> ```
>
> Also, I prepared a PR for this issue:
> https://github.com/apache/manifoldcf/pull/155
>
> 2023年10月19日(木) 7:12 Karl Wright :
>
>> Hi,
>>
>> It looks like the latest release of Kafka is 3.6.0.
>>
>> I'd try setting that version in the pom for connectors/kafka and doing mvn
>> install.  Then you can see what dependencies it wants by:
>> mvn dependency:tree
>>
>> It may be that Kafka no longer even requires zookeeper - I didn't find it
>> in a cursory inspection. But the dependency:tree would be the final word.
>>
>> Karl
>>
>>
>> On Sat, Oct 14, 2023 at 2:17 AM Mingchun Zhao 
>> wrote:
>>
>> > Kalr, Thanks!
>> > Though I'm not familiar with kafka, I'll try to find out what's causing
>> the
>> > error as much as possible.
>> >
>> > Kind Regards,
>> > Mingchun
>> >
>> >
>> > 2023年10月14日(土) 14:07

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-19 Thread Mingchun Zhao

Hi Karl,

I've tried to update Kafka and its dependencies to the latest version
including zookeeper,
and confirmed tha kafka test run-IT-HSQLDB passed as below:

```
~manifoldcf% cd connectors/kafka
~manifoldcf/connectors/kafka/% ant run-IT-HSQLDB

BUILD SUCCESSFUL
Total time: 1 minute 19 seconds
```

Also, I prepared a PR for this issue:
https://github.com/apache/manifoldcf/pull/155

2023年10月19日(木) 7:12 Karl Wright :

> Hi,
>
> It looks like the latest release of Kafka is 3.6.0.
>
> I'd try setting that version in the pom for connectors/kafka and doing mvn
> install.  Then you can see what dependencies it wants by:
> mvn dependency:tree
>
> It may be that Kafka no longer even requires zookeeper - I didn't find it
> in a cursory inspection. But the dependency:tree would be the final word.
>
> Karl
>
>
> On Sat, Oct 14, 2023 at 2:17 AM Mingchun Zhao 
> wrote:
>
> > Kalr, Thanks!
> > Though I'm not familiar with kafka, I'll try to find out what's causing
> the
> > error as much as possible.
> >
> > Kind Regards,
> > Mingchun
> >
> >
> > 2023年10月14日(土) 14:07 Karl Wright :
> >
> > > Yes, this seems to be something related to zookeeper update and the
> Kafka
> > > library version we're using.
> > >
> > > Someone will need to dig into what is going wrong here before we can
> > > release.  I don't know how widely used the kafka connector is but if it
> > is
> > > lightly used we can perhaps not distribute the connector any longer.
> But
> > > that would be a last choice.
> > >
> > > Karl
> > >
> > >
> > > On Fri, Oct 13, 2023 at 12:12 PM Mingchun Zhao <
> > mingchun.zha...@gmail.com>
> > > wrote:
> > >
> > > > By applying r1912939, I was able to confirm that the kafka test
> compile
> > > > error has disappeared when running `ant test`.
> > > > Thanks, Karl!
> > > >
> > > > However, the following error occurred on subsequent test runs.
> > > > ```
> > > > [junit] Testsuite:
> > > > org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
> > > > [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> > > elapsed:
> > > > 0 sec
> > > > [junit]
> > > > [junit] Testcase:
> > > >
> > org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT:sanityCheck:
> > > >Caused an ERROR
> > > > [junit] Forked Java VM exited abnormally. Please note the time in
> > the
> > > > report does not reflect the time until the VM exit.
> > > > [junit] junit.framework.AssertionFailedError: Forked Java VM
> exited
> > > > abnormally. Please note the time in the report does not reflect the
> > time
> > > > until the VM exit.
> > > > [junit] at
> > > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > > [junit] at
> > > >
> > > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > [junit] at
> > > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > > [junit] at
> > > >
> > > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > [junit] at
> > > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > > [junit] at
> > > >
> > > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > [junit] at
> > > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > > [junit] at
> > > >
> > > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > [junit]
> > > > [junit]
> > > >
> > > > BUILD FAILED
> > > > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The
> following
> > > > error occurred while executing this line:
> > > > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The
> following
> > > > error occurred while executing this line:
> > > >
> > /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
> > > > Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
> failed
> > > > (crashed)
> > > > ```
> > > >
> > > >
> > > > 2023年10月13日(金) 21:56 Karl Wright :
> > > >
> > > > > r1912939 fixes this but I need to spin a new RC.
> > > > > Karl
> > > > >
> > > > >
> > > > > On Fri, Oct 13, 2023 at 8:46 AM Karl Wright 
> > > wrote:
> > > > >
> > > > > > Yes I get the same thing; a test needs to be updated.
> > > > > >
> > > > > > [javac]
> > > > > >
> > > > >
> > > >
> > >
> >
> C:\wip\mcf\release-2.26-branch\connectors\kafka\connector\src\test\java\org\apache\manifoldcf\agents\output\kafka\ZooKeeperLocal.java:45:
> > > > > > error: unreported exception AdminServerException; must be caught
> or
> > > > > > declared to be thrown
> > > > > > [javac]
>  zooKeeperServer.runFromConfig(configuration);
> > > > > > [javac]
> > > > > >
> > > > > > Karl
> > > > > >
> > > > > >
> > > > > > On Fri, Oct 13, 2023 at 8:35 AM Karl

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-18 Thread Karl Wright

Hi,

It looks like the latest release of Kafka is 3.6.0.

I'd try setting that version in the pom for connectors/kafka and doing mvn
install.  Then you can see what dependencies it wants by:
mvn dependency:tree

It may be that Kafka no longer even requires zookeeper - I didn't find it
in a cursory inspection. But the dependency:tree would be the final word.

Karl


On Sat, Oct 14, 2023 at 2:17 AM Mingchun Zhao 
wrote:

> Kalr, Thanks!
> Though I'm not familiar with kafka, I'll try to find out what's causing the
> error as much as possible.
>
> Kind Regards,
> Mingchun
>
>
> 2023年10月14日(土) 14:07 Karl Wright :
>
> > Yes, this seems to be something related to zookeeper update and the Kafka
> > library version we're using.
> >
> > Someone will need to dig into what is going wrong here before we can
> > release.  I don't know how widely used the kafka connector is but if it
> is
> > lightly used we can perhaps not distribute the connector any longer.  But
> > that would be a last choice.
> >
> > Karl
> >
> >
> > On Fri, Oct 13, 2023 at 12:12 PM Mingchun Zhao <
> mingchun.zha...@gmail.com>
> > wrote:
> >
> > > By applying r1912939, I was able to confirm that the kafka test compile
> > > error has disappeared when running `ant test`.
> > > Thanks, Karl!
> > >
> > > However, the following error occurred on subsequent test runs.
> > > ```
> > > [junit] Testsuite:
> > > org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
> > > [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> > elapsed:
> > > 0 sec
> > > [junit]
> > > [junit] Testcase:
> > >
> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT:sanityCheck:
> > >Caused an ERROR
> > > [junit] Forked Java VM exited abnormally. Please note the time in
> the
> > > report does not reflect the time until the VM exit.
> > > [junit] junit.framework.AssertionFailedError: Forked Java VM exited
> > > abnormally. Please note the time in the report does not reflect the
> time
> > > until the VM exit.
> > > [junit] at
> > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > [junit] at
> > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > [junit] at
> > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > [junit] at
> > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > [junit] at
> > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > [junit] at
> > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > [junit] at
> > > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > > [junit] at
> > >
> > >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > [junit]
> > > [junit]
> > >
> > > BUILD FAILED
> > > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
> > > error occurred while executing this line:
> > > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
> > > error occurred while executing this line:
> > >
> /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
> > > Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
> > > (crashed)
> > > ```
> > >
> > >
> > > 2023年10月13日(金) 21:56 Karl Wright :
> > >
> > > > r1912939 fixes this but I need to spin a new RC.
> > > > Karl
> > > >
> > > >
> > > > On Fri, Oct 13, 2023 at 8:46 AM Karl Wright 
> > wrote:
> > > >
> > > > > Yes I get the same thing; a test needs to be updated.
> > > > >
> > > > > [javac]
> > > > >
> > > >
> > >
> >
> C:\wip\mcf\release-2.26-branch\connectors\kafka\connector\src\test\java\org\apache\manifoldcf\agents\output\kafka\ZooKeeperLocal.java:45:
> > > > > error: unreported exception AdminServerException; must be caught or
> > > > > declared to be thrown
> > > > > [javac]   zooKeeperServer.runFromConfig(configuration);
> > > > > [javac]
> > > > >
> > > > > Karl
> > > > >
> > > > >
> > > > > On Fri, Oct 13, 2023 at 8:35 AM Karl Wright 
> > > wrote:
> > > > >
> > > > >> There was a Zookeeper dependency change this release.  I wonder if
> > > there
> > > > >> is a test that needs to be updated.  Let me try and see.
> > > > >>
> > > > >> Karl
> > > > >>
> > > > >>
> > > > >> On Fri, Oct 13, 2023 at 4:51 AM Piergiorgio Lucidi <
> > > > >> piergior...@apache.org> wrote:
> > > > >>
> > > > >>> Hi Mingchun,
> > > > >>>
> > > > >>> thank you for your message and I was trying to build ManifoldCF
> > using
> > > > >>> OpenJDK 17 so probably in the future for supporting this version
> of
> > > > Java
> > > > >>> we
> > > > >>> should include Jaxb libraries as well.
> > > > >>>
> > > > >>> The build is ok now and I can compile and

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-14 Thread Mingchun Zhao

Kalr, Thanks!
Though I'm not familiar with kafka, I'll try to find out what's causing the
error as much as possible.

Kind Regards,
Mingchun


2023年10月14日(土) 14:07 Karl Wright :

> Yes, this seems to be something related to zookeeper update and the Kafka
> library version we're using.
>
> Someone will need to dig into what is going wrong here before we can
> release.  I don't know how widely used the kafka connector is but if it is
> lightly used we can perhaps not distribute the connector any longer.  But
> that would be a last choice.
>
> Karl
>
>
> On Fri, Oct 13, 2023 at 12:12 PM Mingchun Zhao 
> wrote:
>
> > By applying r1912939, I was able to confirm that the kafka test compile
> > error has disappeared when running `ant test`.
> > Thanks, Karl!
> >
> > However, the following error occurred on subsequent test runs.
> > ```
> > [junit] Testsuite:
> > org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
> > [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> elapsed:
> > 0 sec
> > [junit]
> > [junit] Testcase:
> > org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT:sanityCheck:
> >Caused an ERROR
> > [junit] Forked Java VM exited abnormally. Please note the time in the
> > report does not reflect the time until the VM exit.
> > [junit] junit.framework.AssertionFailedError: Forked Java VM exited
> > abnormally. Please note the time in the report does not reflect the time
> > until the VM exit.
> > [junit] at
> > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > [junit] at
> >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [junit] at
> > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > [junit] at
> >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [junit] at
> > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > [junit] at
> >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [junit] at
> > jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> > [junit] at
> >
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [junit]
> > [junit]
> >
> > BUILD FAILED
> > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
> > error occurred while executing this line:
> > /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
> > error occurred while executing this line:
> > /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
> > Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
> > (crashed)
> > ```
> >
> >
> > 2023年10月13日(金) 21:56 Karl Wright :
> >
> > > r1912939 fixes this but I need to spin a new RC.
> > > Karl
> > >
> > >
> > > On Fri, Oct 13, 2023 at 8:46 AM Karl Wright 
> wrote:
> > >
> > > > Yes I get the same thing; a test needs to be updated.
> > > >
> > > > [javac]
> > > >
> > >
> >
> C:\wip\mcf\release-2.26-branch\connectors\kafka\connector\src\test\java\org\apache\manifoldcf\agents\output\kafka\ZooKeeperLocal.java:45:
> > > > error: unreported exception AdminServerException; must be caught or
> > > > declared to be thrown
> > > > [javac]   zooKeeperServer.runFromConfig(configuration);
> > > > [javac]
> > > >
> > > > Karl
> > > >
> > > >
> > > > On Fri, Oct 13, 2023 at 8:35 AM Karl Wright 
> > wrote:
> > > >
> > > >> There was a Zookeeper dependency change this release.  I wonder if
> > there
> > > >> is a test that needs to be updated.  Let me try and see.
> > > >>
> > > >> Karl
> > > >>
> > > >>
> > > >> On Fri, Oct 13, 2023 at 4:51 AM Piergiorgio Lucidi <
> > > >> piergior...@apache.org> wrote:
> > > >>
> > > >>> Hi Mingchun,
> > > >>>
> > > >>> thank you for your message and I was trying to build ManifoldCF
> using
> > > >>> OpenJDK 17 so probably in the future for supporting this version of
> > > Java
> > > >>> we
> > > >>> should include Jaxb libraries as well.
> > > >>>
> > > >>> The build is ok now and I can compile and package everything
> > correctly.
> > > >>> Unfortunately executing tests I have the following error:
> > > >>>
> > > >>> compile-tests:
> > > >>> [javac] Compiling 1 source file to
> > > >>>
> > > >>>
> > >
> >
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/build/connector-tests/classes
> > > >>> [javac]
> > > >>>
> > > >>>
> > >
> >
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/connector/src/test/java/org/apache/manifoldcf/agents/output/kafka/ZooKeeperLocal.java:45:
> > > >>> error: unreported exception AdminServerException; must be caught or
> > > >>> declared to be thrown
> > > >>> [javac]   zooKeeperServer.runFromConfig(configuration);

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-13 Thread Karl Wright

Yes, this seems to be something related to zookeeper update and the Kafka
library version we're using.

Someone will need to dig into what is going wrong here before we can
release.  I don't know how widely used the kafka connector is but if it is
lightly used we can perhaps not distribute the connector any longer.  But
that would be a last choice.

Karl


On Fri, Oct 13, 2023 at 12:12 PM Mingchun Zhao 
wrote:

> By applying r1912939, I was able to confirm that the kafka test compile
> error has disappeared when running `ant test`.
> Thanks, Karl!
>
> However, the following error occurred on subsequent test runs.
> ```
> [junit] Testsuite:
> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
> [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 0 sec
> [junit]
> [junit] Testcase:
> org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT:sanityCheck:
>Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the
> report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited
> abnormally. Please note the time in the report does not reflect the time
> until the VM exit.
> [junit] at
> jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at
> jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at
> jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at
> jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> [junit] at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit]
> [junit]
>
> BUILD FAILED
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
> error occurred while executing this line:
> /Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
> Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
> (crashed)
> ```
>
>
> 2023年10月13日(金) 21:56 Karl Wright :
>
> > r1912939 fixes this but I need to spin a new RC.
> > Karl
> >
> >
> > On Fri, Oct 13, 2023 at 8:46 AM Karl Wright  wrote:
> >
> > > Yes I get the same thing; a test needs to be updated.
> > >
> > > [javac]
> > >
> >
> C:\wip\mcf\release-2.26-branch\connectors\kafka\connector\src\test\java\org\apache\manifoldcf\agents\output\kafka\ZooKeeperLocal.java:45:
> > > error: unreported exception AdminServerException; must be caught or
> > > declared to be thrown
> > > [javac]   zooKeeperServer.runFromConfig(configuration);
> > > [javac]
> > >
> > > Karl
> > >
> > >
> > > On Fri, Oct 13, 2023 at 8:35 AM Karl Wright 
> wrote:
> > >
> > >> There was a Zookeeper dependency change this release.  I wonder if
> there
> > >> is a test that needs to be updated.  Let me try and see.
> > >>
> > >> Karl
> > >>
> > >>
> > >> On Fri, Oct 13, 2023 at 4:51 AM Piergiorgio Lucidi <
> > >> piergior...@apache.org> wrote:
> > >>
> > >>> Hi Mingchun,
> > >>>
> > >>> thank you for your message and I was trying to build ManifoldCF using
> > >>> OpenJDK 17 so probably in the future for supporting this version of
> > Java
> > >>> we
> > >>> should include Jaxb libraries as well.
> > >>>
> > >>> The build is ok now and I can compile and package everything
> correctly.
> > >>> Unfortunately executing tests I have the following error:
> > >>>
> > >>> compile-tests:
> > >>> [javac] Compiling 1 source file to
> > >>>
> > >>>
> >
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/build/connector-tests/classes
> > >>> [javac]
> > >>>
> > >>>
> >
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/connector/src/test/java/org/apache/manifoldcf/agents/output/kafka/ZooKeeperLocal.java:45:
> > >>> error: unreported exception AdminServerException; must be caught or
> > >>> declared to be thrown
> > >>> [javac]   zooKeeperServer.runFromConfig(configuration);
> > >>> [javac]^
> > >>> [javac] 1 error
> > >>>
> > >>> BUILD FAILED
> > >>>
> > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/build.xml:497:
> > >>> The following error occurred while executing this line:
> > >>>
> > /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/build.xml:471:
> > >>> The following error occurred while executing this line:
> > >>>
> > >>>
> >
>

Re: [CANCEL][VOTE] Release ManifoldCF 2.26, RC0

2023-10-13 Thread Mingchun Zhao

By applying r1912939, I was able to confirm that the kafka test compile
error has disappeared when running `ant test`.
Thanks, Karl!

However, the following error occurred on subsequent test runs.
```
[junit] Testsuite:
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT
[junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
0 sec
[junit]
[junit] Testcase:
org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT:sanityCheck:
   Caused an ERROR
[junit] Forked Java VM exited abnormally. Please note the time in the
report does not reflect the time until the VM exit.
[junit] junit.framework.AssertionFailedError: Forked Java VM exited
abnormally. Please note the time in the report does not reflect the time
until the VM exit.
[junit] at
jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at
jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at
jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at
jdk.internal.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
[junit] at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit]
[junit]

BUILD FAILED
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:517: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/build.xml:471: The following
error occurred while executing this line:
/Users/zhaomingchun/ManifoldCF/manifoldcf/dist/connector-build.xml:1102:
Test org.apache.manifoldcf.agents.output.kafka.APISanityHSQLDBIT failed
(crashed)
```

2023年10月13日(金) 21:56 Karl Wright :

> r1912939 fixes this but I need to spin a new RC.
> Karl
>
>
> On Fri, Oct 13, 2023 at 8:46 AM Karl Wright  wrote:
>
> > Yes I get the same thing; a test needs to be updated.
> >
> > [javac]
> >
> C:\wip\mcf\release-2.26-branch\connectors\kafka\connector\src\test\java\org\apache\manifoldcf\agents\output\kafka\ZooKeeperLocal.java:45:
> > error: unreported exception AdminServerException; must be caught or
> > declared to be thrown
> > [javac]   zooKeeperServer.runFromConfig(configuration);
> > [javac]
> >
> > Karl
> >
> >
> > On Fri, Oct 13, 2023 at 8:35 AM Karl Wright  wrote:
> >
> >> There was a Zookeeper dependency change this release.  I wonder if there
> >> is a test that needs to be updated.  Let me try and see.
> >>
> >> Karl
> >>
> >>
> >> On Fri, Oct 13, 2023 at 4:51 AM Piergiorgio Lucidi <
> >> piergior...@apache.org> wrote:
> >>
> >>> Hi Mingchun,
> >>>
> >>> thank you for your message and I was trying to build ManifoldCF using
> >>> OpenJDK 17 so probably in the future for supporting this version of
> Java
> >>> we
> >>> should include Jaxb libraries as well.
> >>>
> >>> The build is ok now and I can compile and package everything correctly.
> >>> Unfortunately executing tests I have the following error:
> >>>
> >>> compile-tests:
> >>> [javac] Compiling 1 source file to
> >>>
> >>>
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/build/connector-tests/classes
> >>> [javac]
> >>>
> >>>
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/connectors/kafka/connector/src/test/java/org/apache/manifoldcf/agents/output/kafka/ZooKeeperLocal.java:45:
> >>> error: unreported exception AdminServerException; must be caught or
> >>> declared to be thrown
> >>> [javac]   zooKeeperServer.runFromConfig(configuration);
> >>> [javac]^
> >>> [javac] 1 error
> >>>
> >>> BUILD FAILED
> >>>
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/build.xml:497:
> >>> The following error occurred while executing this line:
> >>>
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/build.xml:471:
> >>> The following error occurred while executing this line:
> >>>
> >>>
> /Users/piergiorgiolucidi/Downloads/apache-manifoldcf-2.26/dist/connector-build.xml:720:
> >>> Compile failed; see the compiler error output for details.
> >>>
> >>> Any ideas?
> >>>
> >>> Thanks.
> >>>
> >>> Cheers,
> >>> PG
> >>>
> >>>
> >>>
> >>> Il giorno gio 12 ott 2023 alle ore 10:39 Mingchun Zhao <
> >>> mingchun.zha...@gmail.com> ha scritto:
> >>>
> >>> > Hi Piergiorgio,
> >>> >
> >>> > FYI, Allow me to share the java and ant versions and the build steps
> I
> >>> ran
> >>> > in my environment.
> >>> >
> >>> > ```
> >>> > $ java --version
> >>> > openjdk 11.0.11 2021-04-20
> >>> > OpenJDK Runtime Environment AdoptOpenJDK-11.0.11+9 (build 11.0.11+9)
> >>> >

46 matches

Mail list logo