Re: Solr 9.x output connector
Hi Julien, Sorry for the delay; I've been under intense pressure at work of late and just saw this email now. Regarding library updates: we should generally go ahead and do those FIRST. There are custom fixes for httpclient checked into the ManifoldCF code base so we may need to work a little to get those to build properly. But I'm reasonably sure it can be done. Libraries are backwards compatible at the minor version level so all is good there. When somebody wants to go to HttpClient 5, though, we are in trouble. AFTER that is done we should evaluate whether the 9.x Solr library is backwards compatible enough with 8.x to work. We had to do very little to go from 7.x to 8.x, so unless the Solr people suddenly changed their philosophy dramatically, it should be possible to do this too. But we will see. Karl On Tue, Nov 29, 2022 at 9:59 AM Julien Massiera < julien.massi...@francelabs.com> wrote: > Hi Karl, > > the Solr output connector does not seem to work with Solr 9.x according > to our tests. We are going to either update or develop a new connector > but there is a problem concerning the libraries required. A solr 9.x > connector will of course involve a solrj 9.x lib but also the update of > the following libs in MCF: > > - zookeeper from 3.4.10 to >= 3.7.0 (current 3.8.0) > - httpcomponent.httpclient.version from 4.5.3 to 4.5.13 > - httpcomponent.httpcore.version from 4.4.6 to 4.4.15 > - httpcomponent.httpmime.version from 4.5.3 to 4.5.13 > > Those updates should not cause problems to other connectors in MCF, the > real problem here concerns the current Solr connector as I am not sure > that an updated version would be compatible with a Solr < 9.x. > There is also the modified solr clients using the custom multi-parts > http post methods that will cause some troubles to be ported on Solrj 9 > .x according to me. > > If I am not wrong, historically those custom clients were developed to > avoid errors with the embedded Tika of Solr for some documents. But > IMHO, it has become a challenge that is not worth the effort: the way to > go should be to have the documents processed by Tika BEFORE the Solr > indexation. Not to mention that the tika embedded in Solr is too old > (1.28.1) and will most certainly be removed someday (as stated in this > tickethttps://issues.apache.org/jira/browse/SOLR-13973). Thus, I think > it is not worth it to port the custom solr clients in the new connector. > This would ease the creation of the Solr 9 output connector. > > Whatever happens, if we want to maintain output connectors for different > versions of Solr, and IF the Solr 9 output connector is not compatible > with previous versions of Solr (still needs to be checked), we'll end up > with several versions of the libs in ManifoldCF. To be honest, I do not > see a proper way to deal with the libs conflicts between the two > connectors... > > What do you think ? > > Regards, > Julien >
Solr 9.x output connector
Hi Karl, the Solr output connector does not seem to work with Solr 9.x according to our tests. We are going to either update or develop a new connector but there is a problem concerning the libraries required. A solr 9.x connector will of course involve a solrj 9.x lib but also the update of the following libs in MCF: - zookeeper from 3.4.10 to >= 3.7.0 (current 3.8.0) - httpcomponent.httpclient.version from 4.5.3 to 4.5.13 - httpcomponent.httpcore.version from 4.4.6 to 4.4.15 - httpcomponent.httpmime.version from 4.5.3 to 4.5.13 Those updates should not cause problems to other connectors in MCF, the real problem here concerns the current Solr connector as I am not sure that an updated version would be compatible with a Solr < 9.x. There is also the modified solr clients using the custom multi-parts http post methods that will cause some troubles to be ported on Solrj 9 .x according to me. If I am not wrong, historically those custom clients were developed to avoid errors with the embedded Tika of Solr for some documents. But IMHO, it has become a challenge that is not worth the effort: the way to go should be to have the documents processed by Tika BEFORE the Solr indexation. Not to mention that the tika embedded in Solr is too old (1.28.1) and will most certainly be removed someday (as stated in this tickethttps://issues.apache.org/jira/browse/SOLR-13973). Thus, I think it is not worth it to port the custom solr clients in the new connector. This would ease the creation of the Solr 9 output connector. Whatever happens, if we want to maintain output connectors for different versions of Solr, and IF the Solr 9 output connector is not compatible with previous versions of Solr (still needs to be checked), we'll end up with several versions of the libs in ManifoldCF. To be honest, I do not see a proper way to deal with the libs conflicts between the two connectors... What do you think ? Regards, Julien
[GitHub] [manifoldcf] asfgit closed pull request #140: Bump jackson-databind from 2.3.2 to 2.12.7.1 in /connectors/slack
asfgit closed pull request #140: Bump jackson-databind from 2.3.2 to 2.12.7.1 in /connectors/slack URL: https://github.com/apache/manifoldcf/pull/140 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@manifoldcf.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [manifoldcf] dependabot[bot] commented on pull request #141: Bump jackson-databind from 2.6.1 to 2.12.7.1 in /connectors/amazoncloudsearch
dependabot[bot] commented on PR #141: URL: https://github.com/apache/manifoldcf/pull/141#issuecomment-1330721554 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@manifoldcf.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [manifoldcf] dependabot[bot] commented on pull request #140: Bump jackson-databind from 2.3.2 to 2.12.7.1 in /connectors/slack
dependabot[bot] commented on PR #140: URL: https://github.com/apache/manifoldcf/pull/140#issuecomment-1330721608 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@manifoldcf.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [manifoldcf] asfgit closed pull request #139: Bump jackson-databind from 2.3.2 to 2.12.7.1 in /connectors/rocketchat
asfgit closed pull request #139: Bump jackson-databind from 2.3.2 to 2.12.7.1 in /connectors/rocketchat URL: https://github.com/apache/manifoldcf/pull/139 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@manifoldcf.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [manifoldcf] asfgit closed pull request #141: Bump jackson-databind from 2.6.1 to 2.12.7.1 in /connectors/amazoncloudsearch
asfgit closed pull request #141: Bump jackson-databind from 2.6.1 to 2.12.7.1 in /connectors/amazoncloudsearch URL: https://github.com/apache/manifoldcf/pull/141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@manifoldcf.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
