Re: Clustering error in Solr 8.2.0
For lingo3g, they have replaced commons-lang with commons-lang3 in version 1.16, which should be in line with what Solr has done. Just that our lingo3g licence does not allow us to upgrade to the new version 1.16, and if we stick to the older version 1.15.1, it requires the use of commons-lang. Regards, Edwin On Tue, 13 Aug 2019 at 13:16, Jörn Franke wrote: > Depends if they do breaking changes in common-lang or not. > > By using an old version of a library such as common-lang you may introduce > security issues in your setup. > > > Am 13.08.2019 um 06:12 schrieb Zheng Lin Edwin Yeo >: > > > > I have found that the Lingo3GClusteringAlgorithm will work if I copied > > the commons-lang-2.6.jar from the previous version to > > solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib. > > > > Will this work in the long run? Because our lingo3g licence is not > eligible > > to download the latest version of 1.16, so we are currently stuck with > the > > older version 1.15.1, which still uses commons-lang dependency. > > > > Regards, > > Edwin > > > > On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo > > wrote: > > > >> Hi Kevin, > >> > >> Thanks for the info. > >> > >> I think should be lingo3g problem. The problem occurs when I use > >> Lingo3GClusteringAlgorithm. > >> >> > name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm > >> > >> If I change back to LingoClusteringAlgorithm, it will work. > >> >> > name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm > >> > >> Regards, > >> Edwin > >> > >>> On Fri, 9 Aug 2019 at 10:59, Kevin Risden wrote: > >>> > >>> According to the stack trace: > >>> > >>> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils > >>>at lingo3g.s.hashCode(Unknown Source) > >>> > >>> It looks like lingo3g - lingo3g isn't on Maven central and looks like > it > >>> requires a license to download. You would have to contact them to see > if > >>> it > >>> still uses commons-lang. You could also copy in commons-lang > dependency. > >>> > >>> Kevin Risden > >>> > >>> > >>> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo < > edwinye...@gmail.com > > >>> wrote: > >>> > Hi Erick, > > Thanks for your reply. > > My clustering code is taken as it is from the Solr package, only the > >>> codes > related to lingo3g is taken from previous version. > > Below are the 3 files that I have taken from previous version: > - lingo3g-1.15.0 > - morfologik-fsa-2.1.1 > - morfologik-stemming-2.1.1 > > Does anyone of these could have caused the error? > > Regards, > Edwin > > On Thu, 8 Aug 2019 at 19:56, Erick Erickson > wrote: > > > This dependency was removed as part of > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is > >>> you’re > > pointing to an old version of the clustering code. > > > > Best, > > Erick > > > >> On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo < > >>> edwinye...@gmail.com> > > wrote: > >> > >> ObjectUtils > > > > > > >>> > >> >
Re: Clustering error in Solr 8.2.0
Depends if they do breaking changes in common-lang or not. By using an old version of a library such as common-lang you may introduce security issues in your setup. > Am 13.08.2019 um 06:12 schrieb Zheng Lin Edwin Yeo : > > I have found that the Lingo3GClusteringAlgorithm will work if I copied > the commons-lang-2.6.jar from the previous version to > solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib. > > Will this work in the long run? Because our lingo3g licence is not eligible > to download the latest version of 1.16, so we are currently stuck with the > older version 1.15.1, which still uses commons-lang dependency. > > Regards, > Edwin > > On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo > wrote: > >> Hi Kevin, >> >> Thanks for the info. >> >> I think should be lingo3g problem. The problem occurs when I use >> Lingo3GClusteringAlgorithm. >> > name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm >> >> If I change back to LingoClusteringAlgorithm, it will work. >> > name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm >> >> Regards, >> Edwin >> >>> On Fri, 9 Aug 2019 at 10:59, Kevin Risden wrote: >>> >>> According to the stack trace: >>> >>> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils >>>at lingo3g.s.hashCode(Unknown Source) >>> >>> It looks like lingo3g - lingo3g isn't on Maven central and looks like it >>> requires a license to download. You would have to contact them to see if >>> it >>> still uses commons-lang. You could also copy in commons-lang dependency. >>> >>> Kevin Risden >>> >>> >>> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo >>> >>> wrote: >>> Hi Erick, Thanks for your reply. My clustering code is taken as it is from the Solr package, only the >>> codes related to lingo3g is taken from previous version. Below are the 3 files that I have taken from previous version: - lingo3g-1.15.0 - morfologik-fsa-2.1.1 - morfologik-stemming-2.1.1 Does anyone of these could have caused the error? Regards, Edwin On Thu, 8 Aug 2019 at 19:56, Erick Erickson wrote: > This dependency was removed as part of > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is >>> you’re > pointing to an old version of the clustering code. > > Best, > Erick > >> On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo < >>> edwinye...@gmail.com> > wrote: >> >> ObjectUtils > > >>> >>
Re: Clustering error in Solr 8.2.0
I have found that the Lingo3GClusteringAlgorithm will work if I copied the commons-lang-2.6.jar from the previous version to solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib. Will this work in the long run? Because our lingo3g licence is not eligible to download the latest version of 1.16, so we are currently stuck with the older version 1.15.1, which still uses commons-lang dependency. Regards, Edwin On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo wrote: > Hi Kevin, > > Thanks for the info. > > I think should be lingo3g problem. The problem occurs when I use > Lingo3GClusteringAlgorithm. > name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm > > If I change back to LingoClusteringAlgorithm, it will work. > name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm > > Regards, > Edwin > > On Fri, 9 Aug 2019 at 10:59, Kevin Risden wrote: > >> According to the stack trace: >> >> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils >> at lingo3g.s.hashCode(Unknown Source) >> >> It looks like lingo3g - lingo3g isn't on Maven central and looks like it >> requires a license to download. You would have to contact them to see if >> it >> still uses commons-lang. You could also copy in commons-lang dependency. >> >> Kevin Risden >> >> >> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo > > >> wrote: >> >> > Hi Erick, >> > >> > Thanks for your reply. >> > >> > My clustering code is taken as it is from the Solr package, only the >> codes >> > related to lingo3g is taken from previous version. >> > >> > Below are the 3 files that I have taken from previous version: >> > - lingo3g-1.15.0 >> > - morfologik-fsa-2.1.1 >> > - morfologik-stemming-2.1.1 >> > >> > Does anyone of these could have caused the error? >> > >> > Regards, >> > Edwin >> > >> > On Thu, 8 Aug 2019 at 19:56, Erick Erickson >> > wrote: >> > >> > > This dependency was removed as part of >> > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is >> you’re >> > > pointing to an old version of the clustering code. >> > > >> > > Best, >> > > Erick >> > > >> > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo < >> edwinye...@gmail.com> >> > > wrote: >> > > > >> > > > ObjectUtils >> > > >> > > >> > >> >
Re: Clustering error in Solr 8.2.0
Hi Kevin, Thanks for the info. I think should be lingo3g problem. The problem occurs when I use Lingo3GClusteringAlgorithm. com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm If I change back to LingoClusteringAlgorithm, it will work. org.carrot2.clustering.lingo.LingoClusteringAlgorithm Regards, Edwin On Fri, 9 Aug 2019 at 10:59, Kevin Risden wrote: > According to the stack trace: > > java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils > at lingo3g.s.hashCode(Unknown Source) > > It looks like lingo3g - lingo3g isn't on Maven central and looks like it > requires a license to download. You would have to contact them to see if it > still uses commons-lang. You could also copy in commons-lang dependency. > > Kevin Risden > > > On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo > wrote: > > > Hi Erick, > > > > Thanks for your reply. > > > > My clustering code is taken as it is from the Solr package, only the > codes > > related to lingo3g is taken from previous version. > > > > Below are the 3 files that I have taken from previous version: > > - lingo3g-1.15.0 > > - morfologik-fsa-2.1.1 > > - morfologik-stemming-2.1.1 > > > > Does anyone of these could have caused the error? > > > > Regards, > > Edwin > > > > On Thu, 8 Aug 2019 at 19:56, Erick Erickson > > wrote: > > > > > This dependency was removed as part of > > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re > > > pointing to an old version of the clustering code. > > > > > > Best, > > > Erick > > > > > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo < > edwinye...@gmail.com> > > > wrote: > > > > > > > > ObjectUtils > > > > > > > > >
Re: Clustering error in Solr 8.2.0
According to the stack trace: java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils at lingo3g.s.hashCode(Unknown Source) It looks like lingo3g - lingo3g isn't on Maven central and looks like it requires a license to download. You would have to contact them to see if it still uses commons-lang. You could also copy in commons-lang dependency. Kevin Risden On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo wrote: > Hi Erick, > > Thanks for your reply. > > My clustering code is taken as it is from the Solr package, only the codes > related to lingo3g is taken from previous version. > > Below are the 3 files that I have taken from previous version: > - lingo3g-1.15.0 > - morfologik-fsa-2.1.1 > - morfologik-stemming-2.1.1 > > Does anyone of these could have caused the error? > > Regards, > Edwin > > On Thu, 8 Aug 2019 at 19:56, Erick Erickson > wrote: > > > This dependency was removed as part of > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re > > pointing to an old version of the clustering code. > > > > Best, > > Erick > > > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo > > wrote: > > > > > > ObjectUtils > > > > >
Re: Clustering error in Solr 8.2.0
Hi Erick, Thanks for your reply. My clustering code is taken as it is from the Solr package, only the codes related to lingo3g is taken from previous version. Below are the 3 files that I have taken from previous version: - lingo3g-1.15.0 - morfologik-fsa-2.1.1 - morfologik-stemming-2.1.1 Does anyone of these could have caused the error? Regards, Edwin On Thu, 8 Aug 2019 at 19:56, Erick Erickson wrote: > This dependency was removed as part of > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re > pointing to an old version of the clustering code. > > Best, > Erick > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo > wrote: > > > > ObjectUtils > >
Re: Clustering error in Solr 8.2.0
This dependency was removed as part of https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re pointing to an old version of the clustering code. Best, Erick > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo wrote: > > ObjectUtils
Clustering error in Solr 8.2.0
Hi, I am currently working on the upgrade from Solr 7.7.1 to Solr 8.2.0. For the clustering, I am using lingo3g. There was no error in the earlier version, but I am getting this error in Solr 8.2.0, even though the configurations are the same. This is my configuration for clustering in solrconfig.xml: lingo com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm clustering/carrot2 stc org.carrot2.clustering.stc.STCClusteringAlgorithm kmeans org.carrot2.clustering.kmeans.BisectingKMeansClusteringAlgorithm none 150 json true text null true true default id subject resourcename content true 200 3 20 true 20 clustering This is the error I am getting: HTTP ERROR 500 Problem accessing /edm/calls/clustering. Reason: Server Error Caused by: java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils at lingo3g.s.hashCode(Unknown Source) at org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:848) at org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:901) at org.apache.commons.lang3.builder.HashCodeBuilder.appendArray(HashCodeBuilder.java:883) at org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:846) at org.apache.commons.lang3.ArrayUtils.hashCode(ArrayUtils.java:192) at org.carrot2.util.resource.ResourceLookup.hashCode(ResourceLookup.java:201) at java.util.HashMap.hash(Unknown Source) at java.util.HashMap.get(Unknown Source) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown Source) at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.init(Unknown Source) at org.carrot2.core.ControllerUtils.init(ControllerUtils.java:52) at org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:189) at org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:170) at org.carrot2.util.pool.SoftUnboundedPool.borrowObject(SoftUnboundedPool.java:83) at org.carrot2.core.PoolingProcessingComponentManager.prepare(PoolingProcessingComponentManager.java:129) at org.carrot2.core.Controller.process(Controller.java:342) at org.carrot2.core.Controller.process(Controller.java:247) at org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.lambda$cluster$2(CarrotClusteringEngine.java:241) at org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.withContextClassLoader(CarrotClusteringEngine.java:557) at org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:240) at org.apache.solr.handler.clustering.ClusteringComponent.process(ClusteringComponent.java:237) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:305) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199) at org.apache.solr.core.SolrCore.execute(SolrCore.java:2578) at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:780) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:423) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:350) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHan