Re: Clustering error in Solr 8.2.0

2019-08-13 Thread Zheng Lin Edwin Yeo
For lingo3g, they have replaced commons-lang with commons-lang3 in version
1.16, which should be in line with what Solr has done.

Just that our lingo3g licence does not allow us to upgrade to the new
version 1.16, and if we stick to the older version 1.15.1, it requires the
use of commons-lang.

Regards,
Edwin



On Tue, 13 Aug 2019 at 13:16, Jörn Franke  wrote:

> Depends if they do breaking changes in common-lang or not.
>
> By using an old version of a library such as common-lang you may introduce
> security issues in your setup.
>
> > Am 13.08.2019 um 06:12 schrieb Zheng Lin Edwin Yeo  >:
> >
> > I have found that the  Lingo3GClusteringAlgorithm  will work if I copied
> > the commons-lang-2.6.jar from the previous version to
> > solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib.
> >
> > Will this work in the long run? Because our lingo3g licence is not
> eligible
> > to download the latest version of 1.16, so we are currently stuck with
> the
> > older version 1.15.1, which still uses commons-lang dependency.
> >
> > Regards,
> > Edwin
> >
> > On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo 
> > wrote:
> >
> >> Hi Kevin,
> >>
> >> Thanks for the info.
> >>
> >> I think should be lingo3g problem.  The problem occurs when I use
> >> Lingo3GClusteringAlgorithm.
> >>  >>
> name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm
> >>
> >> If I change back to LingoClusteringAlgorithm, it will work.
> >>  >>
> name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm
> >>
> >> Regards,
> >> Edwin
> >>
> >>> On Fri, 9 Aug 2019 at 10:59, Kevin Risden  wrote:
> >>>
> >>> According to the stack trace:
> >>>
> >>> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
> >>>at lingo3g.s.hashCode(Unknown Source)
> >>>
> >>> It looks like lingo3g - lingo3g isn't on Maven central and looks like
> it
> >>> requires a license to download. You would have to contact them to see
> if
> >>> it
> >>> still uses commons-lang. You could also copy in commons-lang
> dependency.
> >>>
> >>> Kevin Risden
> >>>
> >>>
> >>> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo <
> edwinye...@gmail.com
> 
> >>> wrote:
> >>>
>  Hi Erick,
> 
>  Thanks for your reply.
> 
>  My clustering code is taken as it is from the Solr package, only the
> >>> codes
>  related to lingo3g is taken from previous version.
> 
>  Below are the 3 files that I have taken from previous version:
>  - lingo3g-1.15.0
>  - morfologik-fsa-2.1.1
>  - morfologik-stemming-2.1.1
> 
>  Does anyone of these could have caused the error?
> 
>  Regards,
>  Edwin
> 
>  On Thu, 8 Aug 2019 at 19:56, Erick Erickson 
>  wrote:
> 
> > This dependency was removed as part of
> > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is
> >>> you’re
> > pointing to an old version of the clustering code.
> >
> > Best,
> > Erick
> >
> >> On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo <
> >>> edwinye...@gmail.com>
> > wrote:
> >>
> >> ObjectUtils
> >
> >
> 
> >>>
> >>
>


Re: Clustering error in Solr 8.2.0

2019-08-12 Thread Jörn Franke
Depends if they do breaking changes in common-lang or not.

By using an old version of a library such as common-lang you may introduce 
security issues in your setup.

> Am 13.08.2019 um 06:12 schrieb Zheng Lin Edwin Yeo :
> 
> I have found that the  Lingo3GClusteringAlgorithm  will work if I copied
> the commons-lang-2.6.jar from the previous version to
> solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib.
> 
> Will this work in the long run? Because our lingo3g licence is not eligible
> to download the latest version of 1.16, so we are currently stuck with the
> older version 1.15.1, which still uses commons-lang dependency.
> 
> Regards,
> Edwin
> 
> On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo 
> wrote:
> 
>> Hi Kevin,
>> 
>> Thanks for the info.
>> 
>> I think should be lingo3g problem.  The problem occurs when I use
>> Lingo3GClusteringAlgorithm.
>> > name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm
>> 
>> If I change back to LingoClusteringAlgorithm, it will work.
>> > name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm
>> 
>> Regards,
>> Edwin
>> 
>>> On Fri, 9 Aug 2019 at 10:59, Kevin Risden  wrote:
>>> 
>>> According to the stack trace:
>>> 
>>> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
>>>at lingo3g.s.hashCode(Unknown Source)
>>> 
>>> It looks like lingo3g - lingo3g isn't on Maven central and looks like it
>>> requires a license to download. You would have to contact them to see if
>>> it
>>> still uses commons-lang. You could also copy in commons-lang dependency.
>>> 
>>> Kevin Risden
>>> 
>>> 
>>> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo >>> 
>>> wrote:
>>> 
 Hi Erick,
 
 Thanks for your reply.
 
 My clustering code is taken as it is from the Solr package, only the
>>> codes
 related to lingo3g is taken from previous version.
 
 Below are the 3 files that I have taken from previous version:
 - lingo3g-1.15.0
 - morfologik-fsa-2.1.1
 - morfologik-stemming-2.1.1
 
 Does anyone of these could have caused the error?
 
 Regards,
 Edwin
 
 On Thu, 8 Aug 2019 at 19:56, Erick Erickson 
 wrote:
 
> This dependency was removed as part of
> https://issues.apache.org/jira/browse/SOLR-9079, so my guess is
>>> you’re
> pointing to an old version of the clustering code.
> 
> Best,
> Erick
> 
>> On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo <
>>> edwinye...@gmail.com>
> wrote:
>> 
>> ObjectUtils
> 
> 
 
>>> 
>> 


Re: Clustering error in Solr 8.2.0

2019-08-12 Thread Zheng Lin Edwin Yeo
I have found that the  Lingo3GClusteringAlgorithm  will work if I copied
the commons-lang-2.6.jar from the previous version to
solr-8.2.0\server\solr-webapp\webapp\WEB-INF\lib.

Will this work in the long run? Because our lingo3g licence is not eligible
to download the latest version of 1.16, so we are currently stuck with the
older version 1.15.1, which still uses commons-lang dependency.

Regards,
Edwin

On Tue, 13 Aug 2019 at 00:14, Zheng Lin Edwin Yeo 
wrote:

> Hi Kevin,
>
> Thanks for the info.
>
> I think should be lingo3g problem.  The problem occurs when I use
> Lingo3GClusteringAlgorithm.
>  name="carrot.algorithm">com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm
>
> If I change back to LingoClusteringAlgorithm, it will work.
>  name="carrot.algorithm">org.carrot2.clustering.lingo.LingoClusteringAlgorithm
>
> Regards,
> Edwin
>
> On Fri, 9 Aug 2019 at 10:59, Kevin Risden  wrote:
>
>> According to the stack trace:
>>
>> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
>> at lingo3g.s.hashCode(Unknown Source)
>>
>> It looks like lingo3g - lingo3g isn't on Maven central and looks like it
>> requires a license to download. You would have to contact them to see if
>> it
>> still uses commons-lang. You could also copy in commons-lang dependency.
>>
>> Kevin Risden
>>
>>
>> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo > >
>> wrote:
>>
>> > Hi Erick,
>> >
>> > Thanks for your reply.
>> >
>> > My clustering code is taken as it is from the Solr package, only the
>> codes
>> > related to lingo3g is taken from previous version.
>> >
>> > Below are the 3 files that I have taken from previous version:
>> > - lingo3g-1.15.0
>> > - morfologik-fsa-2.1.1
>> > - morfologik-stemming-2.1.1
>> >
>> > Does anyone of these could have caused the error?
>> >
>> > Regards,
>> > Edwin
>> >
>> > On Thu, 8 Aug 2019 at 19:56, Erick Erickson 
>> > wrote:
>> >
>> > > This dependency was removed as part of
>> > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is
>> you’re
>> > > pointing to an old version of the clustering code.
>> > >
>> > > Best,
>> > > Erick
>> > >
>> > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo <
>> edwinye...@gmail.com>
>> > > wrote:
>> > > >
>> > > > ObjectUtils
>> > >
>> > >
>> >
>>
>


Re: Clustering error in Solr 8.2.0

2019-08-12 Thread Zheng Lin Edwin Yeo
Hi Kevin,

Thanks for the info.

I think should be lingo3g problem.  The problem occurs when I use
Lingo3GClusteringAlgorithm.
com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm

If I change back to LingoClusteringAlgorithm, it will work.
org.carrot2.clustering.lingo.LingoClusteringAlgorithm

Regards,
Edwin

On Fri, 9 Aug 2019 at 10:59, Kevin Risden  wrote:

> According to the stack trace:
>
> java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
> at lingo3g.s.hashCode(Unknown Source)
>
> It looks like lingo3g - lingo3g isn't on Maven central and looks like it
> requires a license to download. You would have to contact them to see if it
> still uses commons-lang. You could also copy in commons-lang dependency.
>
> Kevin Risden
>
>
> On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo 
> wrote:
>
> > Hi Erick,
> >
> > Thanks for your reply.
> >
> > My clustering code is taken as it is from the Solr package, only the
> codes
> > related to lingo3g is taken from previous version.
> >
> > Below are the 3 files that I have taken from previous version:
> > - lingo3g-1.15.0
> > - morfologik-fsa-2.1.1
> > - morfologik-stemming-2.1.1
> >
> > Does anyone of these could have caused the error?
> >
> > Regards,
> > Edwin
> >
> > On Thu, 8 Aug 2019 at 19:56, Erick Erickson 
> > wrote:
> >
> > > This dependency was removed as part of
> > > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re
> > > pointing to an old version of the clustering code.
> > >
> > > Best,
> > > Erick
> > >
> > > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo <
> edwinye...@gmail.com>
> > > wrote:
> > > >
> > > > ObjectUtils
> > >
> > >
> >
>


Re: Clustering error in Solr 8.2.0

2019-08-08 Thread Kevin Risden
According to the stack trace:

java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
at lingo3g.s.hashCode(Unknown Source)

It looks like lingo3g - lingo3g isn't on Maven central and looks like it
requires a license to download. You would have to contact them to see if it
still uses commons-lang. You could also copy in commons-lang dependency.

Kevin Risden


On Thu, Aug 8, 2019 at 10:23 PM Zheng Lin Edwin Yeo 
wrote:

> Hi Erick,
>
> Thanks for your reply.
>
> My clustering code is taken as it is from the Solr package, only the codes
> related to lingo3g is taken from previous version.
>
> Below are the 3 files that I have taken from previous version:
> - lingo3g-1.15.0
> - morfologik-fsa-2.1.1
> - morfologik-stemming-2.1.1
>
> Does anyone of these could have caused the error?
>
> Regards,
> Edwin
>
> On Thu, 8 Aug 2019 at 19:56, Erick Erickson 
> wrote:
>
> > This dependency was removed as part of
> > https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re
> > pointing to an old version of the clustering code.
> >
> > Best,
> > Erick
> >
> > > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo 
> > wrote:
> > >
> > > ObjectUtils
> >
> >
>


Re: Clustering error in Solr 8.2.0

2019-08-08 Thread Zheng Lin Edwin Yeo
Hi Erick,

Thanks for your reply.

My clustering code is taken as it is from the Solr package, only the codes
related to lingo3g is taken from previous version.

Below are the 3 files that I have taken from previous version:
- lingo3g-1.15.0
- morfologik-fsa-2.1.1
- morfologik-stemming-2.1.1

Does anyone of these could have caused the error?

Regards,
Edwin

On Thu, 8 Aug 2019 at 19:56, Erick Erickson  wrote:

> This dependency was removed as part of
> https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re
> pointing to an old version of the clustering code.
>
> Best,
> Erick
>
> > On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo 
> wrote:
> >
> > ObjectUtils
>
>


Re: Clustering error in Solr 8.2.0

2019-08-08 Thread Erick Erickson
This dependency was removed as part of 
https://issues.apache.org/jira/browse/SOLR-9079, so my guess is you’re pointing 
to an old version of the clustering code.

Best,
Erick

> On Aug 8, 2019, at 4:22 AM, Zheng Lin Edwin Yeo  wrote:
> 
> ObjectUtils



Clustering error in Solr 8.2.0

2019-08-08 Thread Zheng Lin Edwin Yeo
Hi,

I am currently working on the upgrade from Solr 7.7.1 to Solr 8.2.0.

For the clustering, I am using lingo3g. There was no error in the earlier
version, but I am getting this error in Solr 8.2.0, even though the
configurations are the same.

This is my configuration for clustering in solrconfig.xml:

  

  lingo
 com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm

  clustering/carrot2




  stc
  org.carrot2.clustering.stc.STCClusteringAlgorithm




  kmeans
  org.carrot2.clustering.kmeans.BisectingKMeansClusteringAlgorithm

  

  


   none
  150
   json
   true
  text
  null

  true
  true
 default

 id
  
 subject
  
  resourcename
  
 content
  
  true

 200

 
 3
  
  20
  
  true
 20



  clustering

  


This is the error I am getting:

HTTP ERROR 500

Problem accessing /edm/calls/clustering. Reason:

Server Error

Caused by:

java.lang.NoClassDefFoundError: org/apache/commons/lang/ObjectUtils
at lingo3g.s.hashCode(Unknown Source)
at 
org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:848)
at 
org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:901)
at 
org.apache.commons.lang3.builder.HashCodeBuilder.appendArray(HashCodeBuilder.java:883)
at 
org.apache.commons.lang3.builder.HashCodeBuilder.append(HashCodeBuilder.java:846)
at org.apache.commons.lang3.ArrayUtils.hashCode(ArrayUtils.java:192)
at 
org.carrot2.util.resource.ResourceLookup.hashCode(ResourceLookup.java:201)
at java.util.HashMap.hash(Unknown Source)
at java.util.HashMap.get(Unknown Source)
at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.a(Unknown Source)
at com.carrotsearch.lingo3g.Lingo3GClusteringAlgorithm.init(Unknown 
Source)
at org.carrot2.core.ControllerUtils.init(ControllerUtils.java:52)
at 
org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:189)
at 
org.carrot2.core.PoolingProcessingComponentManager$ComponentInstantiationListener.objectInstantiated(PoolingProcessingComponentManager.java:170)
at 
org.carrot2.util.pool.SoftUnboundedPool.borrowObject(SoftUnboundedPool.java:83)
at 
org.carrot2.core.PoolingProcessingComponentManager.prepare(PoolingProcessingComponentManager.java:129)
at org.carrot2.core.Controller.process(Controller.java:342)
at org.carrot2.core.Controller.process(Controller.java:247)
at 
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.lambda$cluster$2(CarrotClusteringEngine.java:241)
at 
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.withContextClassLoader(CarrotClusteringEngine.java:557)
at 
org.apache.solr.handler.clustering.carrot2.CarrotClusteringEngine.cluster(CarrotClusteringEngine.java:240)
at 
org.apache.solr.handler.clustering.ClusteringComponent.process(ClusteringComponent.java:237)
at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:305)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2578)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:780)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:423)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:350)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
at 
org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
at 
org.eclipse.jetty.server.handler.ContextHan