Re: Apache Solr 8.11.1 and Log4J Vulnerability

[Shawn Heisey]

On 4/14/2022 7:18 PM, Shawn Heisey wrote:

https://paste.elyograg.org/view/ed0f1b1e

The required steps are found in the first 33 lines.  The remaining 
43000 lines is the whole build.


To be very specific, the commands I did are on lines 1, 9, 10, 14, 32, 
and 33.

Re: Dismax query parser and wildcards

[Jeremy Buckley - IQ-C]

I was using dismax because these are subqueries of a potentially complex
boolean query that I don't want to inherit all the edismax defaults from
the request handler. I need edismax at the top level for boost.  But I
guess I should figure out how to get edismax to work in the subqueries (I
need mm, so lucene is not an option).

On Thu, Apr 14, 2022 at 9:23 PM Walter Underwood 
wrote:

> I kind of doubt that anyone cares what dismax does. It has been eleven
> years since edismax was introduced. Unless someone must have backwards
> compatibility, nobody should use dismax. It probably should be deprecated.
>
> wunder
> Walter Underwood
> wun...@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
>

Re: Dismax query parser and wildcards

[Walter Underwood]

I kind of doubt that anyone cares what dismax does. It has been eleven years 
since edismax was introduced. Unless someone must have backwards compatibility, 
nobody should use dismax. It probably should be deprecated.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Apr 14, 2022, at 6:12 PM, Jeremy Buckley - IQ-C 
>  wrote:
> 
> qt=/select
> 
> {!lucene df=mpno v='fo4a*'}  returns lots of results
> {!dismax df=mpno v='fo4a*'}  returns *zero *results
> {!edismax df=mpno v='fo4a*'}  returns lots of results
> 
> What is wrong with dismax?

Re: Dismax query parser and wildcards

[Shawn Heisey]

On 4/14/2022 7:12 PM, Jeremy Buckley - IQ-C wrote:

qt=/select

{!lucene df=mpno v='fo4a*'}  returns lots of results
{!dismax df=mpno v='fo4a*'}  returns *zero *results
{!edismax df=mpno v='fo4a*'}  returns lots of results

What is wrong with dismax?



The dismax parser doesn't do everything.  Which is why edismax exists.

The edismax parser does everything dismax can, but also understands most 
of what the lucene parser does.  Think of it as a blend of lucene and 
dismax.


Thanks,
Shawn

Re: Apache Solr 8.11.1 and Log4J Vulnerability

[Shawn Heisey]

On 4/14/2022 6:14 PM, Shawn Heisey wrote:
If you need to check a compliance box saying you dealt with a 
nonexistent vulnerability, just replace the jars as I already said. 


If you want to get really adventurous, you could clone the git repo, 
check out branch_8_11, and build it yourself.  That build would include 
log4j 2.17.1.


Here's a transcript of a full build session on Ubuntu Linux:

https://paste.elyograg.org/view/ed0f1b1e

The required steps are found in the first 33 lines.  The remaining 43000 
lines is the whole build.


You will need Ant and a Java JDK.  I know that openjdk-8 and openjdk-11 
work.  The build will likely not work on Windows.  Some kind of *NIX 
will probably be required.


On RPM-based distros like RHEL and CentOS, you'll probably have problems 
with the packaged ant.  I know how to fix those if you need it.


If you follow those instructions and the build succeeds, the package 
files will be the following, relative to the top level of the git 
clone.  These work exactly like what you can download from 
solr.apache.org, except most everything has "-SNAPSHOT" in the filenames:


solr/package/solr-8.11.2-SNAPSHOT.tgz
solr/package/solr-8.11.2-SNAPSHOT.zip

Thanks,
Shawn

Dismax query parser and wildcards

[Jeremy Buckley - IQ-C]

qt=/select

{!lucene df=mpno v='fo4a*'}  returns lots of results
{!dismax df=mpno v='fo4a*'}  returns *zero *results
{!edismax df=mpno v='fo4a*'}  returns lots of results

What is wrong with dismax?

Re: Apache Solr 8.11.1 and Log4J Vulnerability

[Shawn Heisey]

On 4/14/2022 11:59 AM, Tate, Justina (DTMB) wrote:

Can you please explain how we can go about upgrading Log4J to greater than 
2.16.0.


Just replace the jars in the Solr install directory with newer versions 
obtained directly from the log4j project.


But there's no need.  Solr is not vulnerable to the problems fixed in 
log4j 2.17.


https://solr.apache.org/security.html#apache-solr-affected-by-apache-log4j-cve-2021-44228

If you need to check a compliance box saying you dealt with a 
nonexistent vulnerability, just replace the jars as I already said.


Thanks,
Shawn

Re: SOLR TF/IDF factor removal.

[Andy Webb]

hi Fiz,

I think the BooleanSimilarityFactory is what you're looking for here - see
https://solr.apache.org/guide/8_11/other-schema-elements.html#similarity
and
https://solr.apache.org/docs/8_11_1/solr-core/index.html?org/apache/solr/search/similarities/BooleanSimilarityFactory.html


(I added this in https://issues.apache.org/jira/browse/SOLR-13751 but
haven't found a concrete use case for it yet other than for training
purposes - would be interested to know if it's useful to you!)

Andy


On Thu, 14 Apr 2022 at 13:52, Fiz N  wrote:

> Hello Experts,
>
> In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> server box.
>
> We have implemented a search mechanism by using pure keyword match and
> boosting the keywords as per business needs. For each search result, match
> percentage is derived using the obtained SOLR document score. The SOLR
> document score is the summation of individual keyword scores which is
> derived by using boost factor and TF/IDF values of the keyword.
>
> As per requirements, in our case the resultant scores should be dependent
> only on the boost factor, whereas the implicit TF/IDF factor is causing
> deviation in the expected results and also causing uncertainty in the
> resultant ranking.
>
> So we are looking for better approaches to eliminate/neutralize the SOLR
> TF/IDF factor.
>
> Please do let us know your suggestions in removal of TF/IDF factor or any
> other solution approach that we can consider in this case.
>
> Thanks
> Fiz Fareedh.
>

Apache Solr 8.11.1 and Log4J Vulnerability

[Tate, Justina (DTMB)]

Hello,

Can you please explain how we can go about upgrading Log4J to greater than 
2.16.0.

Thank you,
Justina Tate , MBA
Senior IT Business Analyst
Michigan Department of Technology, Management & Budget Agency Services 
supporting Attorney General and MSHDA
201 N. Washington Square, Ste. 900, Lansing, MI 48933
Office:  (517) 241-2926
Email:  tat...@michigan.gov
LEGAL NOTICE:
This e-mail is for the exclusive use of the intended recipient(s), and may 
contain privileged and confidential information. Any unauthorized review, use, 
disclosure or duplication of this email is expressly prohibited. If you are not 
an intended recipient, please notify the sender immediately, delete the e-mail 
from your computer, and do not copy or disclose it to anyone else. Your receipt 
of this message is not intended to waive any applicable legal privilege, and 
does not constitute an electronic signature or provide consent to contract 
electronically.

can somebody unsubscribe this auto-responder *please*: cau-rep...@uca.es

[dmitri maziuk]

On 2022-04-14 10:21 AM, cau-rep...@uca.es wrote:


No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU:

   http://cau.uca.es/


Agredeciendo su colaboración.

 Saludos


Aplicación CAU
http://cau.uca.es/



No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU:

   http://cau.uca.es/


Agredeciendo su colaboración.

 Saludos


Aplicación CAU
http://cau.uca.es/

Re: Upgrading log4j from v2.16.0 to 2.17.0

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
--- End Message ---

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---

On 4/14/22 03:47, Kunal Tidake wrote:

We have upgraded solr to v8.11.1 which includes log4j v2.16.0. We want to 
upgrade log4j to v2.17.1. So is it possible to upgrade log4j from v2.16.0 to 
v2.17.0 , Please let us know.


Yes.  Just replace all the log4j jars with newer ones.

We are not releasing a new 8.11.x version with updated logj4.  Due to 
the way that the library is used, Solr is not vulnerable to the problems 
fixed by log4j 2.17, at least not with the default logging configuration.


Likely you are using a security scanner that just blindly checks jar 
versions, and has no way to know that in a certain context, there is no 
vulnerability.


Thanks,
Shawn

--- End Message ---

Re: Upgrading log4j from v2.16.0 to 2.17.0

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---

On 4/14/22 03:47, Kunal Tidake wrote:

We have upgraded solr to v8.11.1 which includes log4j v2.16.0. We want to 
upgrade log4j to v2.17.1. So is it possible to upgrade log4j from v2.16.0 to 
v2.17.0 , Please let us know.


Yes.  Just replace all the log4j jars with newer ones.

We are not releasing a new 8.11.x version with updated logj4.  Due to 
the way that the library is used, Solr is not vulnerable to the problems 
fixed by log4j 2.17, at least not with the default logging configuration.


Likely you are using a security scanner that just blindly checks jar 
versions, and has no way to know that in a certain context, there is no 
vulnerability.


Thanks,
Shawn

--- End Message ---

Re: SOLR TF/IDF factor removal.

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
You can tweak the parameters of BM25 similarity:
https://solr.apache.org/docs/8_1_1/solr-core/org/apache/solr/search/similarities/BM25SimilarityFactory.html

IIRC, the similarity becomes a constant with k1 = 0.


0


Thomas

Op do 14 apr. 2022 om 15:51 schreef Vincenzo D'Amore :

> https://github.com/freedev/solr-constant-similarity
>
> this is just an implementation of what Markus was suggesting.
>
> Could be a good idea adding a constant similarity class into the solr
> standard distribution.
>
> On Thu, Apr 14, 2022 at 3:48 PM Vincenzo D'Amore 
> wrote:
>
> > Hi,
> >
> > long time ago I wrote this, just trying to handle cases where there is no
> > need TF/IDF
> >
> > https://github.com/freedev/solr-constant-similarity
> >
> > There just two simple steps to follow:
> >
> >1. Add this line in solrconfig.xml:
> >
> > 
> >
> >1. And add this line into schema.xml:
> >
> >  > class="it.damore.solr.similarity.ConstantTFSimilarity">
> >
> >
> > <
> https://github.com/freedev/solr-constant-similarity#old-solr-versions-before-54
> >
> >
> > On Thu, Apr 14, 2022 at 3:30 PM Jeremy Buckley - IQ-C
> >  wrote:
> >
> >> You may be interested in the ^= modifier for queries.  From the
> reference
> >> guide:
> >>
> >> Constant Score with "^="
> >>
> >> Constant score queries are created with ^=, which
> >> sets
> >> the entire clause to the specified score for any documents matching that
> >> clause. This is desirable when you only care about matches for a
> >> particular
> >> clause and don’t want other relevancy factors such as term frequency
> (the
> >> number of times the term appears in the field) or inverse document
> >> frequency (a measure across the whole index for how rare a term is in a
> >> field).
> >>
> >> Example:
> >>
> >> (description:blue OR color:blue)^=1.0 text:shoes
> >>
> >>
> >> On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:
> >>
> >> > Hello Experts,
> >> >
> >> > In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> >> > server box.
> >> >
> >> > We have implemented a search mechanism by using pure keyword match and
> >> > boosting the keywords as per business needs. For each search result,
> >> match
> >> > percentage is derived using the obtained SOLR document score. The SOLR
> >> > document score is the summation of individual keyword scores which is
> >> > derived by using boost factor and TF/IDF values of the keyword.
> >> >
> >> > As per requirements, in our case the resultant scores should be
> >> dependent
> >> > only on the boost factor, whereas the implicit TF/IDF factor is
> causing
> >> > deviation in the expected results and also causing uncertainty in the
> >> > resultant ranking.
> >> >
> >> > So we are looking for better approaches to eliminate/neutralize the
> SOLR
> >> > TF/IDF factor.
> >> >
> >> > Please do let us know your suggestions in removal of TF/IDF factor or
> >> any
> >> > other solution approach that we can consider in this case.
> >> >
> >> > Thanks
> >> > Fiz Fareedh.
> >> >
> >>
> >
> >
> > --
> > Vincenzo D'Amore
> >
> >
>
> --
> Vincenzo D'Amore
>
--- End Message ---

Re: Upgrading log4j from v2.16.0 to 2.17.0

[Shawn Heisey]

On 4/14/22 03:47, Kunal Tidake wrote:

We have upgraded solr to v8.11.1 which includes log4j v2.16.0. We want to 
upgrade log4j to v2.17.1. So is it possible to upgrade log4j from v2.16.0 to 
v2.17.0 , Please let us know.


Yes.  Just replace all the log4j jars with newer ones.

We are not releasing a new 8.11.x version with updated logj4.  Due to 
the way that the library is used, Solr is not vulnerable to the problems 
fixed by log4j 2.17, at least not with the default logging configuration.


Likely you are using a security scanner that just blindly checks jar 
versions, and has no way to know that in a certain context, there is no 
vulnerability.


Thanks,
Shawn

Re: SOLR TF/IDF factor removal.

[Thomas Corthals]

You can tweak the parameters of BM25 similarity:
https://solr.apache.org/docs/8_1_1/solr-core/org/apache/solr/search/similarities/BM25SimilarityFactory.html

IIRC, the similarity becomes a constant with k1 = 0.


0


Thomas

Op do 14 apr. 2022 om 15:51 schreef Vincenzo D'Amore :

> https://github.com/freedev/solr-constant-similarity
>
> this is just an implementation of what Markus was suggesting.
>
> Could be a good idea adding a constant similarity class into the solr
> standard distribution.
>
> On Thu, Apr 14, 2022 at 3:48 PM Vincenzo D'Amore 
> wrote:
>
> > Hi,
> >
> > long time ago I wrote this, just trying to handle cases where there is no
> > need TF/IDF
> >
> > https://github.com/freedev/solr-constant-similarity
> >
> > There just two simple steps to follow:
> >
> >1. Add this line in solrconfig.xml:
> >
> > 
> >
> >1. And add this line into schema.xml:
> >
> >  > class="it.damore.solr.similarity.ConstantTFSimilarity">
> >
> >
> > <
> https://github.com/freedev/solr-constant-similarity#old-solr-versions-before-54
> >
> >
> > On Thu, Apr 14, 2022 at 3:30 PM Jeremy Buckley - IQ-C
> >  wrote:
> >
> >> You may be interested in the ^= modifier for queries.  From the
> reference
> >> guide:
> >>
> >> Constant Score with "^="
> >>
> >> Constant score queries are created with ^=, which
> >> sets
> >> the entire clause to the specified score for any documents matching that
> >> clause. This is desirable when you only care about matches for a
> >> particular
> >> clause and don’t want other relevancy factors such as term frequency
> (the
> >> number of times the term appears in the field) or inverse document
> >> frequency (a measure across the whole index for how rare a term is in a
> >> field).
> >>
> >> Example:
> >>
> >> (description:blue OR color:blue)^=1.0 text:shoes
> >>
> >>
> >> On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:
> >>
> >> > Hello Experts,
> >> >
> >> > In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> >> > server box.
> >> >
> >> > We have implemented a search mechanism by using pure keyword match and
> >> > boosting the keywords as per business needs. For each search result,
> >> match
> >> > percentage is derived using the obtained SOLR document score. The SOLR
> >> > document score is the summation of individual keyword scores which is
> >> > derived by using boost factor and TF/IDF values of the keyword.
> >> >
> >> > As per requirements, in our case the resultant scores should be
> >> dependent
> >> > only on the boost factor, whereas the implicit TF/IDF factor is
> causing
> >> > deviation in the expected results and also causing uncertainty in the
> >> > resultant ranking.
> >> >
> >> > So we are looking for better approaches to eliminate/neutralize the
> SOLR
> >> > TF/IDF factor.
> >> >
> >> > Please do let us know your suggestions in removal of TF/IDF factor or
> >> any
> >> > other solution approach that we can consider in this case.
> >> >
> >> > Thanks
> >> > Fiz Fareedh.
> >> >
> >>
> >
> >
> > --
> > Vincenzo D'Amore
> >
> >
>
> --
> Vincenzo D'Amore
>

Re: SOLR TF/IDF factor removal.

[Vincenzo D'Amore]

https://github.com/freedev/solr-constant-similarity

this is just an implementation of what Markus was suggesting.

Could be a good idea adding a constant similarity class into the solr
standard distribution.

On Thu, Apr 14, 2022 at 3:48 PM Vincenzo D'Amore  wrote:

> Hi,
>
> long time ago I wrote this, just trying to handle cases where there is no
> need TF/IDF
>
> https://github.com/freedev/solr-constant-similarity
>
> There just two simple steps to follow:
>
>1. Add this line in solrconfig.xml:
>
> 
>
>1. And add this line into schema.xml:
>
>  class="it.damore.solr.similarity.ConstantTFSimilarity">
>
>
> 
>
> On Thu, Apr 14, 2022 at 3:30 PM Jeremy Buckley - IQ-C
>  wrote:
>
>> You may be interested in the ^= modifier for queries.  From the reference
>> guide:
>>
>> Constant Score with "^="
>>
>> Constant score queries are created with ^=, which
>> sets
>> the entire clause to the specified score for any documents matching that
>> clause. This is desirable when you only care about matches for a
>> particular
>> clause and don’t want other relevancy factors such as term frequency (the
>> number of times the term appears in the field) or inverse document
>> frequency (a measure across the whole index for how rare a term is in a
>> field).
>>
>> Example:
>>
>> (description:blue OR color:blue)^=1.0 text:shoes
>>
>>
>> On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:
>>
>> > Hello Experts,
>> >
>> > In our project we are using SOLR 8.11.1 in Standalone mode in Windows
>> > server box.
>> >
>> > We have implemented a search mechanism by using pure keyword match and
>> > boosting the keywords as per business needs. For each search result,
>> match
>> > percentage is derived using the obtained SOLR document score. The SOLR
>> > document score is the summation of individual keyword scores which is
>> > derived by using boost factor and TF/IDF values of the keyword.
>> >
>> > As per requirements, in our case the resultant scores should be
>> dependent
>> > only on the boost factor, whereas the implicit TF/IDF factor is causing
>> > deviation in the expected results and also causing uncertainty in the
>> > resultant ranking.
>> >
>> > So we are looking for better approaches to eliminate/neutralize the SOLR
>> > TF/IDF factor.
>> >
>> > Please do let us know your suggestions in removal of TF/IDF factor or
>> any
>> > other solution approach that we can consider in this case.
>> >
>> > Thanks
>> > Fiz Fareedh.
>> >
>>
>
>
> --
> Vincenzo D'Amore
>
>

-- 
Vincenzo D'Amore

Re: SOLR TF/IDF factor removal.

[Vincenzo D'Amore]

Hi,

long time ago I wrote this, just trying to handle cases where there is no
need TF/IDF

https://github.com/freedev/solr-constant-similarity

There just two simple steps to follow:

   1. Add this line in solrconfig.xml:



   1. And add this line into schema.xml:





On Thu, Apr 14, 2022 at 3:30 PM Jeremy Buckley - IQ-C
 wrote:

> You may be interested in the ^= modifier for queries.  From the reference
> guide:
>
> Constant Score with "^="
>
> Constant score queries are created with ^=, which sets
> the entire clause to the specified score for any documents matching that
> clause. This is desirable when you only care about matches for a particular
> clause and don’t want other relevancy factors such as term frequency (the
> number of times the term appears in the field) or inverse document
> frequency (a measure across the whole index for how rare a term is in a
> field).
>
> Example:
>
> (description:blue OR color:blue)^=1.0 text:shoes
>
>
> On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:
>
> > Hello Experts,
> >
> > In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> > server box.
> >
> > We have implemented a search mechanism by using pure keyword match and
> > boosting the keywords as per business needs. For each search result,
> match
> > percentage is derived using the obtained SOLR document score. The SOLR
> > document score is the summation of individual keyword scores which is
> > derived by using boost factor and TF/IDF values of the keyword.
> >
> > As per requirements, in our case the resultant scores should be dependent
> > only on the boost factor, whereas the implicit TF/IDF factor is causing
> > deviation in the expected results and also causing uncertainty in the
> > resultant ranking.
> >
> > So we are looking for better approaches to eliminate/neutralize the SOLR
> > TF/IDF factor.
> >
> > Please do let us know your suggestions in removal of TF/IDF factor or any
> > other solution approach that we can consider in this case.
> >
> > Thanks
> > Fiz Fareedh.
> >
>


-- 
Vincenzo D'Amore

Re: SOLR TF/IDF factor removal.

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
You may be interested in the ^= modifier for queries.  From the reference
guide:

Constant Score with "^="

Constant score queries are created with ^=, which sets
the entire clause to the specified score for any documents matching that
clause. This is desirable when you only care about matches for a particular
clause and don’t want other relevancy factors such as term frequency (the
number of times the term appears in the field) or inverse document
frequency (a measure across the whole index for how rare a term is in a
field).

Example:

(description:blue OR color:blue)^=1.0 text:shoes


On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:

> Hello Experts,
>
> In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> server box.
>
> We have implemented a search mechanism by using pure keyword match and
> boosting the keywords as per business needs. For each search result, match
> percentage is derived using the obtained SOLR document score. The SOLR
> document score is the summation of individual keyword scores which is
> derived by using boost factor and TF/IDF values of the keyword.
>
> As per requirements, in our case the resultant scores should be dependent
> only on the boost factor, whereas the implicit TF/IDF factor is causing
> deviation in the expected results and also causing uncertainty in the
> resultant ranking.
>
> So we are looking for better approaches to eliminate/neutralize the SOLR
> TF/IDF factor.
>
> Please do let us know your suggestions in removal of TF/IDF factor or any
> other solution approach that we can consider in this case.
>
> Thanks
> Fiz Fareedh.
>
--- End Message ---

Re: SOLR TF/IDF factor removal.

[Jeremy Buckley - IQ-C]

You may be interested in the ^= modifier for queries.  From the reference
guide:

Constant Score with "^="

Constant score queries are created with ^=, which sets
the entire clause to the specified score for any documents matching that
clause. This is desirable when you only care about matches for a particular
clause and don’t want other relevancy factors such as term frequency (the
number of times the term appears in the field) or inverse document
frequency (a measure across the whole index for how rare a term is in a
field).

Example:

(description:blue OR color:blue)^=1.0 text:shoes


On Thu, Apr 14, 2022 at 8:52 AM Fiz N  wrote:

> Hello Experts,
>
> In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> server box.
>
> We have implemented a search mechanism by using pure keyword match and
> boosting the keywords as per business needs. For each search result, match
> percentage is derived using the obtained SOLR document score. The SOLR
> document score is the summation of individual keyword scores which is
> derived by using boost factor and TF/IDF values of the keyword.
>
> As per requirements, in our case the resultant scores should be dependent
> only on the boost factor, whereas the implicit TF/IDF factor is causing
> deviation in the expected results and also causing uncertainty in the
> resultant ranking.
>
> So we are looking for better approaches to eliminate/neutralize the SOLR
> TF/IDF factor.
>
> Please do let us know your suggestions in removal of TF/IDF factor or any
> other solution approach that we can consider in this case.
>
> Thanks
> Fiz Fareedh.
>

Re: SOLR TF/IDF factor removal.

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
Hello Fiz,

Are you sure you are using TF*IDF? It is no longer the default function in
Solr 8. Anyway, if you do, you can implement a custom TFIDFSimilarity [1]
and return just 1.0 for the idf() and tf() functions.

Regards,
Markus

[1]
https://lucene.apache.org/core/8_0_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html

Op do 14 apr. 2022 om 14:52 schreef Fiz N :

> Hello Experts,
>
> In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> server box.
>
> We have implemented a search mechanism by using pure keyword match and
> boosting the keywords as per business needs. For each search result, match
> percentage is derived using the obtained SOLR document score. The SOLR
> document score is the summation of individual keyword scores which is
> derived by using boost factor and TF/IDF values of the keyword.
>
> As per requirements, in our case the resultant scores should be dependent
> only on the boost factor, whereas the implicit TF/IDF factor is causing
> deviation in the expected results and also causing uncertainty in the
> resultant ranking.
>
> So we are looking for better approaches to eliminate/neutralize the SOLR
> TF/IDF factor.
>
> Please do let us know your suggestions in removal of TF/IDF factor or any
> other solution approach that we can consider in this case.
>
> Thanks
> Fiz Fareedh.
>
--- End Message ---

Re: SOLR TF/IDF factor removal.

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
Hello Experts,

In our project we are using SOLR 8.11.1 in Standalone mode in Windows
server box.

We have implemented a search mechanism by using pure keyword match and
boosting the keywords as per business needs. For each search result, match
percentage is derived using the obtained SOLR document score. The SOLR
document score is the summation of individual keyword scores which is
derived by using boost factor and TF/IDF values of the keyword.

As per requirements, in our case the resultant scores should be dependent
only on the boost factor, whereas the implicit TF/IDF factor is causing
deviation in the expected results and also causing uncertainty in the
resultant ranking.

So we are looking for better approaches to eliminate/neutralize the SOLR
TF/IDF factor.

Please do let us know your suggestions in removal of TF/IDF factor or any
other solution approach that we can consider in this case.

Thanks
Fiz Fareedh.
--- End Message ---

Re: SOLR TF/IDF factor removal.

[Markus Jelsma]

Hello Fiz,

Are you sure you are using TF*IDF? It is no longer the default function in
Solr 8. Anyway, if you do, you can implement a custom TFIDFSimilarity [1]
and return just 1.0 for the idf() and tf() functions.

Regards,
Markus

[1]
https://lucene.apache.org/core/8_0_0/core/org/apache/lucene/search/similarities/TFIDFSimilarity.html

Op do 14 apr. 2022 om 14:52 schreef Fiz N :

> Hello Experts,
>
> In our project we are using SOLR 8.11.1 in Standalone mode in Windows
> server box.
>
> We have implemented a search mechanism by using pure keyword match and
> boosting the keywords as per business needs. For each search result, match
> percentage is derived using the obtained SOLR document score. The SOLR
> document score is the summation of individual keyword scores which is
> derived by using boost factor and TF/IDF values of the keyword.
>
> As per requirements, in our case the resultant scores should be dependent
> only on the boost factor, whereas the implicit TF/IDF factor is causing
> deviation in the expected results and also causing uncertainty in the
> resultant ranking.
>
> So we are looking for better approaches to eliminate/neutralize the SOLR
> TF/IDF factor.
>
> Please do let us know your suggestions in removal of TF/IDF factor or any
> other solution approach that we can consider in this case.
>
> Thanks
> Fiz Fareedh.
>

SOLR TF/IDF factor removal.

[Fiz N]

Hello Experts,

In our project we are using SOLR 8.11.1 in Standalone mode in Windows
server box.

We have implemented a search mechanism by using pure keyword match and
boosting the keywords as per business needs. For each search result, match
percentage is derived using the obtained SOLR document score. The SOLR
document score is the summation of individual keyword scores which is
derived by using boost factor and TF/IDF values of the keyword.

As per requirements, in our case the resultant scores should be dependent
only on the boost factor, whereas the implicit TF/IDF factor is causing
deviation in the expected results and also causing uncertainty in the
resultant ranking.

So we are looking for better approaches to eliminate/neutralize the SOLR
TF/IDF factor.

Please do let us know your suggestions in removal of TF/IDF factor or any
other solution approach that we can consider in this case.

Thanks
Fiz Fareedh.

Re: Looking for online tutorials setting up SolrCloud replication with Solr 8.11.1

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
Here is a local demo of three node Solr + three node ZK via Docker Compose…..   
Not quite what you are looking for…. 

https://github.com/querqy/chorus/blob/main/docker-compose.yml#L58 


Look at Quickstart.sh.



> On Apr 14, 2022, at 7:01 AM, cau-rep...@uca.es wrote:
> 
> 
> No es posible recibir su consulta por este medio. Para que nos llegue 
> correctamente debe usar la aplicación CAU: 
> 
>  http://cau.uca.es/
> 
> 
> Agredeciendo su colaboración.
> 
>Saludos
> 
> 
> Aplicación CAU
> http://cau.uca.es/
> 
> 
> From: Ufuk YILMAZ 
> Subject: Re: Looking for online tutorials setting up SolrCloud replication 
> with Solr 8.11.1
> Date: April 14, 2022 at 7:00:43 AM EDT
> To: users@solr.apache.org
> Reply-To: users@solr.apache.org
> 
> 
> I'm using Docker with bitnami solr and official zookeeper images. Starting up 
> 3 zookeepers, pointing solr to them and starting solr instances was very easy 
> this way. In fact I don't know how to start a standalone solr instance.
> 
> A small docker-compose example:
> 
> version: '2'
> services:
> 
>  zoo-1:
>image: zookeeper:3.4
>hostname: zoo-1
>ports:
>  - 2181:2181
>environment:
>  ZOO_MY_ID: 1
>  ZOO_SERVERS: server.1=0.0.0.0:2888:3888
>restart: unless-stopped
>networks:
>  - net
> 
>  solr-1:
>image: solr:8.4-slim
>hostname: solr-1
>container_name: solr-1
>depends_on:
>  - zoo-1
>ports:
>  - "8983:8983"
>environment:
>  ZK_HOST: "zoo-1:2181"
>  SOLR_HOST: "solr-1"
>  SOLR_HEAP: "1g"
>restart: unless-stopped
>networks:
>  - net
> 
> networks:
>  net:
> 
> On 2022-04-13 22:51, David Hastings wrote:
>> I think this would be very beneficial, especially with a step by step on
>> getting all three zookeeps up and running for a quorum, honestly this has
>> been one of my major hold backs form implementing cloud, when the
>> simplicity of a standalone server and a couple hundred $ of ssd's and
>> memory make up for any performance, plus I never needed NRT
>> On Wed, Apr 13, 2022 at 3:48 PM Heller, George A III CTR (USA)
>>  wrote:
>>> I have been looking online tutorials for setting solrCloud with Solr
>>> 8.11.1.
>>> I have found the Apache tutorial using the batch file “solr –e cloud”.
>>> I can’t finding any tutorial setting it up without the batch file. Does
>>> anyone know where I can find a tutorial that does not use the batch file or
>>> that the only way to set up SolrCloud?
>>> I want to set up firstly two solr instances on the same server, then move
>>> them to the servers in our failover cluster.
>>> Thanks,
>>> George
> 
> 

___
Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 | 
http://www.opensourceconnections.com  | 
My Free/Busy   
Co-Author: Apache Solr Enterprise Search Server, 3rd Ed 


This e-mail and all contents, including attachments, is considered to be 
Company Confidential unless explicitly stated otherwise, regardless of whether 
attachments are marked as such.

--- End Message ---

Re: Looking for online tutorials setting up SolrCloud replication with Solr 8.11.1

[Eric Pugh]

Here is a local demo of three node Solr + three node ZK via Docker Compose…..   
Not quite what you are looking for…. 

https://github.com/querqy/chorus/blob/main/docker-compose.yml#L58 


Look at Quickstart.sh.



> On Apr 14, 2022, at 7:01 AM, cau-rep...@uca.es wrote:
> 
> 
> No es posible recibir su consulta por este medio. Para que nos llegue 
> correctamente debe usar la aplicación CAU: 
> 
>  http://cau.uca.es/
> 
> 
> Agredeciendo su colaboración.
> 
>Saludos
> 
> 
> Aplicación CAU
> http://cau.uca.es/
> 
> 
> From: Ufuk YILMAZ 
> Subject: Re: Looking for online tutorials setting up SolrCloud replication 
> with Solr 8.11.1
> Date: April 14, 2022 at 7:00:43 AM EDT
> To: users@solr.apache.org
> Reply-To: users@solr.apache.org
> 
> 
> I'm using Docker with bitnami solr and official zookeeper images. Starting up 
> 3 zookeepers, pointing solr to them and starting solr instances was very easy 
> this way. In fact I don't know how to start a standalone solr instance.
> 
> A small docker-compose example:
> 
> version: '2'
> services:
> 
>  zoo-1:
>image: zookeeper:3.4
>hostname: zoo-1
>ports:
>  - 2181:2181
>environment:
>  ZOO_MY_ID: 1
>  ZOO_SERVERS: server.1=0.0.0.0:2888:3888
>restart: unless-stopped
>networks:
>  - net
> 
>  solr-1:
>image: solr:8.4-slim
>hostname: solr-1
>container_name: solr-1
>depends_on:
>  - zoo-1
>ports:
>  - "8983:8983"
>environment:
>  ZK_HOST: "zoo-1:2181"
>  SOLR_HOST: "solr-1"
>  SOLR_HEAP: "1g"
>restart: unless-stopped
>networks:
>  - net
> 
> networks:
>  net:
> 
> On 2022-04-13 22:51, David Hastings wrote:
>> I think this would be very beneficial, especially with a step by step on
>> getting all three zookeeps up and running for a quorum, honestly this has
>> been one of my major hold backs form implementing cloud, when the
>> simplicity of a standalone server and a couple hundred $ of ssd's and
>> memory make up for any performance, plus I never needed NRT
>> On Wed, Apr 13, 2022 at 3:48 PM Heller, George A III CTR (USA)
>>  wrote:
>>> I have been looking online tutorials for setting solrCloud with Solr
>>> 8.11.1.
>>> I have found the Apache tutorial using the batch file “solr –e cloud”.
>>> I can’t finding any tutorial setting it up without the batch file. Does
>>> anyone know where I can find a tutorial that does not use the batch file or
>>> that the only way to set up SolrCloud?
>>> I want to set up firstly two solr instances on the same server, then move
>>> them to the servers in our failover cluster.
>>> Thanks,
>>> George
> 
> 

___
Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 | 
http://www.opensourceconnections.com  | 
My Free/Busy   
Co-Author: Apache Solr Enterprise Search Server, 3rd Ed 


This e-mail and all contents, including attachments, is considered to be 
Company Confidential unless explicitly stated otherwise, regardless of whether 
attachments are marked as such.

Re: Looking for online tutorials setting up SolrCloud replication with Solr 8.11.1

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
I'm using Docker with bitnami solr and official zookeeper images. 
Starting up 3 zookeepers, pointing solr to them and starting solr 
instances was very easy this way. In fact I don't know how to start a 
standalone solr instance.


A small docker-compose example:

version: '2'
services:

  zoo-1:
image: zookeeper:3.4
hostname: zoo-1
ports:
  - 2181:2181
environment:
  ZOO_MY_ID: 1
  ZOO_SERVERS: server.1=0.0.0.0:2888:3888
restart: unless-stopped
networks:
  - net

  solr-1:
image: solr:8.4-slim
hostname: solr-1
container_name: solr-1
depends_on:
  - zoo-1
ports:
  - "8983:8983"
environment:
  ZK_HOST: "zoo-1:2181"
  SOLR_HOST: "solr-1"
  SOLR_HEAP: "1g"
restart: unless-stopped
networks:
  - net

networks:
  net:

On 2022-04-13 22:51, David Hastings wrote:
I think this would be very beneficial, especially with a step by step 
on
getting all three zookeeps up and running for a quorum, honestly this 
has

been one of my major hold backs form implementing cloud, when the
simplicity of a standalone server and a couple hundred $ of ssd's and
memory make up for any performance, plus I never needed NRT

On Wed, Apr 13, 2022 at 3:48 PM Heller, George A III CTR (USA)
 wrote:


I have been looking online tutorials for setting solrCloud with Solr
8.11.1.



I have found the Apache tutorial using the batch file “solr –e cloud”.





I can’t finding any tutorial setting it up without the batch file. 
Does
anyone know where I can find a tutorial that does not use the batch 
file or

that the only way to set up SolrCloud?



I want to set up firstly two solr instances on the same server, then 
move

them to the servers in our failover cluster.



Thanks,

George

--- End Message ---

Re: Looking for online tutorials setting up SolrCloud replication with Solr 8.11.1

[Ufuk YILMAZ]

I'm using Docker with bitnami solr and official zookeeper images. 
Starting up 3 zookeepers, pointing solr to them and starting solr 
instances was very easy this way. In fact I don't know how to start a 
standalone solr instance.


A small docker-compose example:

version: '2'
services:

  zoo-1:
image: zookeeper:3.4
hostname: zoo-1
ports:
  - 2181:2181
environment:
  ZOO_MY_ID: 1
  ZOO_SERVERS: server.1=0.0.0.0:2888:3888
restart: unless-stopped
networks:
  - net

  solr-1:
image: solr:8.4-slim
hostname: solr-1
container_name: solr-1
depends_on:
  - zoo-1
ports:
  - "8983:8983"
environment:
  ZK_HOST: "zoo-1:2181"
  SOLR_HOST: "solr-1"
  SOLR_HEAP: "1g"
restart: unless-stopped
networks:
  - net

networks:
  net:

On 2022-04-13 22:51, David Hastings wrote:
I think this would be very beneficial, especially with a step by step 
on
getting all three zookeeps up and running for a quorum, honestly this 
has

been one of my major hold backs form implementing cloud, when the
simplicity of a standalone server and a couple hundred $ of ssd's and
memory make up for any performance, plus I never needed NRT

On Wed, Apr 13, 2022 at 3:48 PM Heller, George A III CTR (USA)
 wrote:


I have been looking online tutorials for setting solrCloud with Solr
8.11.1.



I have found the Apache tutorial using the batch file “solr –e cloud”.





I can’t finding any tutorial setting it up without the batch file. 
Does
anyone know where I can find a tutorial that does not use the batch 
file or

that the only way to set up SolrCloud?



I want to set up firstly two solr instances on the same server, then 
move

them to the servers in our failover cluster.



Thanks,

George

Re: Upgrading log4j from v2.16.0 to 2.17.0

[cau-reply2]

No es posible recibir su consulta por este medio. Para que nos llegue 
correctamente debe usar la aplicación CAU: 

  http://cau.uca.es/


Agredeciendo su colaboración.

Saludos


Aplicación CAU
http://cau.uca.es/

--- Begin Message ---
Hi,

We have upgraded solr to v8.11.1 which includes log4j v2.16.0. We want to 
upgrade log4j to v2.17.1. So is it possible to upgrade log4j from v2.16.0 to 
v2.17.0 , Please let us know.

Thanks and Regards,
Kunal Tidake
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


--- End Message ---

Upgrading log4j from v2.16.0 to 2.17.0

[Kunal Tidake]

Hi,

We have upgraded solr to v8.11.1 which includes log4j v2.16.0. We want to 
upgrade log4j to v2.17.1. So is it possible to upgrade log4j from v2.16.0 to 
v2.17.0 , Please let us know.

Thanks and Regards,
Kunal Tidake
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you