Cross join on multivalued field

[Luke Oak]

Hi,

I am wondering whether there is planning to implement cross collections join 
query on multivalued field 

Thanks 

Sent from my iPhone

Re: Caffeine Cache and Filter Cache in 8.3

[Stephen Lewis Bianamara]

Thanks Shawn! This is great clarity, really appreciate it. I'll proceed to
performance testing of the Caffeine Cache 

Is there a Jira issue needed for tracking these two documentation updates (
here

and here

)?

On Mon, Feb 22, 2021 at 1:16 PM Shawn Heisey  wrote:

> On 2/22/2021 1:50 PM, Stephen Lewis Bianamara wrote:
>
> 
>
> > (a) At what version did the caffeine cache reach production stability?
> > (b) Is the caffeine cache, and really all implementations, able to be
> used
> > on any cache, or are the restrictions about which cache implementations
> may
> > be used for which cache? If the latter, can you provide some guidance?
>
> The caffiene-based cache was introduced in Solr 8.3.  It was considered
> viable for production from the time it was introduced.
>
> https://issues.apache.org/jira/browse/SOLR-8241
>
> Something was found and fixed in 8.5.  I do not know what the impact of
> that issue was:
>
> https://issues.apache.org/jira/browse/SOLR-14239
>
> The other cache implementations were deprecated at some point.  Those
> implementations have been removed from the master branch, but still
> exist in the code for 8.x versions.
>
> If you want to use one of the older implementations like FastLRUCache,
> you still can, and will be able to for all future 8.x versions.  When
> 9.0 is released at some future date, that will no longer be possible.
>
> The Caffeine-based implementation is probably the best option, but I do
> not have any concrete data to give you.
>
> Thanks,
> Shawn
>

[IMPORTANT] Apache Solr TLP Update - Solr User email list migration

[Anshum Gupta]

Hi Solr Users,

As part of setting up Apache Solr as a Top Level Project, we’re migrating
the existing solr-user@lucene.apache.org mailing list to
us...@solr.apache.org.

All existing subscriptions, and conversations will be migrated to the new
list but if you have any mail client filters, please fix them accordingly.

The migration has been requested and ASF Infra is working with the
Lucene/Solr PMC for this[1].

We will update the list once the migration is completed.

- Anshum Gupta
On behalf of the Apache Solr PMC

[1] - https://issues.apache.org/jira/browse/INFRA-21443

Re: R: defragmentation can improve performance on SATA class 10 disk ~10000 rpm ?

[dmitri maziuk]

On 2021-02-23 1:53 AM, Danilo Tomasoni wrote:

Thank you all for the suggestions,
The OS is not windows, it's centos, a colleague thinks that even on linux 
defragmenting can improve performance about 2X because it keeps the data 
contiguous on disk.


You may want to check the filesystem you're using and read up on XFS vs 
EXT4.


FWIW we've had reasonable success with ZFS on Linux (look on github) 
binary drivers for centos 6 and, a bit less so: 7. With effectively 
RAID-10'ed HDDs and a regular SSD for read & write caching.


Either way, check with `df` first: if you're more than ~75% full, you 
need a bigger disk no matter what else you do.


Dima

Solr Cloud Autoscaling Basics

[yasoobhaider]

Hi 

I have a master slave architecture setup currently. I'm evaluating
SolrCloud. 

I've read through most of the documentation, but what I can't seem to find
is the preferred way to autoscale the cluster. 

In the master slave architecture, we have a autoscaling policy (CPU based)
configured on Spotinst which adds a node and it replicates the index from
the master and starts serving traffic. This helps us bring the cost of the
cluster down by downscaling the cluster at low traffic times. 

What would be right way to do this in Cloud mode? Will replication factor
need to be changed again and again for this? Would I have to call the
ADDREPLICA api after adding a node as suggested here?
https://lucene.472066.n3.nabble.com/Autoscaling-in-8-2-td4451650.html#a4451659.
It seems rather cumbersome compared to Master-Slave architecture 

How is SolrCloud usually run in production environments? With autoscaling
turned off completely (apart from failure scenarios where a node crashes for
ex)?



--
Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

[ANNOUNCE] Apache Solr 8.8.1 released

[Timothy Potter]

The Lucene PMC is pleased to announce the release of Apache Solr 8.8.1.


Solr is the popular, blazing fast, open source NoSQL search platform from
the Apache Lucene project. Its major features include powerful full-text
search, hit highlighting, faceted search, dynamic clustering, database
integration, rich document handling, and geospatial search. Solr is highly
scalable, providing fault tolerant distributed search and indexing, and
powers the search and navigation features of many of the world's largest
internet sites.


Solr 8.8.1 is available for immediate download at:


  


### Solr 8.8.1 Release Highlights:


Fix for a SolrJ backwards compatibility issue when upgrading the server to
8.8.0 without upgrading SolrJ to 8.8.0.


Please refer to the Upgrade Notes in the Solr Ref Guide for information on
upgrading from previous Solr versions:


  


Please read CHANGES.txt for a full list of bugfixes:


  


Solr 8.8.1 also includes bugfixes in the corresponding Apache Lucene
release:


  



Note: The Apache Software Foundation uses an extensive mirroring network for

distributing releases. It is possible that the mirror you are using may not
have

replicated the release yet. If that is the case, please try another mirror.

This also applies to Maven access.

Multivalued text_general field returns lowercased value in "if" function query

[ufuk yılmaz]

I have a type=”text_general” multivalued=”true” field, named fieldA.

When I use a function query, with fields like

fields=if(true, fieldA, -1), fieldA

Response is:

"response":{"numFound":1,"start":0,"maxScore":4.6553917,"docs":[
  {
"fieldA":["SomeMixedCaseValue"],
"if(true,fieldA,-1)":"somemixedcasevalue"}]
}}

Is this a bug or an expected output? Is there a way to avoid it getting 
lowercased?

Whole field definition is:

  

  
  
  


  
  
  
  

  





-ufuk yilmaz

Sent from Mail for Windows 10

send

[Martin Graney]

-- 
Martin Graney
Lead Developer

http://sooqr.com 
http://twitter.com/sooqrcom

Office: +31 (0) 88 766 7700
Mobile: +31 (0) 64 660 8543

-- 
 

Atomic bug update

[Mahmoud Almokadem]

Hello,

I've upgraded the SolrCloud from 7.6 to 8.8 and unfortunately I got the
following exception on Atomic updates of some of the documents.

And in some cases some fields are retrieved with an array of multi values
in case the field is defined as a single value.

Is there a bug on this version regarding the Atomic updates? And how can I
solve this issue?

org.apache.solr.common.SolrException: TransactionLog doesn't know how to
serialize class org.apache.lucene.document.LazyDocument$LazyField; try
implementing ObjectResolver?
at org.apache.solr.update.TransactionLog$1.resolve(TransactionLog.java:100)
at org.apache.solr.common.util.JavaBinCodec.writeVal(JavaBinCodec.java:266)
at
org.apache.solr.common.util.JavaBinCodec$BinEntryWriter.put(JavaBinCodec.java:441)
at
org.apache.solr.common.ConditionalKeyMapWriter$EntryWriterWrapper.put(ConditionalKeyMapWriter.java:44)
at org.apache.solr.common.MapWriter$EntryWriter.putNoEx(MapWriter.java:101)
at
org.apache.solr.common.MapWriter$EntryWriter.lambda$getBiConsumer$0(MapWriter.java:161)
at
org.apache.solr.common.SolrInputDocument.lambda$writeMap$0(SolrInputDocument.java:59)
at java.base/java.util.LinkedHashMap.forEach(LinkedHashMap.java:684)
at
org.apache.solr.common.SolrInputDocument.writeMap(SolrInputDocument.java:61)
at
org.apache.solr.common.util.JavaBinCodec.writeSolrInputDocument(JavaBinCodec.java:667)
at org.apache.solr.update.TransactionLog.write(TransactionLog.java:397)
at org.apache.solr.update.UpdateLog.add(UpdateLog.java:585)
at org.apache.solr.update.UpdateLog.add(UpdateLog.java:557)
at
org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:351)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:294)
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:241)
at
org.apache.solr.update.processor.RunUpdateProcessorFactory$RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:73)
at
org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:256)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.doVersionAdd(DistributedUpdateProcessor.java:495)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.lambda$versionAdd$0(DistributedUpdateProcessor.java:336)
at org.apache.solr.update.VersionBucket.runWithLock(VersionBucket.java:50)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:336)
at
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:222)
at
org.apache.solr.update.processor.DistributedZkUpdateProcessor.processAdd(DistributedZkUpdateProcessor.java:245)
at
org.apache.solr.handler.loader.JavabinLoader$1.update(JavabinLoader.java:110)
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readOuterMostDocIterator(JavaBinUpdateRequestCodec.java:343)
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readIterator(JavaBinUpdateRequestCodec.java:291)
at
org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:338)
at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:283)
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec$StreamingCodec.readNamedList(JavaBinUpdateRequestCodec.java:244)
at
org.apache.solr.common.util.JavaBinCodec.readObject(JavaBinCodec.java:303)
at org.apache.solr.common.util.JavaBinCodec.readVal(JavaBinCodec.java:283)
at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:196)
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.unmarshal(JavaBinUpdateRequestCodec.java:131)
at
org.apache.solr.handler.loader.JavabinLoader.parseAndLoadDocs(JavabinLoader.java:122)
at org.apache.solr.handler.loader.JavabinLoader.load(JavabinLoader.java:70)
at
org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:82)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2646)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:794)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:357)
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201)
at
org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at