Antwort: Re: Issue while searching with escape characters

[Jan . Christopher . Schluchtmann-EXT]

Hi think, your first line ist correkt for the "value"-field ... what looks 
your "key"-field like?
can you send the whole request, please?

something like this should work in my opinion:

(...)=%28DVeto1%29&(...) 

Mit freundlichen Grüßen/ With kind regards

Jan Schluchtmann
Systems Engineering Cluster Instruments
VW Group
Continental Automotive GmbH
Division Interior
ID S3 RM
VDO-Strasse 1, 64832 Babenhausen, Germany

Telefon/Phone: +49 6073 12-4346
Telefax: +49 6073 12-79-4346



Von:Roopesh Uniyal 
An: solr-user@lucene.apache.org, 
Kopie:  jan.christopher.schluchtmann-...@continental-corporation.com
Datum:  06.12.2017 16:14
Betreff:Re: Issue while searching with escape characters



Thanks Emir & Jan!

I have a situation where I need to search a field value is
between parenthesis () like - *(DVeto1)*

Based on the documentation
<
http://lucene.apache.org/core/7_1_0/queryparser/org/apache/lucene/queryparser/classic/package-summary.html#Escaping_Special_Characters
>
parenthesis just need escape character but no matter what way I provide 
it,
its not providing resultset.

%28*DVeto1*%29
%5C%28*DVeto1*%5C%29
%22%28%22*DVeto1*%22%29%22
%22%5C%28%22*DVeto1*%22%5C%29%22


Thanks,
Roopesh

On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:

> Hi,
> You need to escape special chars with \ and if you are sending it in URL
> you can URL encode it, but that is URL related thing not Solr.
>
> Here is the list of Lucene characters that need to be escaped:
> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
> lucene/queryparser/classic/package-summary.html#Escaping_
> Special_Characters  apache/lucene/queryparser/classic/package-summary.html#
> Escaping_Special_Characters>
>
> HTH,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>
>
>
> > On 6 Dec 2017, at 10:33, Roopesh Uniyal 
> wrote:
> >
> > Thanks Jan. It must be a late night. Not sure what I was thinking.
> >
> > I provided *%5C%28DVeto1%5C%29* but still not able to get the search
> results
> >
> > I also have a situation where I have to search something like
> *(ID#DVeto2)*
> > and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
> the
> > resultsets.
> >
> > Its not throwing any error but no result found in these two scenarios.
> > Although we know there should be some records.
> >
> > Am I missing anything?
> >
> > Thanks!
> >
> >
> > On Wed, Dec 6, 2017 at 4:13 AM, <
> > jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> >
> >> hmm ... it seems, you are using XML/HTML-encoding, but you need
> >> HTTP-encoding, which looks like this:
> >>
> >>
> >> ␣  !   "   #   $   %   &   '   (   )
> >> *   +   ,   -   .   /   :   ;   <
>  =
> >>>  ?   @   [   \   ]   {   |   }
> >>
> >> %20 %21 %22 %23 %24 %25 %26 %27 %28 
%29
> >> %2A %2B %2C %2D %2E %2F %3A %3B %3C 
%3D
> >> %3E %3F %40 %5B %5C %5D %7B %7C %7D
> >>
> >>
> >> good luck! :)
> >>
> >>
> >> Mit freundlichen Grüßen/ With kind regards
> >>
> >> Jan Schluchtmann
> >> Systems Engineering Cluster Instruments
> >> VW Group
> >> Continental Automotive GmbH
> >> Division Interior
> >> ID S3 RM
> >> VDO-Strasse 1, 64832 Babenhausen, Germany
> >>
> >> Telefon/Phone: +49 6073 12-4346
> >> Telefax: +49 6073 12-79-4346
> >>
> >>
> >>
> >> Von:Roopesh Uniyal 
> >> An: solr-user@lucene.apache.org,
> >> Datum:  06.12.2017 09:57
> >> Betreff:Issue while searching with escape characters
> >>
> >>
> >>
> >> Hello I am searching Solr 6 via http call by providing a "UserID".
> >>
> >> Its just that the data is in the format of (DVeto1)
> >>
> >> So, in my call I have to provide parenthesis but since its a special
> >> character I need to provide escape also. Looks like its not working
> >>
> >> Provided the search string over http like these but none worked -
> >>
> >> DVeto1
> >> DVeto1
> >>
> >> Since this is not working I am sure I am missing something. Will
> >> appreciate
> >> your inputs.
> >>
> >> Thanks!
> >>
> >>
> >>
>
>

Re: Calling rest API from Solr custom tokenizer plugin

[Sreenivas.T]

Thanks Doug. Now I think it's better to customize Manifold CF's output
connector for
Solr.

Sreenivas
On Thu, Dec 7, 2017 at 10:01 AM Doug Turnbull <
dturnb...@opensourceconnections.com> wrote:

> A tokenizer plugin is probably not what you want, you probably want
> something more like an UpdateProcessor that can manipulate the whole
> document as it comes into Solr. Or you may want to avoid having a Solr
> plugin call to an API and do this work outside of Solr (what happens when
> the API is down, should doc updates fail? for example).
>
> A tokenizer plugin would definitely not be recommended. Tokenizers need to
> fast, low-level code that split up text into tokens based on readily
> accesible config & data. The overhead of a network call would be far too
> high,
>
> You probably want to put your extracted tags Into a different field anyway,
> and a tokenizer only works on text within a single field.
>
> -Doug
>
> On Wed, Dec 6, 2017 at 10:57 PM Sreenivas.T  wrote:
>
> > All,
> >
> > I need help from experts. We are trying to build a cognitive search
> > platform with enterprise content from content sources like sharepoint,
> file
> > share etc.. before content is getting indexed to Solr, I need to call our
> > internal AI platform to get additional metadata like classification tags
> > etc..
> >
> > I'm planning to leverage manifold cf for getting the content from sources
> > and planning to write
> > Custom tokenizer plugin to send the content to AI platform, which intern
> > returns with additional tags. I'll index additional tags dynamically
> > through plugin code.
> >
> > Is it a feasible solution?Is there any other way to achieve the same? I
> was
> > planning to not to customize manifold cf.
> >
> > Please suggest
> >
> >
> >
> > Regards,
> > Sreenivas
> >
> --
> Consultant, OpenSource Connections. Contact info at
> http://o19s.com/about-us/doug-turnbull/; Free/Busy (
> http://bit.ly/dougs_cal)
>

Re: Calling rest API from Solr custom tokenizer plugin

[Doug Turnbull]

A tokenizer plugin is probably not what you want, you probably want
something more like an UpdateProcessor that can manipulate the whole
document as it comes into Solr. Or you may want to avoid having a Solr
plugin call to an API and do this work outside of Solr (what happens when
the API is down, should doc updates fail? for example).

A tokenizer plugin would definitely not be recommended. Tokenizers need to
fast, low-level code that split up text into tokens based on readily
accesible config & data. The overhead of a network call would be far too
high,

You probably want to put your extracted tags Into a different field anyway,
and a tokenizer only works on text within a single field.

-Doug

On Wed, Dec 6, 2017 at 10:57 PM Sreenivas.T  wrote:

> All,
>
> I need help from experts. We are trying to build a cognitive search
> platform with enterprise content from content sources like sharepoint, file
> share etc.. before content is getting indexed to Solr, I need to call our
> internal AI platform to get additional metadata like classification tags
> etc..
>
> I'm planning to leverage manifold cf for getting the content from sources
> and planning to write
> Custom tokenizer plugin to send the content to AI platform, which intern
> returns with additional tags. I'll index additional tags dynamically
> through plugin code.
>
> Is it a feasible solution?Is there any other way to achieve the same? I was
> planning to not to customize manifold cf.
>
> Please suggest
>
>
>
> Regards,
> Sreenivas
>
-- 
Consultant, OpenSource Connections. Contact info at
http://o19s.com/about-us/doug-turnbull/; Free/Busy (http://bit.ly/dougs_cal)

Calling rest API from Solr custom tokenizer plugin

[Sreenivas.T]

All,

I need help from experts. We are trying to build a cognitive search
platform with enterprise content from content sources like sharepoint, file
share etc.. before content is getting indexed to Solr, I need to call our
internal AI platform to get additional metadata like classification tags
etc..

I'm planning to leverage manifold cf for getting the content from sources
and planning to write
Custom tokenizer plugin to send the content to AI platform, which intern
returns with additional tags. I'll index additional tags dynamically
through plugin code.

Is it a feasible solution?Is there any other way to achieve the same? I was
planning to not to customize manifold cf.

Please suggest



Regards,
Sreenivas

Re: No Live SolrServer available to handle this request

[Selvam Raman]

Yes. you are right. we are using preanalyzed field and that causing the
problem.
The actual problem is preanalyzed with highlight option. if i disable
highlight option it works fine. Please let me know if there is work around
to solve it.

On Wed, Dec 6, 2017 at 10:19 PM, Erick Erickson 
wrote:

> This looks like you're using "pre analyzed fields" which have a very
> specific format. PreAnalyzedFields are actually pretty rarely used,
> did you enable them by mistake?
>
> On Tue, Dec 5, 2017 at 11:37 PM, Selvam Raman  wrote:
> > When i look at the solr logs i find the below exception
> >
> > Caused by: java.io.IOException: Invalid JSON type java.lang.String,
> > expected Map
> > at
> > org.apache.solr.schema.JsonPreAnalyzedParser.parse(
> JsonPreAnalyzedParser.java:86)
> > at
> > org.apache.solr.schema.PreAnalyzedField$PreAnalyzedTokenizer.
> decodeInput(PreAnalyzedField.java:345)
> > at
> > org.apache.solr.schema.PreAnalyzedField$PreAnalyzedTokenizer.access$
> 000(PreAnalyzedField.java:280)
> > at
> > org.apache.solr.schema.PreAnalyzedField$PreAnalyzedAnalyzer$1.
> setReader(PreAnalyzedField.java:375)
> > at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:202)
> > at
> > org.apache.lucene.search.uhighlight.AnalysisOffsetStrategy.tokenStream(
> AnalysisOffsetStrategy.java:58)
> > at
> > org.apache.lucene.search.uhighlight.MemoryIndexOffsetStrategy.
> getOffsetsEnums(MemoryIndexOffsetStrategy.java:106)
> > ... 37 more
> >
> >
> >
> >  I am setting up lot of fields (fq, score, highlight,etc) then put it
> into
> > solrquery.
> >
> > On Wed, Dec 6, 2017 at 11:22 AM, Selvam Raman  wrote:
> >
> >> When i am firing query it returns the doc as expected. (Example:
> >> q=synthesis)
> >>
> >> I am facing the problem when i include wildcard character in the query.
> >> (Example: q=synthesi*)
> >>
> >>
> >> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:
> >> Error from server at http://localhost:8983/solr/Metadata2:
> >> org.apache.solr.client.solrj.SolrServerException:
> >>
> >> No live SolrServers available to handle this request:[/solr/Metadata2_
> >> shard1_replica1,
> >>   solr/Metadata2_shard2_replica2,
> >>   solr/Metadata2_shard1_replica2]
> >>
> >> --
> >> Selvam Raman
> >> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
> >>
> >
> >
> >
> > --
> > Selvam Raman
> > "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
>



-- 
Selvam Raman
"லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

Re: indexing XML stored on HDFS

[Erick Erickson]

Perhaps the bin/post tool? See:
https://lucidworks.com/2015/08/04/solr-5-new-binpost-utility/

On Wed, Dec 6, 2017 at 2:05 PM, Matthew Roth  wrote:
> Hi All,
>
> Is there a DIH for HDFS? I see this old feature request [0
> ] that never seems to have
> gone anywhere. Google searches and searches on this list don't get me to
> far.
>
> Essentially my workflow is that I have many thousands of XML documents
> stored in hdfs. I run an xslt transformation in spark [1
> ]. This transforms to
> the expected solr input of . This is
> than written the back to hdfs. Now how do I get it back to solr? I suppose
> I could move the data back to the local fs, but on the surface that feels
> like the wrong way.
>
> I don't need to store the documents in HDFS after the spark transformation,
> I wonder if I can write them using solrj. However, I am not really familiar
> with solrj. I am also running a single node. Most of the material I have
> read on spark-solr expects you to be running SolrCloud.
>
> Best,
> Matt
>
>
>
> [0] https://issues.apache.org/jira/browse/SOLR-2096
> [1] https://github.com/elsevierlabs-os/spark-xml-utils

indexing XML stored on HDFS

[Matthew Roth]

Hi All,

Is there a DIH for HDFS? I see this old feature request [0
] that never seems to have
gone anywhere. Google searches and searches on this list don't get me to
far.

Essentially my workflow is that I have many thousands of XML documents
stored in hdfs. I run an xslt transformation in spark [1
]. This transforms to
the expected solr input of . This is
than written the back to hdfs. Now how do I get it back to solr? I suppose
I could move the data back to the local fs, but on the surface that feels
like the wrong way.

I don't need to store the documents in HDFS after the spark transformation,
I wonder if I can write them using solrj. However, I am not really familiar
with solrj. I am also running a single node. Most of the material I have
read on spark-solr expects you to be running SolrCloud.

Best,
Matt



[0] https://issues.apache.org/jira/browse/SOLR-2096
[1] https://github.com/elsevierlabs-os/spark-xml-utils

Re: Howto search for § character

[Rick Leir]

Bernd,
What is the analysis chain you have in schema.xml? The chain tokenizes text and 
filters characters. There is an index time chain and a query time chain. My 
suspicion is that your analysis chain is mapping that char to a plain ascii 
char. Use the SolrAdmin analysis tab to debug this.
Cheers -- Rick

On December 6, 2017 11:09:14 AM EST, Bernd Schmidt  
wrote:
>
>Hi all,
>
>
>we have defined a field named "_text_" for a full text search based on
>field-type "text_general":
>indexed="true" stored="false"/>"
>
>
>When trying to search for the "§" character, we have strange behaviour:
>
>
>q=_text_:§ AND entityClass:StructureNodeImpl  => numFound:469 (all
>nodes where entityClass:StructureNodeImpl)
>q=_text_:§ => numFound:0
>
>
>How can we search for the occurence of the § character?
>
>
>Best regards, 
>    Bernd
>
> Mit freundlichen Grüßen
>
> Bernd Schmidt
> SOFTWARE-ENTWICKLUNG 
>
> b.schm...@eggheads.de
>
>
>
> eggheads GmbH
> Herner Straße 370
>44807 Bochum
>
>Fon +49 234 89397-0
>Fax +49 234 89397-28
> 
> www.eggheads.de
> ---
>
>
>Kunden DER TOURISTIK, EMSA, FRIATEC, MAMMUT, SUTTERLÜTY, SCHÄFER SHOP,
>THOMAS COOK, TUI, WILO SE, WÜRTH, u.v.m.
>
>
>Leistungen Standardsoftware für Product Information Management, Cross
>Media Publishing & Multi Channel Commerce, Prozessberatung
>
>
>Innovationspreis 2017 eggheads ist Sieger beim Innovationspreis-IT 2017
>in der Kategorie E-Commerce. Mehr
>
>---
>
>Webinar Vorstellung der neuen Funktionalität der eggheads Suite am
>12.12.2017. Mehr
>
>---

-- 
Sorry for being brief. Alternate email is rickleir at yahoo dot com 

Re: Java profiler?

[Tim Casey]

I really like Profiler.  It takes a little bit of set up, but it works.

tim

On Wed, Dec 6, 2017 at 2:04 AM, Peter Sturge  wrote:

> Hi,
> We'be been using JPRofiler (www.ej-technologies.com) for years now.
> Without a doubt, the most comprehensive and useful profiler for java.
> Works very well, supports remote profiling and includes some very neat heap
> walking/gc profiling.
> Peter
>
>
> On Tue, Dec 5, 2017 at 3:21 PM, Walter Underwood 
> wrote:
>
> > Anybody have a favorite profiler to use with Solr? I’ve been asked to
> look
> > at why out queries are slow on a detail level.
> >
> > Personally, I think they are slow because they are so long, up to 40
> terms.
> >
> > wunder
> > Walter Underwood
> > wun...@wunderwood.org
> > http://observer.wunderwood.org/  (my blog)
> >
> >
> >
>

Re: Collection creation timeout

[Shawn Heisey]

On 12/6/2017 11:32 AM, Steve Pruitt wrote:
> After clicking Add Collection to create it, I get a Solr lost connection 
> error and the admin console is frozen.  Looking at the log I have
>o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the 
> collection time out:180s
>
> When I open the admin console on the two VM's I see the collection and the 
> graph shows my three shards distributed across all three machines.  The two 
> VM's are green, but the vector for my machine not active.  When I click on 
> it.  I get something suggesting a SSL connection issue.  This is a 
> development install, so I have not messed security.
>
> When I look at the two VM's, they have the data folder for the collection.  
> My machine does not.

Initial guess is the host firewall.  You're probably talking about the
Windows machine that has been discussed elsewhere.  All recent Windows
versions come with a firewall that is enabled by default and will block
all incoming connections from other machines, unless it is configured to
allow them.  SolrCloud relies heavily on its nodes being able to talk to
each other over the network.

https://technet.microsoft.com/en-us/library/cc766312(v=ws.10).aspx

If I'm right, you could just turn off the firewall, but I don't
generally recommend that for client systems.  It's something I often do
on server systems, but only when there's another firewall protecting
them.  For your system, you should probably leave the firewall enabled
and allow the traffic for Solr to get through the firewall.

If you choose to allow traffic by program, then the program in this case
will be the Java executable that is used to start Solr.  If you upgrade
Java, you may need to allow it again.  You can choose to allow it by TCP
port, in which case you'll need to know what port Solr is using.  The
default port is 8983.

Thanks,
Shawn

Re: [EXTERNAL] - Re: SolrCloud Windows Service

[Shawn Heisey]

On 12/6/2017 11:15 AM, Steve Pruitt wrote:
> If I sign out, I lose my running Solr.  I need to start it up and then sign 
> out.

If you're starting Solr with NSSM and having that problem, I think that
would be something to discuss with the NSSM project.  That behavior
sounds like Solr is not actually being started as a service.

One idea:  It's probably necessary to include the "-f" option on the
bin\solr command in your service, so Solr runs as a foreground process
within the service.  Running in the background is a good option for a
manual start, but it might be causing problems for a service, since the
service itself would be a background process.

Thanks,
Shawn

Collection creation timeout

[Steve Pruitt]

I have three SolrCloud nodes.  Two are VM's, the other is my machine.  I start 
Solr on each and they report running in SolrCloud mode.  I can access each node 
via the admin console.

I have a configset uploaded to my ZK ensemble.

I next tried creating a collection via the admin console for my machine with 
the Add Collection form.  My uploaded config set shows up ok.  I set numShards 
to 3 and replication factor to 1.  maxShardsPer, I leave at the default of 1.

After clicking Add Collection to create it, I get a Solr lost connection error 
and the admin console is frozen.  Looking at the log I have
   o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the 
collection time out:180s

When I open the admin console on the two VM's I see the collection and the 
graph shows my three shards distributed across all three machines.  The two 
VM's are green, but the vector for my machine not active.  When I click on it.  
I get something suggesting a SSL connection issue.  This is a development 
install, so I have not messed security.

When I look at the two VM's, they have the data folder for the collection.  My 
machine does not.

I tried deleting the collection from the admin console for one of the VM's and 
I got the same Solr connection lost error and the admin console is frozen.  
However, it looks like the collection was deleted because the VM's collection 
folder under the data folder is gone.

I don't understand why the collection seems to be created on the two VMs', but 
not on my machine.  I have an environmental issue, but not sure where to look.

RE: [EXTERNAL] - Re: SolrCloud Windows Service

[Steve Pruitt]

If I sign out, I lose my running Solr.  I need to start it up and then sign out.

Thanks.

-S

-Original Message-
From: Shawn Heisey [mailto:apa...@elyograg.org] 
Sent: Wednesday, December 06, 2017 12:10 PM
To: solr-user@lucene.apache.org
Subject: [EXTERNAL] - Re: SolrCloud Windows Service

On 12/6/2017 9:39 AM, Steve Pruitt wrote:
> Can someone suggest the best method for starting SolrCloud as a Windows 
> Service?
>
> I have used nssm prior.  It works ok for Solr standalone, but doesn't seem to 
> work correctly for SolrCloud.  This could simply be me not configuring the 
> service in nssm.

It would be the same whether you're starting standalone or cloud.  To start in 
cloud mode, edit the solr.in.cmd file so it defines ZK_HOST.

Thanks,
Shawn

Re: SolrCloud Windows Service

[Shawn Heisey]

On 12/6/2017 9:39 AM, Steve Pruitt wrote:
> Can someone suggest the best method for starting SolrCloud as a Windows 
> Service?
>
> I have used nssm prior.  It works ok for Solr standalone, but doesn't seem to 
> work correctly for SolrCloud.  This could simply be me not configuring the 
> service in nssm.

It would be the same whether you're starting standalone or cloud.  To
start in cloud mode, edit the solr.in.cmd file so it defines ZK_HOST.

Thanks,
Shawn

Re: SolrIndexSearcher count

[Rick Dig]

Hi all
Any pointers on this ?
Thanks


On Dec 5, 2017 22:42, "Rick Dig"  wrote:

No custom code at all.

On Dec 5, 2017 10:31 PM, "Erick Erickson"  wrote:

> Do you have any custom code in the mix anywhere?
>
> On Tue, Dec 5, 2017 at 5:02 AM, Rick Dig  wrote:
> > Hello all,
> > is it normal to have many instances (100+) of SolrIndexSearchers to be
> open
> > at the same time? Our Heap Analysis shows this to be the case.
> >
> > We have autoCommit for every 5 minutes, with openSearcher=true, would
> this
> > close the old searcher and create a new one or just create a new one with
> > the old one still not getting dereferenced? if so, when do the older
> > searchers get cleaned up ?
> >
> > thanks for your help
> > -rakshit
>

Re: No Live SolrServer available to handle this request

[Erick Erickson]

This looks like you're using "pre analyzed fields" which have a very
specific format. PreAnalyzedFields are actually pretty rarely used,
did you enable them by mistake?

On Tue, Dec 5, 2017 at 11:37 PM, Selvam Raman  wrote:
> When i look at the solr logs i find the below exception
>
> Caused by: java.io.IOException: Invalid JSON type java.lang.String,
> expected Map
> at
> org.apache.solr.schema.JsonPreAnalyzedParser.parse(JsonPreAnalyzedParser.java:86)
> at
> org.apache.solr.schema.PreAnalyzedField$PreAnalyzedTokenizer.decodeInput(PreAnalyzedField.java:345)
> at
> org.apache.solr.schema.PreAnalyzedField$PreAnalyzedTokenizer.access$000(PreAnalyzedField.java:280)
> at
> org.apache.solr.schema.PreAnalyzedField$PreAnalyzedAnalyzer$1.setReader(PreAnalyzedField.java:375)
> at org.apache.lucene.analysis.Analyzer.tokenStream(Analyzer.java:202)
> at
> org.apache.lucene.search.uhighlight.AnalysisOffsetStrategy.tokenStream(AnalysisOffsetStrategy.java:58)
> at
> org.apache.lucene.search.uhighlight.MemoryIndexOffsetStrategy.getOffsetsEnums(MemoryIndexOffsetStrategy.java:106)
> ... 37 more
>
>
>
>  I am setting up lot of fields (fq, score, highlight,etc) then put it into
> solrquery.
>
> On Wed, Dec 6, 2017 at 11:22 AM, Selvam Raman  wrote:
>
>> When i am firing query it returns the doc as expected. (Example:
>> q=synthesis)
>>
>> I am facing the problem when i include wildcard character in the query.
>> (Example: q=synthesi*)
>>
>>
>> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:
>> Error from server at http://localhost:8983/solr/Metadata2:
>> org.apache.solr.client.solrj.SolrServerException:
>>
>> No live SolrServers available to handle this request:[/solr/Metadata2_
>> shard1_replica1,
>>   solr/Metadata2_shard2_replica2,
>>   solr/Metadata2_shard1_replica2]
>>
>> --
>> Selvam Raman
>> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"
>>
>
>
>
> --
> Selvam Raman
> "லஞ்சம் தவிர்த்து நெஞ்சம் நிமிர்த்து"

SolrCloud Windows Service

[Steve Pruitt]

Can someone suggest the best method for starting SolrCloud as a Windows Service?

I have used nssm prior.  It works ok for Solr standalone, but doesn't seem to 
work correctly for SolrCloud.  This could simply be me not configuring the 
service in nssm.

If anyone has a working method, my thanks.


-S

RE: [EXTERNAL] - Re: Solr Cloud configuration

[Steve Pruitt]

Thanks.  I understand.

-Original Message-
From: Shawn Heisey [mailto:apa...@elyograg.org] 
Sent: Monday, December 04, 2017 11:58 PM
To: solr-user@lucene.apache.org
Subject: [EXTERNAL] - Re: Solr Cloud configuration

On 12/4/2017 12:11 PM, Steve Pruitt wrote:
> Getting my Solr Cloud nodes up and running took manually setting execution 
> permissions on the configuration files and manually creating the logs and 
> logs/archived folders under /opt/solr/server.  Even though I have my log 
> folders set to var/solr/logs in the default/solr.in.sh file.
> 
> After getting Happy searching!
> 
> I opened the Admin Console and I see
> solr.data.home=
> solr.log.home = "/opt/solr/server/logs solr.solr.home = 
> "/opt/solr/server/solr
> 
> SOLR_ENV points to my default/solr.in.sh file where I have these properties 
> set.

These paths sound like what Solr does when you manually start it, not what 
happens when you start the service.

In /opt/solr/bin, do you have a solr.in.sh file?  If you do, that file should 
be deleted or renamed.  The service install script will rename it to 
solr.in.sh.orig.

If your service is not named "solr" then you should absolutely never manually 
start Solr.  Even if the service is named solr, I would still never do a manual 
start.

Thanks,
Shawn

Solr DR Replication

[Greenhorn Techie]

Hi,

We are on Solr 5.5.2 and wondering what is the best mechanism for
replicating Solr indexes from a Disaster Recovery perspective. As I
understand only from Solr6 onwards, we have CDCR. However, I couldn't find
much content around index replication management for older versions.
Wondering if there is any such documented solution is available.

>From replication perspective, apart from SolrColud collection data, what
other information need to be copied over from source cluster to the target
cluster? Should we copy the ZK data as well for the collection?

TIA

Howto search for § character

[Bernd Schmidt]

Hi all,


we have defined a field named "_text_" for a full text search based on 
field-type "text_general":
"


When trying to search for the "§" character, we have strange behaviour:


q=_text_:§ AND entityClass:StructureNodeImpl  => numFound:469 (all nodes where 
entityClass:StructureNodeImpl)
q=_text_:§ => numFound:0


How can we search for the occurence of the § character?


Best regards, 
    Bernd

 Mit freundlichen Grüßen

 Bernd Schmidt
 SOFTWARE-ENTWICKLUNG 

 b.schm...@eggheads.de



 eggheads GmbH
 Herner Straße 370
44807 Bochum

Fon +49 234 89397-0
Fax +49 234 89397-28
 
 www.eggheads.de
 ---


Kunden DER TOURISTIK, EMSA, FRIATEC, MAMMUT, SUTTERLÜTY, SCHÄFER SHOP, THOMAS 
COOK, TUI, WILO SE, WÜRTH, u.v.m.


Leistungen Standardsoftware für Product Information Management, Cross Media 
Publishing & Multi Channel Commerce, Prozessberatung


Innovationspreis 2017 eggheads ist Sieger beim Innovationspreis-IT 2017 in der 
Kategorie E-Commerce. Mehr

---

Webinar Vorstellung der neuen Funktionalität der eggheads Suite am 12.12.2017. 
Mehr

---

Re: SOLR-10272

[Chris Ulicny]

Thanks Shawn,

That's great to hear. I'm glad the overwriting behavior is being reverted.

On Wed, Dec 6, 2017 at 10:33 AM Shawn Heisey  wrote:

> On 12/6/2017 6:43 AM, Chris Ulicny wrote:
> > I am curious as to whether overwriting an _existing_ config with the
> > "_default" one was intended or not when the change was made. If it was,
> the
> > documentation for CREATE in the Collections API could do with an update,
> > because it currently seems to me at least like the behavior hasn't
> actually
> > changed from the 6.X behavior.
>
> See the discussion here:
>
> https://issues.apache.org/jira/browse/SOLR-11624
>
> The fix for this issue is planned for the 7.3 release.
>
> Thanks,
> Shawn
>
>

Re: Issue while searching with escape characters

[Roopesh Uniyal]

Oh, that might be because I made DVeto1 in bold but it converted bold into
*. So you can ignore both *.

On Wed, Dec 6, 2017 at 10:35 AM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:

> Hi Roopesh,
> What are *? Is it wildcard or special char as well? Examples that you
> provided are  not what you said you want to search - * are not on the same
> position. If you are not finding anything, that can be due to your analysis
> - are you sure that your analysis does not trim parenthesis?
>
> Regards,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>
>
>
> > On 6 Dec 2017, at 16:13, Roopesh Uniyal 
> wrote:
> >
> > Thanks Emir & Jan!
> >
> > I have a situation where I need to search a field value is
> > between parenthesis () like - *(DVeto1)*
> >
> > Based on the documentation
> >  apache/lucene/queryparser/classic/package-summary.html#
> Escaping_Special_Characters>
> > parenthesis just need escape character but no matter what way I provide
> it,
> > its not providing resultset.
> >
> > %28*DVeto1*%29
> > %5C%28*DVeto1*%5C%29
> > %22%28%22*DVeto1*%22%29%22
> > %22%5C%28%22*DVeto1*%22%5C%29%22
> >
> >
> > Thanks,
> > Roopesh
> >
> > On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
> > emir.arnauto...@sematext.com> wrote:
> >
> >> Hi,
> >> You need to escape special chars with \ and if you are sending it in URL
> >> you can URL encode it, but that is URL related thing not Solr.
> >>
> >> Here is the list of Lucene characters that need to be escaped:
> >> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
> >> lucene/queryparser/classic/package-summary.html#Escaping_
> >> Special_Characters  core/7_1_0/queryparser/org/
> >> apache/lucene/queryparser/classic/package-summary.html#
> >> Escaping_Special_Characters>
> >>
> >> HTH,
> >> Emir
> >> --
> >> Monitoring - Log Management - Alerting - Anomaly Detection
> >> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
> >>
> >>
> >>
> >>> On 6 Dec 2017, at 10:33, Roopesh Uniyal 
> >> wrote:
> >>>
> >>> Thanks Jan. It must be a late night. Not sure what I was thinking.
> >>>
> >>> I provided *%5C%28DVeto1%5C%29* but still not able to get the search
> >> results
> >>>
> >>> I also have a situation where I have to search something like
> >> *(ID#DVeto2)*
> >>> and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
> >> the
> >>> resultsets.
> >>>
> >>> Its not throwing any error but no result found in these two scenarios.
> >>> Although we know there should be some records.
> >>>
> >>> Am I missing anything?
> >>>
> >>> Thanks!
> >>>
> >>>
> >>> On Wed, Dec 6, 2017 at 4:13 AM, <
> >>> jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> >>>
>  hmm ... it seems, you are using XML/HTML-encoding, but you need
>  HTTP-encoding, which looks like this:
> 
> 
>  ␣  !   "   #   $   %   &   '   (
>  )
>  *   +   ,   -   .   /   :   ;   <
> >> =
> > ?   @   [   \   ]   {   |   }
> 
>  %20 %21 %22 %23 %24 %25 %26 %27 %28
> %29
>  %2A %2B %2C %2D %2E %2F %3A %3B %3C
> %3D
>  %3E %3F %40 %5B %5C %5D %7B %7C %7D
> 
> 
>  good luck! :)
> 
> 
>  Mit freundlichen Grüßen/ With kind regards
> 
>  Jan Schluchtmann
>  Systems Engineering Cluster Instruments
>  VW Group
>  Continental Automotive GmbH
>  Division Interior
>  ID S3 RM
>  VDO-Strasse 1, 64832 Babenhausen, Germany
> 
>  Telefon/Phone: +49 6073 12-4346
>  Telefax: +49 6073 12-79-4346
> 
> 
> 
>  Von:Roopesh Uniyal 
>  An: solr-user@lucene.apache.org,
>  Datum:  06.12.2017 09:57
>  Betreff:Issue while searching with escape characters
> 
> 
> 
>  Hello I am searching Solr 6 via http call by providing a "UserID".
> 
>  Its just that the data is in the format of (DVeto1)
> 
>  So, in my call I have to provide parenthesis but since its a special
>  character I need to provide escape also. Looks like its not working
> 
>  Provided the search string over http like these but none worked -
> 
>  DVeto1
>  DVeto1
> 
>  Since this is not working I am sure I am missing something. Will
>  appreciate
>  your inputs.
> 
>  Thanks!
> 
> 
> 
> >>
> >>
>
>

Re: Issue while searching with escape characters

[Emir Arnautović]

Hi Roopesh,
What are *? Is it wildcard or special char as well? Examples that you provided 
are  not what you said you want to search - * are not on the same position. If 
you are not finding anything, that can be due to your analysis - are you sure 
that your analysis does not trim parenthesis?

Regards,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/



> On 6 Dec 2017, at 16:13, Roopesh Uniyal  wrote:
> 
> Thanks Emir & Jan!
> 
> I have a situation where I need to search a field value is
> between parenthesis () like - *(DVeto1)*
> 
> Based on the documentation
> 
> parenthesis just need escape character but no matter what way I provide it,
> its not providing resultset.
> 
> %28*DVeto1*%29
> %5C%28*DVeto1*%5C%29
> %22%28%22*DVeto1*%22%29%22
> %22%5C%28%22*DVeto1*%22%5C%29%22
> 
> 
> Thanks,
> Roopesh
> 
> On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
> emir.arnauto...@sematext.com> wrote:
> 
>> Hi,
>> You need to escape special chars with \ and if you are sending it in URL
>> you can URL encode it, but that is URL related thing not Solr.
>> 
>> Here is the list of Lucene characters that need to be escaped:
>> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
>> lucene/queryparser/classic/package-summary.html#Escaping_
>> Special_Characters > apache/lucene/queryparser/classic/package-summary.html#
>> Escaping_Special_Characters>
>> 
>> HTH,
>> Emir
>> --
>> Monitoring - Log Management - Alerting - Anomaly Detection
>> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>> 
>> 
>> 
>>> On 6 Dec 2017, at 10:33, Roopesh Uniyal 
>> wrote:
>>> 
>>> Thanks Jan. It must be a late night. Not sure what I was thinking.
>>> 
>>> I provided *%5C%28DVeto1%5C%29* but still not able to get the search
>> results
>>> 
>>> I also have a situation where I have to search something like
>> *(ID#DVeto2)*
>>> and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
>> the
>>> resultsets.
>>> 
>>> Its not throwing any error but no result found in these two scenarios.
>>> Although we know there should be some records.
>>> 
>>> Am I missing anything?
>>> 
>>> Thanks!
>>> 
>>> 
>>> On Wed, Dec 6, 2017 at 4:13 AM, <
>>> jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
>>> 
 hmm ... it seems, you are using XML/HTML-encoding, but you need
 HTTP-encoding, which looks like this:
 
 
 ␣  !   "   #   $   %   &   '   (   )
 *   +   ,   -   .   /   :   ;   <
>> =
> ?   @   [   \   ]   {   |   }
 
 %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
 %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
 %3E %3F %40 %5B %5C %5D %7B %7C %7D
 
 
 good luck! :)
 
 
 Mit freundlichen Grüßen/ With kind regards
 
 Jan Schluchtmann
 Systems Engineering Cluster Instruments
 VW Group
 Continental Automotive GmbH
 Division Interior
 ID S3 RM
 VDO-Strasse 1, 64832 Babenhausen, Germany
 
 Telefon/Phone: +49 6073 12-4346
 Telefax: +49 6073 12-79-4346
 
 
 
 Von:Roopesh Uniyal 
 An: solr-user@lucene.apache.org,
 Datum:  06.12.2017 09:57
 Betreff:Issue while searching with escape characters
 
 
 
 Hello I am searching Solr 6 via http call by providing a "UserID".
 
 Its just that the data is in the format of (DVeto1)
 
 So, in my call I have to provide parenthesis but since its a special
 character I need to provide escape also. Looks like its not working
 
 Provided the search string over http like these but none worked -
 
 DVeto1
 DVeto1
 
 Since this is not working I am sure I am missing something. Will
 appreciate
 your inputs.
 
 Thanks!
 
 
 
>> 
>> 

Re: SOLR-10272

[Shawn Heisey]

On 12/6/2017 6:43 AM, Chris Ulicny wrote:
> I am curious as to whether overwriting an _existing_ config with the
> "_default" one was intended or not when the change was made. If it was, the
> documentation for CREATE in the Collections API could do with an update,
> because it currently seems to me at least like the behavior hasn't actually
> changed from the 6.X behavior.

See the discussion here:

https://issues.apache.org/jira/browse/SOLR-11624

The fix for this issue is planned for the 7.3 release.

Thanks,
Shawn

Re: Dataimporter status

[Shawn Heisey]

On 12/6/2017 1:38 AM, Mahmoud Almokadem wrote:
> I'm already using the admin UI and get URL for fetching the status of
> dataimporter from network console and tried it outside the admin UI. Admin
> UI have the same behavior,  when I pressed on execute the status messages
> are swapped between "not started", "started and indexing", "completed on 3
> seconds", "completed on 10 seconds" something like that.
>
> I understood what you mean that the dataimporter are load balanced between
> shards, that's made me using the old admin UI on using dataimporter to get
> accurate status of what is running now. Because the it's related to core
> not collection.
>
> I think the dataimporter feature must moved to the core level instead of
> collection level.

For production usage, you should be using the API directly, not the
admin UI.

In version 7, the old UI is no longer available.  Moving dataimport back
to the core level in the admin UI is an interesting idea that would make
the problem less likely, though a good fix for SOLR-3666 would be
better.  Any committers want to comment?

Whether it's the admin UI or the API, if you access the DIH handler
through the collection instead of a core, you're going to see this behavior.

Thanks,
Shawn

Re: Issue while searching with escape characters

[Roopesh Uniyal]

Thanks Emir & Jan!

I have a situation where I need to search a field value is
between parenthesis () like - *(DVeto1)*

Based on the documentation

parenthesis just need escape character but no matter what way I provide it,
its not providing resultset.

%28*DVeto1*%29
%5C%28*DVeto1*%5C%29
%22%28%22*DVeto1*%22%29%22
%22%5C%28%22*DVeto1*%22%5C%29%22


Thanks,
Roopesh

On Wed, Dec 6, 2017 at 7:44 AM, Emir Arnautović <
emir.arnauto...@sematext.com> wrote:

> Hi,
> You need to escape special chars with \ and if you are sending it in URL
> you can URL encode it, but that is URL related thing not Solr.
>
> Here is the list of Lucene characters that need to be escaped:
> http://lucene.apache.org/core/7_1_0/queryparser/org/apache/
> lucene/queryparser/classic/package-summary.html#Escaping_
> Special_Characters  apache/lucene/queryparser/classic/package-summary.html#
> Escaping_Special_Characters>
>
> HTH,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
>
>
>
> > On 6 Dec 2017, at 10:33, Roopesh Uniyal 
> wrote:
> >
> > Thanks Jan. It must be a late night. Not sure what I was thinking.
> >
> > I provided *%5C%28DVeto1%5C%29* but still not able to get the search
> results
> >
> > I also have a situation where I have to search something like
> *(ID#DVeto2)*
> > and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get
> the
> > resultsets.
> >
> > Its not throwing any error but no result found in these two scenarios.
> > Although we know there should be some records.
> >
> > Am I missing anything?
> >
> > Thanks!
> >
> >
> > On Wed, Dec 6, 2017 at 4:13 AM, <
> > jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> >
> >> hmm ... it seems, you are using XML/HTML-encoding, but you need
> >> HTTP-encoding, which looks like this:
> >>
> >>
> >> ␣  !   "   #   $   %   &   '   (   )
> >> *   +   ,   -   .   /   :   ;   <
>  =
> >>>  ?   @   [   \   ]   {   |   }
> >>
> >> %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
> >> %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
> >> %3E %3F %40 %5B %5C %5D %7B %7C %7D
> >>
> >>
> >> good luck! :)
> >>
> >>
> >> Mit freundlichen Grüßen/ With kind regards
> >>
> >> Jan Schluchtmann
> >> Systems Engineering Cluster Instruments
> >> VW Group
> >> Continental Automotive GmbH
> >> Division Interior
> >> ID S3 RM
> >> VDO-Strasse 1, 64832 Babenhausen, Germany
> >>
> >> Telefon/Phone: +49 6073 12-4346
> >> Telefax: +49 6073 12-79-4346
> >>
> >>
> >>
> >> Von:Roopesh Uniyal 
> >> An: solr-user@lucene.apache.org,
> >> Datum:  06.12.2017 09:57
> >> Betreff:Issue while searching with escape characters
> >>
> >>
> >>
> >> Hello I am searching Solr 6 via http call by providing a "UserID".
> >>
> >> Its just that the data is in the format of (DVeto1)
> >>
> >> So, in my call I have to provide parenthesis but since its a special
> >> character I need to provide escape also. Looks like its not working
> >>
> >> Provided the search string over http like these but none worked -
> >>
> >> DVeto1
> >> DVeto1
> >>
> >> Since this is not working I am sure I am missing something. Will
> >> appreciate
> >> your inputs.
> >>
> >> Thanks!
> >>
> >>
> >>
>
>

SOLR-10272

[Chris Ulicny]

Hi all,

We are currently in the process of testing out solr 7.1, and I was running
into some strange issues with config upload and collection creation. After
some digging, I found SOLR-10272 which makes the configName parameter
necessary for collection creation, but all of our scripts for 6.X used the
old default behavior of matching collection name to the config set. The
resulting behavior was overwriting all of our named configs in zookeeper
with "_default" when the collections were created.

I am curious as to whether overwriting an _existing_ config with the
"_default" one was intended or not when the change was made. If it was, the
documentation for CREATE in the Collections API could do with an update,
because it currently seems to me at least like the behavior hasn't actually
changed from the 6.X behavior.

Thanks,
Chris

Re: Issue while searching with escape characters

[Emir Arnautović]

Hi,
You need to escape special chars with \ and if you are sending it in URL you 
can URL encode it, but that is URL related thing not Solr.

Here is the list of Lucene characters that need to be escaped: 
http://lucene.apache.org/core/7_1_0/queryparser/org/apache/lucene/queryparser/classic/package-summary.html#Escaping_Special_Characters
 


HTH,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/



> On 6 Dec 2017, at 10:33, Roopesh Uniyal  wrote:
> 
> Thanks Jan. It must be a late night. Not sure what I was thinking.
> 
> I provided *%5C%28DVeto1%5C%29* but still not able to get the search results
> 
> I also have a situation where I have to search something like *(ID#DVeto2)*
> and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get the
> resultsets.
> 
> Its not throwing any error but no result found in these two scenarios.
> Although we know there should be some records.
> 
> Am I missing anything?
> 
> Thanks!
> 
> 
> On Wed, Dec 6, 2017 at 4:13 AM, <
> jan.christopher.schluchtmann-...@continental-corporation.com> wrote:
> 
>> hmm ... it seems, you are using XML/HTML-encoding, but you need
>> HTTP-encoding, which looks like this:
>> 
>> 
>> ␣  !   "   #   $   %   &   '   (   )
>> *   +   ,   -   .   /   :   ;   <   =
>>>  ?   @   [   \   ]   {   |   }
>> 
>> %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
>> %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
>> %3E %3F %40 %5B %5C %5D %7B %7C %7D
>> 
>> 
>> good luck! :)
>> 
>> 
>> Mit freundlichen Grüßen/ With kind regards
>> 
>> Jan Schluchtmann
>> Systems Engineering Cluster Instruments
>> VW Group
>> Continental Automotive GmbH
>> Division Interior
>> ID S3 RM
>> VDO-Strasse 1, 64832 Babenhausen, Germany
>> 
>> Telefon/Phone: +49 6073 12-4346
>> Telefax: +49 6073 12-79-4346
>> 
>> 
>> 
>> Von:Roopesh Uniyal 
>> An: solr-user@lucene.apache.org,
>> Datum:  06.12.2017 09:57
>> Betreff:Issue while searching with escape characters
>> 
>> 
>> 
>> Hello I am searching Solr 6 via http call by providing a "UserID".
>> 
>> Its just that the data is in the format of (DVeto1)
>> 
>> So, in my call I have to provide parenthesis but since its a special
>> character I need to provide escape also. Looks like its not working
>> 
>> Provided the search string over http like these but none worked -
>> 
>> DVeto1
>> DVeto1
>> 
>> Since this is not working I am sure I am missing something. Will
>> appreciate
>> your inputs.
>> 
>> Thanks!
>> 
>> 
>> 

Re: Does apache solr stores the file?

[Gora Mohanty]

On 6 December 2017 at 10:39, Munish Kumar Arora
 wrote:
>
> So the questions are,
> 1. Can I get the PDF content?
> 2. does Solr stores the actual file somewhere?
>a. If it stores then where it does?
> b. If it does not store then, is there a way to store THE FILE?

Normal practice would be to store the PDF file somewhere on the file
system where it can be served through a HTTP request. Then, store the
filesystem path to the PDF file in Solr so that it can be returned in
a Solr search request.

Regards,
Gora

Re: Java profiler?

[Peter Sturge]

Hi,
We'be been using JPRofiler (www.ej-technologies.com) for years now.
Without a doubt, the most comprehensive and useful profiler for java.
Works very well, supports remote profiling and includes some very neat heap
walking/gc profiling.
Peter


On Tue, Dec 5, 2017 at 3:21 PM, Walter Underwood 
wrote:

> Anybody have a favorite profiler to use with Solr? I’ve been asked to look
> at why out queries are slow on a detail level.
>
> Personally, I think they are slow because they are so long, up to 40 terms.
>
> wunder
> Walter Underwood
> wun...@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
>
>
>

Re: Issue while searching with escape characters

[Roopesh Uniyal]

Thanks Jan. It must be a late night. Not sure what I was thinking.

I provided *%5C%28DVeto1%5C%29* but still not able to get the search results

I also have a situation where I have to search something like *(ID#DVeto2)*
and I am providing *%5C%28ID%23DVeto2%5C%2*9 and still not able to get the
resultsets.

Its not throwing any error but no result found in these two scenarios.
Although we know there should be some records.

Am I missing anything?

Thanks!


On Wed, Dec 6, 2017 at 4:13 AM, <
jan.christopher.schluchtmann-...@continental-corporation.com> wrote:

> hmm ... it seems, you are using XML/HTML-encoding, but you need
> HTTP-encoding, which looks like this:
>
>
> ␣  !   "   #   $   %   &   '   (   )
> *   +   ,   -   .   /   :   ;   <   =
> >   ?   @   [   \   ]   {   |   }
>
> %20 %21 %22 %23 %24 %25 %26 %27 %28 %29
> %2A %2B %2C %2D %2E %2F %3A %3B %3C %3D
> %3E %3F %40 %5B %5C %5D %7B %7C %7D
>
>
> good luck! :)
>
>
> Mit freundlichen Grüßen/ With kind regards
>
> Jan Schluchtmann
> Systems Engineering Cluster Instruments
> VW Group
> Continental Automotive GmbH
> Division Interior
> ID S3 RM
> VDO-Strasse 1, 64832 Babenhausen, Germany
>
> Telefon/Phone: +49 6073 12-4346
> Telefax: +49 6073 12-79-4346
>
>
>
> Von:Roopesh Uniyal 
> An: solr-user@lucene.apache.org,
> Datum:  06.12.2017 09:57
> Betreff:Issue while searching with escape characters
>
>
>
> Hello I am searching Solr 6 via http call by providing a "UserID".
>
> Its just that the data is in the format of (DVeto1)
>
> So, in my call I have to provide parenthesis but since its a special
> character I need to provide escape also. Looks like its not working
>
> Provided the search string over http like these but none worked -
>
> DVeto1
> DVeto1
>
> Since this is not working I am sure I am missing something. Will
> appreciate
> your inputs.
>
> Thanks!
>
>
>

Antwort: Issue while searching with escape characters

[Jan . Christopher . Schluchtmann-EXT]

hmm ... it seems, you are using XML/HTML-encoding, but you need 
HTTP-encoding, which looks like this:


␣  !   "   #   $   %   &   '   (   ) 
*   +   ,   -   .   /   :   ;   <   = 
>   ?   @   [   \   ]   {   |   }

%20 %21 %22 %23 %24 %25 %26 %27 %28 %29 
%2A %2B %2C %2D %2E %2F %3A %3B %3C %3D 
%3E %3F %40 %5B %5C %5D %7B %7C %7D 


good luck! :)


Mit freundlichen Grüßen/ With kind regards

Jan Schluchtmann
Systems Engineering Cluster Instruments
VW Group
Continental Automotive GmbH
Division Interior
ID S3 RM
VDO-Strasse 1, 64832 Babenhausen, Germany

Telefon/Phone: +49 6073 12-4346
Telefax: +49 6073 12-79-4346



Von:Roopesh Uniyal 
An: solr-user@lucene.apache.org, 
Datum:  06.12.2017 09:57
Betreff:Issue while searching with escape characters



Hello I am searching Solr 6 via http call by providing a "UserID".

Its just that the data is in the format of (DVeto1)

So, in my call I have to provide parenthesis but since its a special
character I need to provide escape also. Looks like its not working

Provided the search string over http like these but none worked -

DVeto1
DVeto1

Since this is not working I am sure I am missing something. Will 
appreciate
your inputs.

Thanks!

Does apache solr stores the file?

[Munish Kumar Arora]

Hi guys,

Hope you all are well. I could not find any place to ask my question so I
am dropping you guys a mail. If you can help me, that would be great.

I am currently working on Apache Solr 7. There is a POC I need to complete
as I have less time so putting this question here. I have setup SOLR on my
windows machine. I have created core and uploaded a PDF document using
/update/extract from Admin UI. After uploading, I can see the metadata of
the file if I query from the Admin UI using query button. I was wondering
if I can get the actual content of the PDF as well. I can see there is one
tlog file gets generated under /data/tlog/tlog000... with raw PDF data but
not the actual file.

So the questions are,
1. Can I get the PDF content?
2. does Solr stores the actual file somewhere?
   a. If it stores then where it does?
b. If it does not store then, is there a way to store THE FILE?


I hope, someone would answer my question.

Regards,
Munish Arora

Issue while searching with escape characters

[Roopesh Uniyal]

Hello I am searching Solr 6 via http call by providing a "UserID".

Its just that the data is in the format of (DVeto1)

So, in my call I have to provide parenthesis but since its a special
character I need to provide escape also. Looks like its not working

Provided the search string over http like these but none worked -

DVeto1
DVeto1

Since this is not working I am sure I am missing something. Will appreciate
your inputs.

Thanks!

Re: Dataimporter status

[Mahmoud Almokadem]

Thanks Shawn,

I'm already using the admin UI and get URL for fetching the status of
dataimporter from network console and tried it outside the admin UI. Admin
UI have the same behavior,  when I pressed on execute the status messages
are swapped between "not started", "started and indexing", "completed on 3
seconds", "completed on 10 seconds" something like that.

I understood what you mean that the dataimporter are load balanced between
shards, that's made me using the old admin UI on using dataimporter to get
accurate status of what is running now. Because the it's related to core
not collection.

I think the dataimporter feature must moved to the core level instead of
collection level.

Thanks,
Mahmoud


On Tue, Dec 5, 2017 at 6:57 AM, Shawn Heisey  wrote:

> On 12/3/2017 9:27 AM, Mahmoud Almokadem wrote:
>
>> We're facing an issue related to the dataimporter status on new Admin UI
>> (7.0.1).
>>
>> Calling to the API
>> http://solrip/solr/collection/dataimport?_=1512314812090
>> mand=status=on=json
>>
>> returns different status despite the importer is running
>> The messages are swapped between the following when refreshing the page:
>>
>
> 
>
> The old Admin UI was working well.
>>
>> Is that a bug on the new Admin UI?
>>
>
> What I'm going to say below is based on the idea that you're running
> SolrCloud.  If you're not, then this seems extremely odd and should not be
> happening.
>
> The first part of your message has a URL that accesses the API directly,
> *not* the admin UI, so I'm going to concentrate on that, and not discuss
> the admin UI, because the admin UI is not involved when using that kind of
> URL.
>
> When requests are sent to a collection name rather than directly to a
> core, SolrCloud load balances those requests across the cloud, picking
> different replicas and shards so each individual request ends up on a
> different core, and possibly on a different server.
>
> This load balancing is a general feature of SolrCloud, and happens even
> with the dataimport handler.  You never know which shard/replica is going
> to actually get a /dataimport request.  So what is happening here is that
> one of the cores in your collection is actually doing a dataimport, but all
> the others aren't.  When the status command is load balanced to the core
> that did the import, then you see the status with actual data, and when
> load balancing sends the request to one of the other cores, you see the
> empty status.
>
> If you want to reliably see the status of an import on SolrCloud, you're
> going to have to choose one of the cores (collection_shardN_replicaM) on
> one of the servers in your cloud, and send both the import command and the
> status command to that one core, instead of the collection.  You might even
> need to add a distrib=false parameter to the request to keep it from being
> load balanced, but I am not sure whether that's needed for /dataimport.
>
> Thanks,
> Shawn
>

Slices not found for checkpointCollection

[Mahmoud Almokadem]

Hi all,

I'm running Solr 7.0.1. When I tried to run TopicStream with the following
expression

String expression = "topic(checkpointCollection," +
 "myCollection" + "," +
"q=\"*:*\"," +
"fl=\"document_id,title,full_text\"," +
"id=\"myTopic\"," +
"rows=\"300\"," +
"initialCheckpoint=\"0\"," +
"wt=javabin)";

I got the error

java.io.IOException: Slices not found for checkpointCollection

Should I create a checkpointCollection on the cluster? And if yes, what is
the schema for this collection?

I used the topic stream instead of search to fetch all documents with no
docValues fields.

Thanks,
Mahmoud