shards are going down frequently

2017-06-14 Thread ramesh.pallapo...@fedex.com
Hi All, I am using solr-4.10.4 and our shards are frequently going down. When ever it goes down , we are deleting the data folder and restart server it is recovering data from replica. Any idea why shards are going down? Any suggestions ? Any defect in 4.10.4 version? - Thanks, Ramesh.

Re: Issue with highlighter

2017-06-14 Thread David Smiley
> Beware of NOT plus OR in a search. That will certainly produce no highlights. (eg test -results when default op is OR) Seems like a bug to me; the default operator shouldn't matter in that case I think since there is only one clause that has no BooleanQuery.Occur operator and thus the OR/AND

Re: Reg:- StrField Analyzer Issue

2017-06-14 Thread @Nandan@
Thanks Erick For best Explanation. The issue with My data is as below. :- I have few data on my books table. cqlsh:nandan> select * from books; id | author | date | isbn | solr_query | title

Re: Reg:- StrField Analyzer Issue

2017-06-14 Thread Erick Erickson
Back up a bit and tell us why you want to use StrField, because what you're trying to do is somewhat confused. First of all, StrFields are totally unanalyzed. So defining an as part of a StrField type definition is totally unsupported. I'm a bit surprised that Solr even starts up. Second, you

RE: Issue with highlighter

2017-06-14 Thread Phil Scadden
Just had similar issue - works for some, not others. First thing to look at is hl.maxAnalyzedChars is the query. The default is quite small. Since many of my documents are large PDF files, I opted to use storeOffsetsWithPositions="true" termVectors="true" on the field I was searching on. This

CSV output

2017-06-14 Thread Phil Scadden
If I try /getsolr? fl=id,title,datasource,score=true=9000=unified=Wainui-1=AND=csv The response I get is: id,title,datasource,scoreW:\PR_Reports\OCR\PR869.pdf,,Petroleum Reports,8.233313W:\PR_Reports\OCR\PR3440.pdf,,Petroleum Reports,8.217836W:\PR_Reports\OCR\PR4313.pdf,,Petroleum

Re: Multiple hashJoin or innerJoin

2017-06-14 Thread Zheng Lin Edwin Yeo
I have found that this is possible, but currently I have problems if the field name to join in all the 3 collections are different. For example, if in "people" collection, it is called personId, and in "pets" collection, it is called petsId. But in "collectionId", it is called collectionName, but

Re: Solr 6: how to get SortedSetDocValues from index by field name

2017-06-14 Thread Tomas Fernandez Lobbe
Hi, To respond your first question: “How do I get SortedSetDocValues from index by field name?”, DocValues.getSortedSet(LeafReader reader, String field) (which is what you want to use to assert the existence and type of the DV) will give you the dv instance for a single leaf reader. In general,

Reg:- StrField Analyzer Issue

2017-06-14 Thread @Nandan@
Hi , I am using Apache Solr for do advanced searching with my Big Data. When I am creating Solr core , then by default for text field , it is coming as TextField data type and class. Can you please tell me how to change TextField to StrField. My table contains record into English as well as

Re: Swapping indexes on disk

2017-06-14 Thread Erick Erickson
Why not just use the replication API and fetchindex? See: https://cwiki.apache.org/confluence/display/solr/Index+Replication#IndexReplication-HTTPAPICommandsfortheReplicationHandler. It's not entirely obvious from the writeup, but you can specify masterUrl as part of the command

Re: Issue with highlighter

2017-06-14 Thread Erick Erickson
If the default operator is OR, then you're just matching on the "like" word and it's being properly highlighted. If you're saying that doc 286 (or whatever) has both "something" and "like" in the content and you expect to find them both, try increasing the number of snippets returned. Otherwise

Re: Swapping indexes on disk

2017-06-14 Thread Mike Lissner
I figured Solr would have a native system built in, but since we don't use it already, I didn't want to learn all of its ins and outs just for this disk situation. Ditto, essentially, applies for the swapping strategy. We don't have a Solr expert, just me, a generalist, and sorting out these

Issue with highlighter

2017-06-14 Thread Ali Husain
Hi, I think I've found a bug with the highlighter. I search for the word "something" and I get an empty highlighting response for all the documents that are returned shown below. The fields that I am searching over are text_en, the highlighter works for a lot of queries. I have no

Re: Can't upload pdf file to example Core

2017-06-14 Thread Susheel Kumar
Try using the curl command directly on terminal/console and it will work. I just tried on 6.6 on a mac. The upload thru UI would not work for PDF's unless more parameters are provided. The upload thru UI though works directly for XML/JSON files etc. curl '

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Susheel Kumar
Created JIRA https://issues.apache.org/jira/browse/SOLR-10890 Thank you. On Wed, Jun 14, 2017 at 1:59 PM, Joel Bernstein wrote: > Let's create a jira for this. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Wed, Jun 14, 2017 at 12:26 PM, Susheel Kumar

Re: Swapping indexes on disk

2017-06-14 Thread Chris Ulicny
Are you physically swapping the disks to introduce the new index? Or having both disks mounted at the same time? If the disks are simultaneously available, can you just swap the cores and then delete the core on the old disk?

Re: Swapping indexes on disk

2017-06-14 Thread David Hastings
I dont have an answer to why the folder got cleared, however i am wondering why you arent using basic replication to do this exact same thing, since solr will natively take care of all this for you with no interruption to the user and no stop/start routines etc. On Wed, Jun 14, 2017 at 2:26 PM,

Can't upload pdf file to example Core

2017-06-14 Thread Vasiliy Boldyrev
Hello, I used Apache Solr™ version 6.6.0 but can't upload pdf file to Core Instruction and Example has been get from https://cwiki.apache.org/confluence/display/solr/Uploading+Data+with+Solr+Cell+using+Apache+Tika Add to solconfig.xml additional path to /dist/ and /contrib/extraction jar

Swapping indexes on disk

2017-06-14 Thread Mike Lissner
We are replacing a drive mounted at /old with one mounted at /new. Our index currently lives on /old, and our plan was to: 1. Create a new index on /new 2. Reindex from our database so that the new index on /new is properly populated. 3. Stop solr. 4. Symlink /old to /new (Solr now looks for the

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Joel Bernstein
Let's create a jira for this. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Jun 14, 2017 at 12:26 PM, Susheel Kumar wrote: > Thanks, Yury. Indeed that is the issue. > > Joel, is that something expected behavior or should i create a JIRA? > > Thanks, > Susheel >

Re: Out of Memory Errors

2017-06-14 Thread Susheel Kumar
The attachment will not come thru. Can you upload thru dropbox / other sharing sites etc. On Wed, Jun 14, 2017 at 12:41 PM, Satya Marivada wrote: > Susheel, Please see attached. There heap towards the end of graph has > spiked > > > > On Wed, Jun 14, 2017 at 11:46

Re: Out of Memory Errors

2017-06-14 Thread Satya Marivada
Susheel, Please see attached. There heap towards the end of graph has spiked On Wed, Jun 14, 2017 at 11:46 AM Susheel Kumar wrote: > You may have gc logs saved when OOM happened. Can you draw it in GC Viewer > or so and share. > > Thnx > > On Wed, Jun 14, 2017 at 11:26

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Susheel Kumar
Thanks, Yury. Indeed that is the issue. Joel, is that something expected behavior or should i create a JIRA? Thanks, Susheel On Wed, Jun 14, 2017 at 12:16 PM, Yury Kats wrote: > I have seen this with very few indexed documents and multiple shards. > In such a

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Yury Kats
I have seen this with very few indexed documents and multiple shards. In such a case, some shards may not have any documents, and when the query happens to hit such a shard, it does not find the fields it's looking for and turns this into "column not found". If you resubmit the query and hit a

Re: Out of Memory Errors

2017-06-14 Thread Susheel Kumar
You may have gc logs saved when OOM happened. Can you draw it in GC Viewer or so and share. Thnx On Wed, Jun 14, 2017 at 11:26 AM, Satya Marivada wrote: > Hi, > > I am getting Out of Memory Errors after a while on solr-6.3.0. > The

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Susheel Kumar
Also i tried with both docValues and non docValue fields/column. On Wed, Jun 14, 2017 at 11:42 AM, Susheel Kumar wrote: > Yes, Joel. Kind of every other command runs into this issue. I just > executed below queries and 3 of them failed while 1 succeeded. I just > have

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Susheel Kumar
Yes, Joel. Kind of every other command runs into this issue. I just executed below queries and 3 of them failed while 1 succeeded. I just have 6 documents ingested and no further indexing going on. Let me know what else to look for the state of index. ➜ solr-6.6.0 curl --data-urlencode

Out of Memory Errors

2017-06-14 Thread Satya Marivada
Hi, I am getting Out of Memory Errors after a while on solr-6.3.0. The -XX:OnOutOfMemoryError=/sanfs/mnt/vol01/solr/solr-6.3.0/bin/oom_solr.sh just kills the jvm right after. Using Jconsole, I see the nice triangle pattern, where it uses the heap and being reclaimed back. The heap size is set at

Re: Parallel SQL - column not found intermittent error

2017-06-14 Thread Joel Bernstein
Are you able to reproduce the error, or is it just appearing in the logs? Do you know the state of index when it's occurring? Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Jun 14, 2017 at 11:09 AM, Susheel Kumar wrote: > I have setup Solr-6.6-0 on local (local ZK

Multiple hashJoin or innerJoin

2017-06-14 Thread Zheng Lin Edwin Yeo
Hi, I'm using Solr 6.5.1. Is it possible to have multiple hashJoin or innerJoin in the query? An example will be something like this for innerJoin: innerJoin(innerJoin( search(people, q=*:*, fl="personId,name", sort="personId asc"), search(pets, q=type:cat, fl="personId,petName",

Parallel SQL - column not found intermittent error

2017-06-14 Thread Susheel Kumar
I have setup Solr-6.6-0 on local (local ZK and Solr) and then on servers (3 ZK and 2 machines, 2 shards) and on both the env, i see this intermittent error "column not found". The same query works sometime and other time fails. Is that a bug or am I missing something... Console === ->

Solr NLS custom query parser

2017-06-14 Thread aruninfo100
Hi, I am trying to configure NLP search with Solr. I am using OpenNLP for the same.I am able to index the documents and extract named entities and POS using OpenNLP-UIMA support and also by using a UIMA Update request processor chain.But I am not able to write a query parser for the same.Is there

install solr service possible bug

2017-06-14 Thread Susheel Kumar
Hi, Can anyone confirm if this "service --version" command works ? For me to install in SUSE distribution, "service --version" commands always fail and abort the solr installation with printing the error "Script requires the 'service' command" To make it work, i had to change "service

Re: Multi tenant setup

2017-06-14 Thread Susheel Kumar
I'll suggest to raise a JIRA and link to https://issues.apache.org/jira/browse/SOLR-7759 but before that see if updating the settings in Solrcofig for statsCache as described works here https://issues.apache.org/jira/browse/SOLR-1632 Thanks, Susheel On Tue, Jun 13, 2017 at 5:16 PM, Zisis T.

Re: Setting q parameter for fetch Streaming expression

2017-06-14 Thread Zheng Lin Edwin Yeo
Hi Joel, Thanks for your reply. For the "having" expression, it says that it requires a BooleanEvaluator. Which means I can only use it to filter if there is Boolean Evaluator, and not if it is just a normal query? And yes, it will be good to support filter queries with fetch. Should I put that