Checking performance of plugins, queryParser, edismax, etc

2016-06-07 Thread Zheng Lin Edwin Yeo
Hi, Would like to find out, is there a way to check the performance of the queryParser and things like edismax in Solr? I have tried on the debug=true, but it only show general information like the time taken for query, highlight, etc. "process":{ "time":6397.0, "query":{

Re: Concern of large amount daily update

2016-06-07 Thread Erick Erickson
Atomic updates are really a full document index under the covers. What happens is that the stored fields are all read from disk, your updates overlain and the entire document is re-indexed. From Solr's persepctive, this is probably actually _more_ work than just having the document resent

Re: Solr 6 fail to index images

2016-06-07 Thread Alexandre Rafalovitch
How do you map all those fields right now to a PointMap? Seems the same issue there, so if you solved it for one, you solved it for another by using a regex to match field names. Specifically, RegexReplaceProcessorFactory inherits from FieldMutatingUpdateProcessorFactory, which means it can match

Re: Solr 6 fail to index images

2016-06-07 Thread Jeferson dos Anjos
The problem with this solution is that I need to know all possible fields that can generate this type of error. For example, TIFF images get different errors. = / 2016-06-06 15:13 GMT-03:00 Shawn Heisey : > On 6/6/2016 10:56 AM, Jeferson dos Anjos wrote: > > I'm trying to

Re: SolrCloud SolrNode stopping randomly for no reason

2016-06-07 Thread Shawn Heisey
On 6/7/2016 9:55 AM, Pablo Anzorena wrote: > Sorry for the poor details, but I didn't post the log files because > there was nothing out of the ordinary in the solr.log file, neither in > the solr-8984-console.log, nor in solr_gc.log. What log do you want me > to show you? solr.log.1 (which I

Re: Field Definitions Ignored

2016-06-07 Thread Shawn Heisey
On 6/7/2016 12:37 PM, Alan G Quan wrote: > Solr seems to ignore my field definitions in schema.xml. I have > defined many fields, each using the standard syntax, e.g.,: name="product_id" type="int" indexed="true" stored="true"/> These > fields are defined but not yet populated with data. Solr

Re: Index and Search file path

2016-06-07 Thread Shawn Heisey
On 6/7/2016 2:59 PM, sz wrote: > Hi all, Recently I run into issue indexing and searching path value. > For example, I have field with solr type "string". I tried to store a > file path with value '\\root\path1\path2'. After successfully > indexing, I checked via Solr Admin UI and see the value is

Index and Search file path

2016-06-07 Thread sz
Hi all, Recently I run into issue indexing and searching path value. For example, I have field with solr type "string". I tried to store a file path with value '\\root\path1\path2'. After successfully indexing, I checked via Solr Admin UI and see the value is 'root\\path1\\path2'.

start parameter for CloudSolrStream

2016-06-07 Thread Susmit Shukla
*sending with correct subject* Does solr streaming aggregation support pagination? Some documents seem to be skipped if I set "start" parameter for CloudSolrStream for a sharded collection. Thanks, Susmit

Re: Field Definitions Ignored

2016-06-07 Thread Susmit Shukla
Does solr streaming aggregation support pagination? Some documents seem to be skipped if I set "start" parameter for CloudSolrStream for a sharded collection. Thanks, Susmit

Re: Solutions for Multi-word Synonyms

2016-06-07 Thread Joe Lawson
I'm sorry I wasn't more specific, I meant we were hijacking the thread with the question, "Anyone used a different method of handling multi-term synonyms that isn't as global?" as the original thread was about getting synonym_edismax running. On Tue, Jun 7, 2016 at 2:24 PM, MaryJo Sminkey

Field Definitions Ignored

2016-06-07 Thread Alan G Quan
Solr seems to ignore my field definitions in schema.xml. I have defined many fields, each using the standard syntax, e.g.,: These fields are defined but not yet populated with data. Solr reads the schema.xml with no problem on startup, and the core using that schema is created successfully,

Solutions for Multi-word Synonyms

2016-06-07 Thread MaryJo Sminkey
> MaryJo you might want to start a new thread, I think we kinda hijacked this > one. Also if you are interested in tuning queries check out > http://splainer.io/ and https://www.quepid.com which are interactive tools > (both of which my company makes) to tune for search relevancy. > Okay I

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-07 Thread Joe Lawson
MaryJo you might want to start a new thread, I think we kinda hijacked this one. Also if you are interested in tuning queries check out http://splainer.io/ and https://www.quepid.com which are interactive tools (both of which my company makes) to tune for search relevancy. On Tue, Jun 7, 2016 at

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-07 Thread MaryJo Sminkey
I'm really thinking this just might not be the right tool for us, what we really need is a solution that works like the normal synonym filter does, just with proper multi-term support, so I can apply the synonyms only on certain fields (copied fields) that have their own, lower boost settings. The

Re: Solr Cloud and Multi-word Synonyms :: synonym_edismax parser

2016-06-07 Thread MaryJo Sminkey
Here's the issue I am still having with getting the right search relevancy with the synonym plugin in place. We typically have users searching on multiple terms, and we want matches across multiple terms, particularly those that appears as phrases, to appear higher than matches for the same term

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-06-07 Thread Satvinder Singh
Hi, Any updates on this?? Thanks Satvinder Singh Security Systems Engineer satvinder.si...@nc4.com 804.744.9630 x273 direct 703.989.8030 cell www.NC4.com

Re: SolrCloud SolrNode stopping randomly for no reason

2016-06-07 Thread Pablo Anzorena
Sorry for the poor details, but I didn't post the log files because there was nothing out of the ordinary in the solr.log file, neither in the solr-8984-console.log, nor in solr_gc.log. What log do you want me to show you? solr.log.1 (which I think it should be the last one) for example? You need

Re: find stores with sales of > $x in last 2 months ?

2016-06-07 Thread Erick Erickson
Have you looked at the stats component here? https://cwiki.apache.org/confluence/display/solr/The+Stats+Component As for the rolling time period, date math is your friend: https://cwiki.apache.org/confluence/display/solr/Working+with+Dates If working with date math in fq clauses, beware of using

Re: Streaming expressions malfunctioning

2016-06-07 Thread Joel Bernstein
I'm not a big user of curl when I test the http interface. Most of the time I use a browser and just send the request and view the results. This won't be feasible if you're streaming a large number of documents but it will work to quickly prototype expressions. I believe chrome will also handle

Re: Cloud Solr 5.3.1 + 6.0.1 cannot delete documents

2016-06-07 Thread Erick Erickson
OK, let's see the code you're using, including how you open your solrClient, how you commit, and how you show that the deleted doc is still there. This should be translatable into a test case. Like I said, this is tested in the unit tests, so it would be good to see the difference between the test

Re: Streaming expressions malfunctioning

2016-06-07 Thread jpereira
EDIT: I'll keep testing with other stream sources/decorators. So far only the search endpoint works both in the JAVA and cURL implementation Cheers -- View this message in context: http://lucene.472066.n3.nabble.com/Streaming-expressions-malfunctioning-tp4281016p4281019.html Sent from the

Streaming expressions malfunctioning

2016-06-07 Thread jpereira
Hi there, I just recently upgraded a SOLR instance to 6.0.1 version and while been trying the new streaming expressions feature I discovered what I think might be a bug in the HTTP interface. I tried to create two simple streaming expressions, as described below: innerJoin(

Re: Using Solr to index zip files

2016-06-07 Thread Alexandre Rafalovitch
I _think_ DataImportHandler could handle zip files with fixed level of nesting, but not read from HDFS. I don't think anything else in Solr will. So, doing it outside of Solr is probably best. Especially, since you would need to decide how you actually want to map these files (e.g. do you keep

RE: Using Solr to index zip files

2016-06-07 Thread BURN, James
Hi I think you'll need to do some unzipping of your zip files using an unzip application before you post to Solr. If you do this via a OS level batch script you can apply logic there to deal with nested zips. Then post your unzipped files to Solr via Curl. James -Original Message-

Re: Solr 5.4 Transaction

2016-06-07 Thread Shawn Heisey
On 6/7/2016 12:41 AM, Pithon Philippe wrote: > I have a question on Solr Transaction as relational databases The Solr > commit is not isolated for each client session, right? In my test > (source below) The commit in a session adds records of other sessions > is there a documentation on this? is

Re: Solr 6.1.x Release Date ??

2016-06-07 Thread Mikhail Khludnev
It's not an answer to your question, but have you found it in nightly build? On Tue, Jun 7, 2016 at 8:38 AM, Ramesh Shankar wrote: > Hi, > > Any idea of Solr 6.1.X Release Date ?? > > I am interested in the [subquery] transformer and like to know the release > date since

Re: Solr 5.4 Transaction

2016-06-07 Thread Mikhail Khludnev
Ah, it's easy. It reminds me the fact that ESB don't use transactions in favor of compansations. Allocate some txId, assign it on every doc then if you need to rollback submit deleteByQuery txId:<666>, and commit. Although, it provides phantom and dirty reads both, it's really cheap. If you need

Re: SolrCloud SolrNode stopping randomly for no reason

2016-06-07 Thread Shawn Heisey
On 6/7/2016 6:08 AM, Pablo Anzorena wrote: > I'am using SolrCloud with two nodes (5.2.1). One or two times a day the > node1 is stopping for no reason. I checked the logs but no errors are beign > logged. > I also have a standalone solr service in both nodes running in production > (we are doing

SolrCloud SolrNode stopping randomly for no reason

2016-06-07 Thread Pablo Anzorena
Hey, I'am using SolrCloud with two nodes (5.2.1). One or two times a day the node1 is stopping for no reason. I checked the logs but no errors are beign logged. I also have a standalone solr service in both nodes running in production (we are doing the migration to SolrCloud, that's why).

Re: Solr 5.4 Transaction

2016-06-07 Thread Upayavira
There is no equivalent to transactions in Lucene or Solr. A commit persists newly added documents to disk - all of them, regardless of which client sent them. A rollback discards all uncommitted documents, regardless of which client sent them, which renders a rollback pretty un-useful. If you

solrj SpellCheck request fails

2016-06-07 Thread Rohana Rajapakse
QueryResponse class's _spellResponse is not populated. The following two lines worked in Solr-4.x, but Solr-6/7 SolrClient server = new HttpSolrClient(); QueryResponse response = server.query(new SolrQuery("bus").setParam("spellcheck", "true")); //this returns results SpellCheckResponse scr =

Re: Solr 5.4 Transaction

2016-06-07 Thread Vincenzo D'Amore
Hi Pithon, I have to state beforehand that I worked with transactions on Solr 4.8.1, so I'm not sure the transactions are changed in Solr over time. And, I have to add, the transactions support not is very well documented, so most of what I know is based on my experience. Given that, Solr

Re: Solr 5.4 Transaction

2016-06-07 Thread Pithon Philippe
Thanks, my problem is for rollback transaction by user... if there is a problem in trycatch for a user, the rollback run for all users commit... Philippe 2016-06-07 9:23 GMT+02:00 Mikhail Khludnev : > Hello, > > That's how Lucene work underneath. > Just ad-hoc idea

Re: Solr 6 CDCR does not work

2016-06-07 Thread Uwe Reh
Hi Adam, maybe it's my poor English, but I'm confused. I've taken Renault's quote as a hint to activate autocommit on the target cluster. Or at least doing manually frequent commits, to see the replicated documents. Now you wrote disabling autocommit helps. Could you please clarify this

Re: Solr 5.4 Transaction

2016-06-07 Thread Mikhail Khludnev
Hello, That's how Lucene work underneath. Just ad-hoc idea you can have isolated per session indices and then add them altogether. Thinking deeper, we can consider per thread invertors which somehow isolated, perhaps something transactional might be built on top of them, but it's really deep

Solr 5.4 Transaction

2016-06-07 Thread Pithon Philippe
Hi, I have a question on Solr Transaction as relational databases The Solr commit is not isolated for each client session, right? In my test (source below) The commit in a session adds records of other sessions is there a documentation on this? is what's planned improvements on this? version 6,