Re: SOLR war for SOLR 6

2016-07-13 Thread Bharath Kumar
Hi All, Thanks so much for the response. We upgraded to SOLR 6.1 and moved to use jetty instead of deploying the solr war on jboss, till now it looks good. Danny, I too faced the same problem with the servlet-api, then fixed that, but still was getting 404 after that, so decided to deploy solr a

Frange query apostrophe issue

2016-07-13 Thread Bharath Kumar
Hi All, I have a query - {!frange l=1}sum(product(termfreq(content,'hasn't'),1)) where the content field has keyword - "hasn't" with apostrophe and when provided with this query i get the below SOLR exception:- "msg":"org.apache.solr.search.SyntaxError: Expected ',' at position 35 in 'sum(product

Re: Query optimization

2016-07-13 Thread Midas A
Hi , One more thing i would like to add here is we build facet queries over dynamic fields so my question is a) Is there any harm of using docValues true with dynamic fields. b) Other suggestion that we can implement to optimize this query my index size is 8GB and query is taking more tha 3 seco

solrcloud so many connections

2016-07-13 Thread Kent Mu
Hi friends! We are using Solrj 4.9.1 to connect to a Zookeeper. and the solr server version is 4.9.0 We are currently using CloudSolrServer as a singleton, I believe that solrj to zookeeper is a TCP connection, and zookeeper to solrcloud internal is actually a httpconnection. we use the zabbix to

Re: How to speed up field collapsing on large number of groups

2016-07-13 Thread Jichi Guo
Hi everyone, Is it possible to optimize collapsing on large index through parallelization without sharding? Or can we conclude that sharding is currently the only approach to geometrically speedup slow collapsing queries? I tried manually parallelizing CollapsingQParserPlugin by diff

Re: Query optimization

2016-07-13 Thread Erick Erickson
DocValues are now the preferred mechanism whenever you need to sort, facet or group. It'll make your on-disk index bigger, but the on-disk structure would have been built in Java's memory if you didn't use DocValues whereas if you do it's MMap'd. So overall, use DocValues by preference. Best,

Re: Update index

2016-07-13 Thread Erick Erickson
bq: dont have attribute modified just date_creation Well, assuming that your date_creation is set whenever you insert a record, just change the WHERE clause to WHERE date_creation > ... But that doesn't help with updated records unless the date_creation is updated every time a field in an ex

Re: solr.textfield in solr 6

2016-07-13 Thread Erick Erickson
You have to show us exactly what you're doing when you add and remove "solr.TextField". This error _usually_ means that your solrconfig.xml file for some request handler has text and thus when you send a query in without a field qualifier it is searched for in a "text" field. I suspect that what y

RE: Strip HTML Tags and Store

2016-07-13 Thread Kalpana
Thanks for your reply. I have attached my config. I wanted the field health_content_t to be stripped off of Html and stored. Should the below lines be placed above the Update handler and also what do I do to update the handler? From: Markus Jelsma-2 [via Lucene] [mailto:ml-node+s472066n42870

RE: POST options (UNCLASSIFIED)

2016-07-13 Thread Markus Jelsma
Hello - this is the 101 documentation on indexing: https://cwiki.apache.org/confluence/display/solr/Indexing+and+Basic+Data+Operations ..and this describes stuff on indexing stuff with POST etc: https://cwiki.apache.org/confluence/display/solr/Uploading+Data+with+Index+Handlers ..and things that

RE: Strip HTML Tags and Store

2016-07-13 Thread Markus Jelsma
Hello - just as mentioned in the thread: > Add to your solrconfig: > > > > features > > > > And point your update handler config to this html-strip-features update processor chain. M. -Original message- > From:Kalpana > Sent: Wednesday 13th

RE: Strip HTML Tags and Store

2016-07-13 Thread Kalpana
Hello I am trying to do something similar, I want to strip the html tags before being stored. Where do I add this code in Solrconfig.xml? which section? Thanks much Kalpana -- View this message in context: http://lucene.472066.n3.nabble.com/Strip-HTML-Tags-and-Store-tp4067208p4287064.html Sen

Re: solrcloud consumes more time than solr when write index

2016-07-13 Thread Jeff Wartes
There’s another thread on this list going on right now touching on the need to optimize, might be worth reading. http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201607.mbox/%3c61f3d01f-c3ef-2d71-7112-6a88b0145...@elyograg.org%3E On 7/12/16, 6:25 PM, "Kent Mu" wrote: >Dear Mr. Wartes,

Re: Fwd: how collect a list of damaged file they can not be indexed

2016-07-13 Thread kostali hassan
thank you Rick the section logging of solr Admin show only name of Error and caused by Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to read content Processing Document # 1 at org.apache.sol

solr.textfield in solr 6

2016-07-13 Thread sara hajili
hi i switched from solr 5.3 to solr 6.1.0. in my schema file i have a solr.textField now when i start solr and add core . i get this exception org.apache.solr.common.SolrException: undefined field text at org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1300)

Re: Update index

2016-07-13 Thread kostali hassan
I try to set deltaquery > deltaImportQuery="SELECT * from users WHERE id='${dih.delta.id}'" > deltaQuery="SELECT id FROM users WHERE modified > > '${dataimporter.last_index_time}'" But the database who i try to index dont have attribute modified just date_creation 2016-07-13 14:11 GMT+01:00 J

RE: Update index

2016-07-13 Thread Jamal, Sarfaraz
Hi Kostali, I would look at the Delta Queries - Sas -Original Message- From: kostali hassan [mailto:med.has.kost...@gmail.com] Sent: Wednesday, July 13, 2016 5:17 AM To: solr-user@lucene.apache.org Subject: Update index I am using solr 5.4 1 to index sql database with data import handl

Re: Query optimization

2016-07-13 Thread sara hajili
as i know when you use docValue=true solr when indexing doc, solr although store doc and docValue=true field in memory.to use that in facet query and sort query result. so maybe use a lot docvalue=true use a lot memory of ur system. but use it in logical way.can make better query response time On

POST options (UNCLASSIFIED)

2016-07-13 Thread Musshorn, Kris T CTR USARMY RDECOM ARL (US)
CLASSIFICATION: UNCLASSIFIED I am looking for documentation of every option you can set when indexing a core with POST.. Anyone seen such a document? Thanks, Kris ~~ Kris T. Musshorn FileMaker Developer - Contractor - Catapult Technology Inc. US Army Research Lab

Re: Query optimization

2016-07-13 Thread Midas A
Is there any draw back of using docValues=true ? On Wed, Jul 13, 2016 at 2:28 PM, sara hajili wrote: > Hi. > Facet query take a long time.you vcan use group query. > Or in fileds in schema that you run facet query on that filed. > Set doc value=true. > To get better answer.in quick time. > On Ju

Update index

2016-07-13 Thread kostali hassan
I am using solr 5.4 1 to index sql database with data import handler. I am looking for update index automatically when the database is modified or insert in it new value.

Re: Query optimization

2016-07-13 Thread sara hajili
Hi. Facet query take a long time.you vcan use group query. Or in fileds in schema that you run facet query on that filed. Set doc value=true. To get better answer.in quick time. On Jul 13, 2016 11:54 AM, "Midas A" wrote: > http:// > > #:8983/solr/prod/select?q=id_path_ids:166&fq=sort_price:[0

Re: solr server heap out

2016-07-13 Thread sara hajili
Hi .u can monitor heap size by jvm. Run solr and open jvisualvm in "javahome/bin " Monitor your heap size that solr use. You can create heap image and check objects that are in heap.and check why you get heap size error. On Jul 13, 2016 9:55 AM, "Midas A" wrote: > Hi, > I frequently getting solr

Query optimization

2016-07-13 Thread Midas A
http:// #:8983/solr/prod/select?q=id_path_ids:166&fq=sort_price:[0%20TO%20*]&fq=status:A&fq=company_status:A&facet=true&facet.mincount=1&facet.field=show_meta_id&facet.field=show_brand&facet.field=product_amount_available&facet.field=by_processor&facet.field=by_system_memory&facet.field=by_scre