Re: Wildcard-Search Solr 3.5.0

2012-05-23 Thread Dmitry Kan
with the umlauts but I have no idea what... -Original Message- From: Dmitry Kan [mailto:dmitry@gmail.com] Sent: Mittwoch, 23. Mai 2012 13:36 To: solr-user@lucene.apache.org Subject: Re: Wildcard-Search Solr 3.5.0 what about bä*-hits? -- Dmitry On Wed, May 23, 2012 at 2

Re: Throws Null Pointer Exception Even Query is Correct in solr

2012-05-23 Thread Dmitry Kan
from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan

Re: indexing unstructured text (tweets)

2012-05-28 Thread Dmitry Kan
that before getting to Solr, I might need to use another Apache tool called Tika. Can anybody provide a brief explaination about the general picture? Can I index my tweets with Solr? Or do I need to put also Tika in my pipeline? Best regards, Giovanni Gherdovich -- Regards, Dmitry Kan

Re: Sorting performance

2012-06-08 Thread Dmitry Kan
from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan

Re: Building a heat map from geo data in index

2012-06-11 Thread Dmitry Kan
so a heat map could be constructed. Any other thoughts on this would be greatly appreciated, right now I am really just fishing for some ideas. -- Regards, Dmitry Kan

Re: Writing index files that have the right owner

2012-06-16 Thread Dmitry Kan
written to the index directories should be? Thanks, Mike -- Regards, Dmitry Kan

Re: write.lock

2012-06-21 Thread Dmitry Kan
as to what is causing the locks, and what config changes that I can make in order to prevent the lock? Any help would be very appreciated! -- Chris -- Regards, Dmitry Kan

Re: Multiple query hit for one query

2012-06-25 Thread Dmitry Kan
/Multiple-query-hit-for-one-query-tp3990466.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan

Re: Autocomplete using facets

2012-06-26 Thread Dmitry Kan
logic on SOLR side. Any suggestion ?? Regards, Ugo. -- Regards, Dmitry Kan

Re: Using custom user-defined caches to store user app data while indexing

2012-06-30 Thread Dmitry Kan
the UpdateRequestProcessorFactory, I do not arrive to access this cache. What would be the method to read/write into a user defined sorl cache while indexing? How can I access the current SolrIndexSearcher from my code? Are there any other solutions that I should look at? Thanks! Iana -- Regards, Dmitry Kan

Re: how do I trash a whole index and start over?

2012-06-30 Thread Dmitry Kan
last indexing, and I'd like the changes to be taken into account. Cheers, Giovanni -- Regards, Dmitry Kan

Re: index writer in searchComponent

2012-07-01 Thread Dmitry Kan
to the index _after_ searching the index? I.e accessing the indexWriter? thank you Peyman -- Regards, Dmitry Kan

Re: index writer in searchComponent

2012-07-02 Thread Dmitry Kan
handler mechanism was the (RESTFUL) interface between user query and the index/s. thank you Peyman On Jul 1, 2012, at 10:11 AM, Dmitry Kan wrote: Hi Peyman, Could you just use solrj api for this purpose? That is, ask via solrj api 1-2 and perform 3 if entity (assuming you mean document

Re: Multi-thread UpdateProcessor

2012-07-06 Thread Dmitry Kan
...@griddynamics.com -- Sincerely yours Mikhail Khludnev Tech Lead Grid Dynamics http://www.griddynamics.com mkhlud...@griddynamics.com -- Regards, Dmitry Kan

Re: Can we retrieve deleted records before optimized

2012-10-16 Thread Dmitry Kan
to related segment index files, then delete them from disk after optimize. Now, the question is that before optimized, can we retrieve those deleted records? if yes, how to? thanks a lot! Best Wishes Lames -- Regards, Dmitry Kan

Re: Can we retrieve deleted records before optimized

2012-10-17 Thread Dmitry Kan
in the cheaper disk. wanna to know is there any other solution for such kind of problem. e.g. move the index files directly? thanks a lot! On Wed, Oct 17, 2012 at 12:31 AM, Dmitry Kan dmitry@gmail.com wrote: Hello, One approach (not a solrish one, but still) would be to use Lucene API

Re: Apache Solr Quiz

2012-10-19 Thread Dmitry Kan
Thanks for the quiz. It is refreshing. Do you plan on covering other parts of SOLR management, like various handlers, scoring, plugins, sharding etc? Dmitry On Wed, Oct 17, 2012 at 7:12 PM, Yulia Crowder yulia.crow...@gmail.comwrote: I love Solr! I have searched for a quiz about Solr and

Re: Solr3.6 DeleteByQuery with negated field not working

2012-10-22 Thread Dmitry Kan
. And no Error in the Solr-Log. I hope someone can help me ... I dont want do this manually :) Regards, Markus -- Regards, Dmitry Kan

hot shard concept

2012-10-29 Thread Dmitry Kan
complicated operationally for us. Please let me know, if you need more details or if the problem isn't clear enough. Thanks. [1] http://blog.foofactory.fi/2008/01/regenerating-equally-sized-shards-from.html [2] https://github.com/HON-Khresmoi/hash-based-index-splitter -- Regards, Dmitry Kan

Re: hot shard concept

2012-10-30 Thread Dmitry Kan
, Oct 29, 2012 at 7:17 PM, Shawn Heisey s...@elyograg.org wrote: On 10/29/2012 7:55 AM, Dmitry Kan wrote: Hi everyone, at this year's Berlin Buzz words conference someone (sematext?) have described a technique of a hot shard. The idea is to have a slim shard to maximize the update throughput

Re: Http 500/503 Responses from Solr

2012-10-30 Thread Dmitry Kan
to change in in the solrconfig.xml ? - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/Http-500-503-Responses-from-Solr-tp4016948.html Sent from the Solr - User mailing list archive at Nabble.com. -- Regards, Dmitry Kan

Re: hot shard concept

2012-11-01 Thread Dmitry Kan
first post). Dmitry On Wed, Oct 31, 2012 at 7:50 AM, Shawn Heisey s...@elyograg.org wrote: On 10/30/2012 5:05 AM, Dmitry Kan wrote: Hi Shawn, Thanks for sharing your story. Let me get it right: How do you keep the incremental shard slim enough over time, do you periodically redistribute

Re: how to deploy customization in solr that requires dependency

2013-03-18 Thread Dmitry Kan
Hi, See here, might help: http://wiki.apache.org/solr/SolrPlugins#How_to_Load_Plugins We don't use multicore functionality of SOLR, so we decided to bundle SOLR dependencies into the war file of the solr web app. Regards, Dmitry On Mon, Mar 18, 2013 at 7:47 PM, Gian Maria Ricci

Re: Prediction About Index Sizes of Solr

2013-04-08 Thread Dmitry Kan
Interesting bit, thanks* *Rafał! On Mon, Apr 8, 2013 at 12:54 PM, Rafał Kuć r@solr.pl wrote: Hello! Let me answer the first part of your question. Please have a look at https://svn.apache.org/repos/asf/lucene/dev/trunk/dev-tools/size-estimator-lucene-solr.xls It should help you make

solr 3.4: memory leak?

2013-04-11 Thread Dmitry Kan
Hello list, We are on solr 3.4. After running a shard for some time (1w or so), we sometimes need to shut it down for changing schema or move it around. We have noticed the following memory leak related messages in the tomcat logs. Could this be a sign of us doing something wrong or solr. Or can

Re: solr 3.4: memory leak?

2013-04-13 Thread Dmitry Kan
stale. So we prefer actually (re)deploying via tomcat restart. Thanks, Dmitry On Thu, Apr 11, 2013 at 6:01 PM, Andre Bois-Crettez andre.b...@kelkoo.comwrote: On 04/11/2013 08:49 AM, Dmitry Kan wrote: SEVERE: The web application [/solr] appears to have started a thread named

Re: SolR InvalidTokenOffsetsException with Highlighter and Synonyms

2013-04-15 Thread Dmitry Kan
Hi, Does it work well, if you remove synonyms with spaces in them, like eighty six ? Dmitry On Fri, Apr 5, 2013 at 3:43 AM, juancesarvillalba juancesarvilla...@gmail.com wrote: Hi I saw some similar problems in other threads but I think that this is a little different and couldn't get any

Re: How do I recover the position and offset a highlight for solr (4.1/4.2)?

2013-04-15 Thread Dmitry Kan
Hi, They are available in the HighlighterComponent. You will need to read the source code. Dmitry On Wed, Mar 27, 2013 at 4:28 PM, Skealler Nametic bchaillou...@gmail.comwrote: Hi, I would like to retrieve the position and offset of each highlighting found. I searched on the internet,

Re: SolR InvalidTokenOffsetsException with Highlighter and Synonyms

2013-04-15 Thread Dmitry Kan
Do you use the standard highlighter or FastVectorHighlighter / PhraseHighlighter ? Do you use hl.highlightMultiTermhttp://wiki.apache.org/solr/HighlightingParameters#hl.highlightMultiTerm option? On Tue, Apr 16, 2013 at 2:51 AM, juancesarvillalba juancesarvilla...@gmail.com wrote: Hi,

Re: SolR InvalidTokenOffsetsException with Highlighter and Synonyms

2013-04-16 Thread Dmitry Kan
Could be a bug in the higlighter. But before claiming that, I would still play around different options, like hl.fragSize, hl.highlightMultiTerm. Also, have you considered storing synonyms in the index? On Tue, Apr 16, 2013 at 9:42 AM, juancesarvillalba juancesarvilla...@gmail.com wrote:

Re: first time with new keyword, solr take to much time to give the result

2013-04-16 Thread Dmitry Kan
Hi, Things to google ;) 1. warmup queries 2. solr cache How much RAM does you index take now? Dmitry On Tue, Apr 16, 2013 at 1:22 PM, Montu v Boda montu.b...@highqsolutions.com wrote: Hi, when we search with any new keyword at first time then solr 4.2.1 take to much time to give the

Re: first time with new keyword, solr take to much time to give the result

2013-04-16 Thread Dmitry Kan
In the admin page you can monitor the cache parameters, like eviction. If you cache evicts too much, you can increase its capacity. NOTE: this will affect on RAM consumption, so you would need to change the tomcat config too. On Tue, Apr 16, 2013 at 2:08 PM, Montu v Boda

Re: SolR InvalidTokenOffsetsException with Highlighter and Synonyms

2013-04-17 Thread Dmitry Kan
Hi, If you are not afraid of looking into the code, you could trace and possibly fix this. Remember to commit a patch :) Another (easier?) way is to compile a repeatable test and file a Jira. Dmitry On Tue, Apr 16, 2013 at 4:12 PM, juancesarvillalba juancesarvilla...@gmail.com wrote: Hi,

Re: Rejecting document already existing in different shard.

2013-04-17 Thread Dmitry Kan
Hi, Although we use logical sharding, there are cases in our environment as you described. We handle them manually: 0. prepare new version of a document 1. remove the old version of the document 2. post it and commit With logical sharding it is relatively easy, but we do need to store location

Re: shard query return 500 on large data set

2013-04-19 Thread Dmitry Kan
Can you instead use paging mechanism? On Thu, Apr 18, 2013 at 8:03 PM, Jie Sun jsun5...@yahoo.com wrote: Hi - when I execute a shard query like:

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-23 Thread Dmitry Kan
Hello Walter, Have you had a chance to get something working with graphite, codahale and solr? Has anyone else tried these tools with Solr 3.x family? How much work is it to set things up? We have tried zabbix in the past. Even though it required lots of up front investment on configuration, it

Re: Average Solr Server Spec.

2013-04-23 Thread Dmitry Kan
Walter, Can you share the document count / index size for this shard? Even though these are not decisive parameters, but suit the data points comparison :) On Tue, Apr 9, 2013 at 9:00 PM, Walter Underwood wun...@wunderwood.orgwrote: We mostly run m1.xlarge with an 8GB heap. --wunder On Apr

Fwd: [solr 3.4] anomaly during distributed facet query with 102 shards

2013-04-24 Thread Dmitry Kan
Hello list, We deal with an anomaly when doing a distributed facet query against 102 shards. The problem manifests itself in both the frontend solr (router) and a shard. Each time the request is executed, always different shard is affected (at random, hence the anomaly). The query is:

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Dmitry Kan
www.flax.co.uk On 23 Apr 2013, at 07:40, Dmitry Kan wrote: Hello Walter, Have you had a chance to get something working with graphite, codahale and solr? Has anyone else tried these tools with Solr 3.x family? How much work is it to set things up? We have tried zabbix in the past. Even

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-25 Thread Dmitry Kan
We are very much interested in 3.4. On Thu, Apr 25, 2013 at 12:55 PM, Alan Woodward a...@flax.co.uk wrote: This is on top of trunk at the moment, but would be back ported to 4.4 if there was interest. Alan Woodward www.flax.co.uk On 25 Apr 2013, at 10:32, Dmitry Kan wrote: Hi Alan

Re: [solr 3.4] anomaly during distributed facet query with 102 shards

2013-04-25 Thread Dmitry Kan
Are there any distrib facet gurus on the list? I would be ready to try sensible ideas, including on the source code level, if someone of you could give me a hand. Dmitry On Wed, Apr 24, 2013 at 3:08 PM, Dmitry Kan solrexp...@gmail.com wrote: Hello list, We deal with an anomaly when doing

Re: Solr maven install - authorization problem when downloading maven.restlet.org dependencies

2013-04-25 Thread Dmitry Kan
Building the solr 4.2.1 worked fine for me. Here is the relevant portion of ivy-settings.xml that I had to change: chain name=default returnFirst=true checkmodified=true changingPattern=.*SNAPSHOT resolver ref=local/ !-- resolver ref=local-maven-2 / -- resolver ref=main/

Re: [solr 3.4] anomaly during distributed facet query with 102 shards

2013-04-25 Thread Dmitry Kan
Thanks, Yonik. Yes, I supposed that. We are in the pre-release phase, so we have the pressure. Solr 3.4. Would setting up 4.2.1 router work with 3.4 shards? On 25 Apr 2013 17:11, Yonik Seeley yo...@lucidworks.com wrote: On Thu, Apr 25, 2013 at 8:32 AM, Dmitry Kan solrexp...@gmail.com wrote

Re: Solr metrics in Codahale metrics and Graphite?

2013-04-26 Thread Dmitry Kan
, Shawn Heisey s...@elyograg.org wrote: On 4/25/2013 6:30 AM, Dmitry Kan wrote: We are very much interested in 3.4. On Thu, Apr 25, 2013 at 12:55 PM, Alan Woodward a...@flax.co.uk wrote: This is on top of trunk at the moment, but would be back ported to 4.4 if there was interest

Re: [solr 3.4] anomaly during distributed facet query with 102 shards

2013-04-26 Thread Dmitry Kan
Hi, 1. Ruled out possibility to test 4.2.1 router against 3.4 shard farm for obvious reasons (java.lang.RuntimeException: Invalid version (expected 2, but 60) or the data in not in 'javabin' format). 2. Tried jetty, but same result. On Thu, Apr 25, 2013 at 5:16 PM, Dmitry Kan solrexp

facet.offset issue (previosly: [solr 3.4] anomaly during distributed facet query with 102 shards)

2013-04-26 Thread Dmitry Kan
Hi list, We have encountered a weird bug related to the facet.offset parameter. In short: the more general query is, that generates lots of hits, the higher the risk of the facet.offset parameter to stop working. In more detail: 1. Since getting all facets we need (facet.limit=1000) from around

Re: Solr performance issues for simple query - q=*:* with start and rows

2013-04-29 Thread Dmitry Kan
Jan, Would the same distrib=false help for distributed faceting? We are running into a similar issue with facet paging. Dmitry On Mon, Apr 29, 2013 at 11:58 AM, Jan Høydahl jan@cominvent.com wrote: Hi, How many shards do you have? This is a known issue with deep paging with multi

Re: Solr performance issues for simple query - q=*:* with start and rows

2013-04-29 Thread Dmitry Kan
Abhishek, There is a wiki regarding this: http://wiki.apache.org/solr/CommonQueryParameters search pageDoc and pageScore. On Mon, Apr 29, 2013 at 1:17 PM, Abhishek Sanoujam abhi.sanou...@gmail.comwrote: We have a single shard, and all the data is in a single box only. Definitely looks like

Re: Solr performance issues for simple query - q=*:* with start and rows

2013-04-29 Thread Dmitry Kan
, I bet it would also help performance. Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Apr 29, 2013 at 9:06 AM, Dmitry Kan solrexp...@gmail.com

Re: facet.offset issue (previosly: [solr 3.4] anomaly during distributed facet query with 102 shards)

2013-04-30 Thread Dmitry Kan
It is logical to use facet pagination for us, if it would work. It just doesn't, probably due the data amount we store and imposed RAM settings. On Tue, Apr 30, 2013 at 10:39 AM, Toke Eskildsen t...@statsbiblioteket.dkwrote: On Mon, 2013-04-29 at 18:22 +0200, Dmitry Kan wrote: Does

socket write error

2013-05-02 Thread Dmitry Kan
Hi guys! We have solr router and shards. I see this in jetty log on the router: May 02, 2013 1:30:22 PM org.apache.commons.httpclient.HttpMethodDirector executeWithRetry INFO: I/O exception (java.net.SocketException) caught when processing request: Connection reset by peer: socket write error

Re: socket write error

2013-05-02 Thread Dmitry Kan
, May 2, 2013 at 1:57 PM, Dmitry Kan solrexp...@gmail.com wrote: Hi guys! We have solr router and shards. I see this in jetty log on the router: May 02, 2013 1:30:22 PM org.apache.commons.httpclient.HttpMethodDirector executeWithRetry INFO: I/O exception (java.net.SocketException) caught when

Re: socket write error

2013-05-02 Thread Dmitry Kan
. -- Patanachai On 05/02/2013 05:05 AM, Dmitry Kan wrote: After some searching around, I see this: http://search-lucene.com/m/**ErEZUl7P5f2/%2522socket+write+** error%2522subj=Long+list+of+**shards+breaks+solrj+queryhttp://search-lucene.com/m/ErEZUl7P5f2/%2522socket+write+error%2522subj=Long+list

Re: socket write error

2013-05-03 Thread Dmitry Kan
returning results to the router? Dmitry On Fri, May 3, 2013 at 6:50 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi, thanks. Solr 3.4. There is POST request everywhere, between client and router, router and shards. Do you do faceting across all shards? How many documents approx you have

Re: socket write error

2013-05-03 Thread Dmitry Kan
:55 AM, Dmitry Kan solrexp...@gmail.com wrote: Digging in further, found this in HttpCommComponent class: [code] static { MultiThreadedHttpConnectionManager mgr = new MultiThreadedHttpConnectionManager(); mgr.getParams().setDefaultMaxConnectionsPerHost(20); mgr.getParams

Re: iterate through each document in Solr

2013-05-06 Thread Dmitry Kan
Are you doing it once? Is your index sharded? If so, can you ask each shard individually? Another way would be to do it on Lucene level, i.e. read from the binary indices (API exists). Dmitry On Mon, May 6, 2013 at 5:48 AM, Mingfeng Yang mfy...@wisewindow.com wrote: Dear Solr Users, Does

Re: iterate through each document in Solr

2013-05-06 Thread Dmitry Kan
through the docs directly. Thanks! Ming- On Mon, May 6, 2013 at 3:33 AM, Dmitry Kan solrexp...@gmail.com wrote: Are you doing it once? Is your index sharded? If so, can you ask each shard individually? Another way would be to do it on Lucene level, i.e. read from the binary indices

Re: Number of search results from SOLR

2013-05-08 Thread Dmitry Kan
If you need just the count of the results found, check the numFound. If you would like to get all the results possible in one go, you could try rows=-1. This may impact on your server a lot, so be careful. If you have a single non-sharded index, try pagination (start=offsetrows=window_size)

Re: stats cache

2013-05-08 Thread Dmitry Kan
Mohamed, (out of curiosity) What kind of tool are you using for that? On Wed, May 8, 2013 at 10:13 AM, J Mohamed Zahoor zah...@indix.com wrote: Thanks.. i am caching in HTTP now.. ./zahoor On 08-May-2013, at 3:58 AM, Yonik Seeley yo...@lucidworks.com wrote: On Tue, May 7, 2013 at

Re: stats cache

2013-05-08 Thread Dmitry Kan
OK, thanks. On Wed, May 8, 2013 at 1:38 PM, J Mohamed Zahoor zah...@indix.com wrote: I am using a simple LRU cache in my client where i store req and response for now. Later might move to something like varnish. ./zahoor On 08-May-2013, at 3:26 PM, Dmitry Kan solrexp...@gmail.com wrote

Re: Issue with getting highlight with hl.maxAnalyzedChars = -1

2013-05-13 Thread Dmitry Kan
You didn't say, what is exactly going weird.. On Fri, May 10, 2013 at 2:19 PM, meghana meghana.rav...@amultek.com wrote: I am facing one weird issue while setting hl.maxAnalyzedChars to -1 to fetch highlight for some random records, for other records its working fine. Below is my solr

Re: maximum number of simultaneous threads

2013-05-13 Thread Dmitry Kan
venkata, only blank lines between ..in solrconfig.xml and Is it possible.. have arrived. On Mon, May 13, 2013 at 3:25 PM, venkata vmarr...@yahoo.com wrote: I am seeing the following in solrconfig.xml It is possible to specific max number of threads for query time too? -- View

Re: maximum number of simultaneous threads

2013-05-14 Thread Dmitry Kan
venkata, If you are after search scaling, then the webapp server (like tomcat, jetty etc) handles allocation of threads per client connection (maxThreads for jetty for instance). Inside one client request SOLR uses threads for various tasks, but I don't have any exact figures (not sure if wiki

Re: Issue with getting highlight with hl.maxAnalyzedChars = -1

2013-05-17 Thread Dmitry Kan
query. Dmitry Kan-2 wrote You didn't say, what is exactly going weird.. On Fri, May 10, 2013 at 2:19 PM, meghana lt; meghana.ravani@ gt; wrote: I am facing one weird issue while setting hl.maxAnalyzedChars to -1 to fetch highlight for some random records, for other records its

[custom data structure] aligned dynamic fields

2013-05-20 Thread Dmitry Kan
Hi all, Our current project requirement suggests that we should start storing custom data structures in solr index. The custom data structure would be an equivalent of C struct. The task is as follows. Suppose we have two types of fields, one is FieldName1 and the other FieldName2. Suppose

Re: [custom data structure] aligned dynamic fields

2013-05-22 Thread Dmitry Kan
-valued fields with large numbers of values per document, that is feedback that your design needs to be denormalized and flattened further. -- Jack Krupansky -Original Message- From: Dmitry Kan Sent: Monday, May 20, 2013 7:06 AM To: solr-user@lucene.apache.org Subject: [custom data

Re: Documents

2013-06-07 Thread Dmitry Kan
hi, you need to parse your custom xml file and transform it into the xml file that will be of format solr understands. If you are familiar with xslt, you could do that in a few lines depending on the complexity of the input xml file. Dmitry On Fri, Jun 7, 2013 at 3:34 PM, acas...@greendata.com

[CROSS-POSTING] SOLR-4903 and SOLR-4904

2013-06-07 Thread Dmitry Kan
CROSS-POSTING from dev list. Hi guys, As discussed with Grant and Andrzej I have created two jiras related to inefficiency in distributed faceting. This affects 3.4, but my gut feeling is telling me 4.x is affected as well. Regards, Dmitry Kan P.S. Asking this question won yours truly second

Re: Doubt Regarding Shards Index

2013-06-07 Thread Dmitry Kan
Hi, Sharding by time by itself does not need any custom code on solr side: start indexing your data to a shard, depending on the timestamp of your document. The querying part is trickier if you want to have one front end solr: it should know which shards to query. If querying all shards for each

Re: retrieve datefield value from document

2013-06-14 Thread Dmitry Kan
Maybe a document was marked as deleted? *isDeletedhttp://lucene.apache.org/core/3_6_0/api/all/org/apache/lucene/index/IndexReader.html#isDeleted(int) * On Fri, Jun 14, 2013 at 11:25 PM, Michael Della Bitta michael.della.bi...@appinions.com wrote: Shot in the dark: You're using Lucene to

Re: Concurrent Modification Exception

2013-07-04 Thread Dmitry Kan
Can you repeat the test with for example jetty? In case jboss (?) has some issues in the case. What type of query was this? On 2 Jul 2013 19:27, adityab aditya_ba...@yahoo.com wrote: Anyone , any suggestion or pointers for this issue? -- View this message in context:

Re: Concurrent Modification Exception

2013-07-06 Thread Dmitry Kan
Ok. If you can create a test setting to repro the bug, I would suggest filing a jira. Sounds like a regression if your config remained otherwise same. On 5 Jul 2013 16:57, adityab aditya_ba...@yahoo.com wrote: well our observation leads us that this happens only during spell check. If we turn

[solr 3.4.1] collections: meaning and necessity

2013-07-16 Thread Dmitry Kan
Hello list, Following the answer by Jaendra here: http://stackoverflow.com/questions/14516279/how-to-add-collections-to-solr-core

Re: [solr 3.4.1] collections: meaning and necessity

2013-07-16 Thread Dmitry Kan
also don't plan on using SolrCloud at the moment. So from our standpoint the solr4 configuration looks more complicated, than that of solr 3.4. Are there any benefits of such a setup for non SolrCloud users? Thanks, Dmitry On Tue, Jul 16, 2013 at 2:24 PM, Dmitry Kan solrexp...@gmail.com wrote

Re: [solr 3.4.1] collections: meaning and necessity

2013-07-16 Thread Dmitry Kan
is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Tue, Jul 16, 2013 at 7:28 AM, Dmitry Kan solrexp...@gmail.com wrote: Sorry, hit send too fast.. picking up: from the answer by Jayendra

Re: [solr 3.4.1] collections: meaning and necessity

2013-07-16 Thread Dmitry Kan
, it doesn't seem to be working. (Anonymous - via GTD book) On Tue, Jul 16, 2013 at 2:30 PM, Dmitry Kan solrexp...@gmail.com wrote: Thanks Alexandre, Well, the initial question was, whether it is possible to altogether avoid dealing with collections (extra layer, longer url). But it seems

Re: [solr 3.4.1] collections: meaning and necessity

2013-07-16 Thread Dmitry Kan
Hi Shawn, Thanks for your input. Having spent some time today figuring out the path to upgrade, I concluded that we have been using what is (and was in solr 3 and possibly earlier) called a core. A group of two cores (with different schemas) we (probably mistakenly) referred to as a shard. That

shards param fails with cores

2013-07-17 Thread Dmitry Kan
Hi list, I have set up two cores (=collections): http://localhost:8983/solr/core0 http://localhost:8983/solr/core1 In addition the following has been set up: http://localhost:8984/solr/core0 http://localhost:8984/solr/core1 I'm trying to query the first via the second like this:

Re: shards param fails with cores

2013-07-17 Thread Dmitry Kan
All clear. There seems to be a mis-config on my side as the vanilla solr 4.3.1 package works just fine with the described setup. On Wed, Jul 17, 2013 at 4:21 PM, Dmitry Kan solrexp...@gmail.com wrote: Hi list, I have set up two cores (=collections): http://localhost:8983/solr/core0 http

Re: highlighting required in document

2013-07-23 Thread Dmitry Kan
You just need to specify the emphasizing tag in hl params by adding something like this to your query: hl.fl=contenthl.simple.pre=bhl.simple.post=%2Fb Check the solr admin page, the querying item, it shows the constructed query, so you don't need to guess! Regards, Dmitry On Mon, Jul 22,

Re: highlighting required in document

2013-07-23 Thread Dmitry Kan
Ah, I think I misread your question. So your question is actually, how make solr embed higlighting into the doc response itself. I'm not aware of such a functionality. This why you have the highlighting section in your response. On Tue, Jul 23, 2013 at 2:30 PM, Dmitry Kan solrexp...@gmail.com

Re: maximum number of documents per shard?

2013-07-25 Thread Dmitry Kan
Nicole, According to our findings, there is also a limit for the number of shards depending on the volume of the returned data. See this jira: https://issues.apache.org/jira/browse/SOLR-4903 Dmitry On Thu, Jul 25, 2013 at 11:25 AM, Nicole Lacoste niki.laco...@gmail.comwrote: Oh found the

Re: maximum number of documents per shard?

2013-07-25 Thread Dmitry Kan
Well, we have hit the aforementioned jira issue with about 80 shards. The sharding for us is a pure function of memory consumption and we use RAM lots. With solr4 however, things look much better and hopefully having migrated from solr3 we can live for long time without hitting the limit again.

Re: Measuring SOLR performance

2013-07-31 Thread Dmitry Kan
Hi Roman, What version and config of SOLR does the tool expect? Tried to run, but got: **ERROR** File solrjmeter.py, line 1390, in module main(sys.argv) File solrjmeter.py, line 1296, in main check_prerequisities(options) File solrjmeter.py, line 351, in check_prerequisities

Re: Improper shutdown of Solr in Jetty 9

2013-07-31 Thread Dmitry Kan
Karpenko a.karpe...@oxseed.comwrote: Hello Dmitry, it's Windows 7. I'm starting Jetty with java -jar start.jar 31.07.2013 12:36, Dmitry Kan пишет: Artem, Whats the OS are using? So far jetty 9 with solr 4.3.1 works ok under ubuntu 12.04. On 30 Jul 2013 17:23, Alexandre Rafalovitch arafa

Re: Measuring SOLR performance

2013-07-31 Thread Dmitry Kan
.. :) On Wed, Jul 31, 2013 at 4:39 PM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, What version and config of SOLR does the tool expect? Tried to run, but got: **ERROR** File solrjmeter.py, line 1390, in module main(sys.argv) File solrjmeter.py, line 1296, in main

Re: Measuring SOLR performance

2013-08-01 Thread Dmitry Kan
it on solr4.0, where it tries contactin /solr/admin/system - is it different for 4.3? I guess I should make it configurable (it already is, the endpoint is set at the check_options()) thanks roman On Wed, Jul 31, 2013 at 10:01 AM, Dmitry Kan solrexp...@gmail.com wrote: Ok, got the error fixed

Re: Measuring SOLR performance

2013-08-02 Thread Dmitry Kan
roman.ch...@gmail.com wrote: Dmitry, Can you post the entire invocation line? roman On Thu, Aug 1, 2013 at 7:46 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, When I try to run with -q /home/dmitry/projects/lab/solrjmeter/queries/demo/demo.queries here what is reported

[solr 4.4.0] SPLITSHARD and core autodiscovery

2013-08-02 Thread Dmitry Kan
Hello list, I was wondering, if what I see with the split shard a correct behaviour or is something wrong. Following this article: http://searchhub.org/2013/06/19/shard-splitting-in-solrcloud/ I have issued a low-level core split query:

Re: [solr 4.4.0] SPLITSHARD and core autodiscovery

2013-08-02 Thread Dmitry Kan
docbook@gmail.com wrote: Dmitry, That is expected behaviour. You need to manually remove the original core. Thanks. On Fri, Aug 2, 2013 at 6:03 AM, Dmitry Kan solrexp...@gmail.com wrote: Hello list, I was wondering, if what I see with the split shard a correct behaviour

Re: Measuring SOLR performance

2013-08-05 Thread Dmitry Kan
, the script is trying to guess the admin page (when one cannot be contacted - but if the new solr introduces some new paths, i may be wrong - i am short on time to investigate deeper) roman On Fri, Aug 2, 2013 at 7:27 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, Sure: python

Re: Measuring SOLR performance

2013-08-06 Thread Dmitry Kan
, roman On Mon, Aug 5, 2013 at 6:22 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, No problem. Still trying to launch the thing.. The query with the added -t parameter generated an error: 1. python solrjmeter.py -a -x ./jmx/SolrQueryTest.jmx -q ./queries/demo

Re: Measuring SOLR performance

2013-08-06 Thread Dmitry Kan
parameter as well? Dmitry On Tue, Aug 6, 2013 at 4:34 PM, Shawn Heisey s...@elyograg.org wrote: On 8/6/2013 6:17 AM, Dmitry Kan wrote: Of three URLs you asked for, only the 3rd one gave response: snip The rest report 404. On Mon, Aug 5, 2013 at 8:38 PM, Roman Chyla roman.ch

[solr 4.3.1 admin ui] bug in Plugins / Stats Refresh Values option?

2013-08-07 Thread Dmitry Kan
On the first click the values are refreshed. On the second click the page gets redirected: from: http://localhost:8983/solr/#/statements/plugins/cache to: http://localhost:8983/solr/#/ Is this intentional? Regards, Dmitry

Re: Measuring SOLR performance

2013-08-07 Thread Dmitry Kan
! roman On Tue, Aug 6, 2013 at 9:46 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi, Thanks for the clarification, Shawn! So with this in mind, the following work: http://localhost:8983/solr/statements/admin/system?wt=json http://localhost:8983/solr/statements/admin/mbeans?wt=json

Re: Measuring SOLR performance

2013-08-07 Thread Dmitry Kan
at 4:13 PM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, Finally, this has worked! Thanks for quick support. The graphs look awesome. At least on the index sample :) It is quite easy to setup and run + possible to run directly on the shard server in background mode. my test run

Re: [solr 4.3.1 admin ui] bug in Plugins / Stats Refresh Values option?

2013-08-07 Thread Dmitry Kan
work, but shouldn't stop you from refreshing the page :) - Stefan On Wednesday, August 7, 2013 at 3:00 PM, Dmitry Kan wrote: On the first click the values are refreshed. On the second click the page gets redirected: from: http://localhost:8983/solr/#/statements/plugins/cache to: http

Re: Measuring SOLR performance

2013-08-12 Thread Dmitry Kan
solrjmeter.py -C g1,foo -c hour -x ./jmx/SolrQueryTest.jmx -a roman On Wed, Aug 7, 2013 at 10:03 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi Roman, One more question. I tried to compare different runs (g1 vs cms) using the command below, but get an error. Should I attach some other

Re: [solr 4.3.1 admin ui] bug in Plugins / Stats Refresh Values option?

2013-08-12 Thread Dmitry Kan
, no chance that it doesn't get loaded. and that normally stops only working if something really bad happens ;o - Stefan On Wednesday, August 7, 2013 at 4:23 PM, Dmitry Kan wrote: Hi Stefan, I was able to debug the second click scenario (was tricky to catch it, since on click redirect happens

Re: Measuring SOLR performance

2013-08-13 Thread Dmitry Kan
raise TypeError(repr(o) + is not JSON serializable) TypeError: __main__.ForgivingValue object at 0x7fc6d4040fd0 is not JSON serializable Regards, D. On Tue, Aug 13, 2013 at 8:10 AM, Roman Chyla roman.ch...@gmail.com wrote: Hi Dmitry, On Mon, Aug 12, 2013 at 9:36 AM, Dmitry Kan solrexp

<    1   2   3   4   5   6   >