RE: Can't extract Outlook message files

2012-08-26 Thread Alexander Cougarman
This is an issue with extractOnly=true on Solr 3.6.1. We upgraded to 4.0 Beta 2 and the problem went away. Just in case anyone runs into this. Sincerely, Alex -Original Message- From: Alexander Cougarman [mailto:acoug...@bwc.org] Sent: 23 August 2012 12:27 PM To:

Two-dimensional array in Solr schema

2012-08-26 Thread Alexander Cougarman
Hi. We're using Solr 4.0 Beta. Is it possible to have a 2-dimensional array in Solr schema? For example, you want to store this information in a field: MyCustomField: - Text - FileName So each text has a filename associated with it. Thanks. Sincerely, Alex

Multi-core setup in Solr 4.0

2012-08-26 Thread Alexander Cougarman
Hi. I'm looking for a tutorial on how to set up two cores for a Solr 4.0 Beta instance. I've found this tutorial for earlier versions of Solr: http://drupal.org/node/484800 Also, what are Collections in Solr 4? Are they related to cores? Thanks. Sincerely, Alex

hl.fl is ignored in solr 4 beta?

2012-08-26 Thread Yoni Amir
I have a setup for /select handler which, regarding highlighting, looks roughly like this: requestHandler name=/select class=solr.SearchHandler default=true lst name=defaults str name=defTypeedismax/str str

RE: Two-dimensional array in Solr schema

2012-08-26 Thread Alexander Cougarman
More detail: So, when Solr returns results, we'd get XML that looks like this: doc arr name=text str filename=abcdef.docxdkjfkjdfkjdkfj/str str filename=ghijklm.docxkdjfkjdkfj/str /arr /doc Sincerely, Alex -Original Message- From: Alexander Cougarman

RE: hl.fl is ignored in solr 4 beta?

2012-08-26 Thread Yoni Amir
I managed to narrow it down to the presence of dynamic field *_custom_txt in the hl.fl list. If the list contains only regular fields the highlighting works fine. However, I also want to highlight some dynamic fields. Is this a bug? Thanks, Yoni -Original Message- From: Yoni Amir

Re: Multi-core setup in Solr 4.0

2012-08-26 Thread Ahmet Arslan
Hi. I'm looking for a tutorial on how to set up two cores for a Solr 4.0 Beta instance. http://wiki.apache.org/solr/CoreAdmin Both example-DIH and multicore can be used as an example. cd solr/example java -Dsolr.solr.home=example-DIH/solr -jar start.jar java -Dsolr.solr.home=multicore -jar

Re: Two-dimensional array in Solr schema

2012-08-26 Thread Michael Della Bitta
Multivalued fields come back in the order you index them. So you could have a field named filenames and another field named filecontents, and as long as you indexed them both in the same order, they'd appear in the results in the same order. So iterating over them would be like iterating over two

Re: Multi-core setup in Solr 4.0

2012-08-26 Thread Jack Krupansky
You may want to take a look at the wiki for SolrCloud: http://wiki.apache.org/solr/SolrCloud/ But, you may just need a simple master-slave replication setup: http://wiki.apache.org/solr/SolrReplication SolrCloud is certainly preferred for large multi-shard, multi-replica configurations, but

Re: hl.fl is ignored in solr 4 beta?

2012-08-26 Thread Jack Krupansky
I am unable to reproduce this scenario of all fields being highlighted. In fact, from looking at the code, I don't see a way that could happen. Further, the code, both 4.0-BETA and 3.6.1 as well as trunk, does NOT support glob patterns within a comma/space-delimited list of fields. Only a

Re: turning up logging using the web UI, can't get more than INFO

2012-08-26 Thread Lance Norskog
It is possible. Also, those settings are not saved across restarts. You really should use a logging properties file. Other ways to check on freezes: 1) run garbage collection logging or monitoring. 2) poll the statistics requesthandler and log. 3) poll the thread list and log. On Fri, Aug 24,

Re: SolrCloud admin UI core/stats showing commit count even without no explicit commit

2012-08-26 Thread Lance Norskog
How much memory is allocated? There is a feature in modern Unix systems called 'Large Pages' or 'Huge Pages'. This is an operating system feature to run very large processes with better virtual memory tracking strategies inside the CPU RAM subsystem. Search for 'Large Pages' and 'Translation

Re: Solr Score threshold 'reasonably', independent of results returned

2012-08-26 Thread Lance Norskog
Not really. The percentage given in other search packages is fairly bogus. You have to do a global batch analysis of all of the index to get a true scale for relevance. On Sat, Aug 25, 2012 at 1:38 PM, Ramzi Alqrainy ramzi.alqra...@gmail.com wrote: You are right Mr.Ravish, because this depends

Re: Debugging DIH

2012-08-26 Thread Lance Norskog
Also, there is a logging feature to print intermediate values. Another point is the complexity of your query. It can be easier to test with the query as a database view, instead of embedding it in the DIH script. On Fri, Aug 24, 2012 at 9:00 AM, Ahmet Arslan iori...@yahoo.com wrote: That is

Re: Debugging DIH

2012-08-26 Thread Hasan Diwan
Mr Norskong, et al, On 26 August 2012 14:37, Lance Norskog goks...@gmail.com wrote: Also, there is a logging feature to print intermediate values. I see the data as it should be. It's just not recorded into SOLR. One possible concern is that I have timestamp in epoch seconds, which I'd like

Re: Debugging DIH

2012-08-26 Thread Lance Norskog
The timestamp format is 2012-01-01T01:01:01, with an optional Z001 for milliseconds. The timezone is UTC. This is a standard format but I do not remember the name of the standard. On Sun, Aug 26, 2012 at 2:43 PM, Hasan Diwan hasan.di...@gmail.com wrote: Mr Norskong, et al, On 26 August 2012

Re: Debugging DIH

2012-08-26 Thread Walter Underwood
ISO 8601. The entire standards is rather complex, so most software uses a subset of it. A useful subset is described here: http://www.w3.org/TR/NOTE-datetime ISO 8601 does not allow Z001 for milliseconds. The Z is for UTC (Zulu in military time) and follows the time portion. Milliseconds (or

Re: Query regarding multi core search

2012-08-26 Thread ravicv
Hi Erick Thanks For reply. My use case is I have 50 fields to index , but at the time of index all 50 fields data is unavailable. So we have divided them in to 24 separate cores and indexing . we are using shards for querying. But the problem is each core is having huge data. Total size of

Re: Group count in SOLR 3.3

2012-08-26 Thread Roman Slavík
Thanks, I found GroupResponse was added in Solr 3.4 so I have to update version :) Roman Dne 24.8.2012 18:09, Erick Erickson napsal(a): 3.6 has a getNGroups, does that do what you want? Best Erick On Thu, Aug 23, 2012 at 2:23 AM, Roman Slavík sla...@effectiva.cz wrote: Hi guys, we are