Solr the right thing for me?

2011-02-15 Thread Chris
th 40 Websites, set B with 7 websites) Does it sound possible with SOLR? Do I have to expect custom development? If so, how much? Thank you in advance Bye, Chris

Re: slowdown after 15K queries

2008-06-02 Thread Chris
Maybe you jetty need to turning how many memory in your system ? Can you show the processes information with the java processes ? above Chris 2008/6/2 Bram de Jong <[EMAIL PROTECTED]>: > Hello all, > > > Still running tests on solr using the example jetty cont

Capabilities of solr

2008-09-19 Thread Chris
Hello, We currently have a ton of documents that we would like to index and make search-able. I came across solr and it seems like it offers a lot of nice features and would suite our needs. The documents are in similar structure to java code, blocks representing functions, variables, comment blo

Re: How to let crawlers in, but prevent their damage?

2011-01-10 Thread Chris Hostetter
: What I mean is that when you have publicly exposed search that bots crawl, they : issue all kinds of crazy "queries" that result in errors, that add noise to Solr : caches, increase Solr cache evictions, etc. etc. I teld with this type of thing a few years back by having my front end app e

Re: MaxRows and disabling sort

2011-01-14 Thread Chris Hostetter
: Also I guess default sorting is on Scoring and sorting can only be done once : it has the scores of all matches so then limiting it to the max rows becomes : useless. So if there a way to disable sorting? e.g. it returns the rows as : it finds without any order? http://wiki.apache.org/solr/Comm

Re: highlighting not working with Solr 3.0 trunk?

2011-01-14 Thread Chris Hostetter
: and ran ant there. I've followed the tutorial but : highlighting on analyzer debug screen isn't working. Yep, thanks for reporting this, i've opened a bug to track it... https://issues.apache.org/jira/browse/SOLR-2315 -Hoss

Re: Solr UUID field for externally generated UUIDs

2011-01-18 Thread Chris Hostetter
: : : The above won't generate a UUID on it's own, right? correct. -Hoss

Re: Single value vs multi value setting in tokenized field

2011-01-18 Thread Chris Hostetter
: problem, disk space is cheap. What I wanted to know was whether it is best : to make the single field multiValued="true" or not. That is, should my : 'content' field hold data like: ... : or would it be better to make it a concatenated, single value field like: functionally, the only di

Re: [POLL] Where do you get Lucene/Solr from? Maven? ASF Mirrors?

2011-01-18 Thread Chris Male
> > > [X] ASF Mirrors (linked in our release announcements or via the Lucene > website) > > [X] Maven repository (whether you use Maven, Ant+Ivy, Buildr, etc.) > > [] I/we build them from source via an SVN/Git checkout. > > [] Other (someone in your company mirrors them internally or via a > downst

Re: please help >>Problem with dataImportHandler

2011-01-24 Thread Chris Hostetter
: this is the error that i'm getting.. no idea of what is it.. Did you follow the instructions in the error message and look at your solr log file to see what the "severe errors in solr configuration" might be? : SimplePostTool: FATAL: Solr returned an error: : Severe_errors_in_solr_configurat

Re: No system property or default value specified for...

2011-01-24 Thread Chris Hostetter
: I'm trying to dynamically add a core to a multi core system using the : following command: : : http://localhost:8983/solr/admin/cores?action=CREATE&name=items&instanceDir=items&config=data-config.xml&schema=schema.xml&dataDir=data&persist=true : : the data-config.xml looks like this: : : I

Re: searching based on grouping result

2011-01-24 Thread Chris Hostetter
: Subject: searching based on grouping result : In-Reply-To: <913367.31366...@web121705.mail.ne1.yahoo.com> : References: <913367.31366...@web121705.mail.ne1.yahoo.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing l

Re: Solr with Unknown Lucene Index?

2011-01-24 Thread Chris Hostetter
: Having found some code that searches a Lucene index, the only analyzers : referenced are Lucene.Net.Analysis.Standard.StandardAnalyzer. : : How can I map this is Solr? The example schema doesn't seem to mention this, : and specifying 'text' or 'string' for every field doesn't seem to help. 1)

Re: Specifying an AnalyzerFactory in the schema

2011-01-24 Thread Chris Hostetter
: I notice that in the schema, it is only possible to specify a Analyzer class, : but not a Factory class as for the other elements (Tokenizer, Fitler, etc.). : This limits the use of this feature, as it is impossible to specify parameters : for the Analyzer. : I have looked at the IndexSchema imp

Re: Stemming for Finnish language

2011-01-24 Thread Chris Hostetter
: I tried following in my schema.xml, but I got : org.apache.solr.common.SolrException: Error loading class : 'solr.FinnishLightStemFilterFactory' FinnishLightStemFilterFactory is a class that exists in SVN on the 3x and trunk branches, but does not exist in the Solr 1.4.1 release (it was added

Re: How call I make one request for all cores and get response classified by cores

2011-01-24 Thread Chris Hostetter
: I have a group of subindex, each of which is a core in my solr now. I want : to make one query for some of them, how can I do that? And classify response : doc by index, using facet search? some background: "multi core" is when you have multiple solr "cores" on one solr instance; each "core" c

Re: Adding weightage to the facets count

2011-01-24 Thread Chris Hostetter
: prod1 has tag called “Light Weight” with weightage 20, : prod2 has tag called “Light Weight” with weightage 100, : : If i get facet for “Light Weight” , i will get Light Weight (2) , : here i need to consider the weightage in to account, and the result will be : Light Weight (120) : : How can

Re: Import Handler for tokenizing facet string into multi-valued solr.StrField..

2011-01-27 Thread Chris Hostetter
: Subject: Import Handler for tokenizing facet string into multi-valued : solr.StrField.. : In-Reply-To: <1296123345064-2361292.p...@n3.nabble.com> : References: <1296123345064-2361292.p...@n3.nabble.com> -Hoss

Re: DIH clean=false

2011-01-27 Thread Chris Hostetter
: Then for clean=false, my understanding is that it won't blow off existing : index. For data that exist in index and db table (by the same uniqueKey) : it will update the index data regardless if there is actual field update. : For existing index data but not existing in table (by comparing un

RE: match count per shard and across shards

2011-01-31 Thread Chris Hostetter
: Interesting idea. I must investigate if this is a possibility - eg. how often : will a document be reindexed from one shard to another - this is actually a : possibility as a consequence of the way we configure our shards :-/ : : Thanks for the input! I was still hoping for a way to get that in

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Chris Hostetter
: Well, this does not seem to me like a bug but more like an exotic : situation where two concepts collidate with eachother. : The CSVRequestHandler is intended to sweep all the unneccessary stuff : out of the input to avoid exceptions for unknown fields : while my UpdateRequestProcessor needs suc

Re: Sending binary data as part of a query

2011-01-31 Thread Chris Hostetter
: I have successfully created a QueryComponent class that, assuming it : has the integer bitset, can turn that into the necessary DocSetFilter : to pass to the searcher, get back the facets, etc. That part all works ... : What I'm unsure how to do is actually send this compressed bitset fr

Re: nested faceting ?

2011-01-31 Thread Chris Hostetter
: I am loading devices and accessories in solr index. deviceType indicates if : its a device or accessory : : All other attributes are same for device and accessory. When query results : come back I would like to display someting like : : Devices : +Manucaturer (100) : - Samsung (50) : - Sha

Re: Migration from Solr 1.2 to Solr 1.4

2011-01-31 Thread Chris Hostetter
: I have huge numbers of data indexed in solr and I would know the best way to : migrate it ? : A simple cp of the data directory can work ? if you don't have any custom components, you can probably just use your entire solr home dir as is -- just change the solr.war. (you can't just copy the

Re: Lock obtain timed out: NativeFSLock

2011-02-01 Thread Chris Hostetter
: I'm going to go ahead and replay to myself since I solved my problem. It : seems I was doing one more update to the data at the end and wasn't doing a : commit, so it then couldn't write to the other core. Adding the last commit : seems to have fixed everything. sending interleaving updates t

RE: Index Not Matching

2011-02-03 Thread Chris Hostetter
: At first I thought it could be a schema problem, but we went though it : with a fine comb and compared it to the one in our stage environment. : What is really weird is that I grabbed one of the product ID that are : not showing up in SOLR from the DB, search through the SOLR GUI and it : found i

Re: HTTP ERROR 400 undefined field: *

2011-02-03 Thread Chris Hostetter
: I was working on an checkout of the 3.x branch from about 6 months ago. : Everything was working pretty well, but we decided that we should update and : get what was at the head. However after upgrading, I am now getting this FWIW: please be specific. "head" of what? the 3x branch? or trunk?

Re: keepword file with phrases

2011-02-05 Thread Chris Hostetter
: You need to switch the order. Do synonyms and expansion first, then : shingles.. except then he would be building shingles out of all the permutations of "words" in his symonyms -- including the multi-word synonyms. i don't *think* that's what he wants based on his example (but i may be wron

Re: How to use q.op

2011-02-05 Thread Chris Hostetter
: Dismax uses a strategy called Min-Should-Match which emulates the binary : operator in the Standard Handler. In a nutshell, this parameter (called mm) : specifies how many of the entered terms need to be present in your matched : documents. You can either specify an absolute number or a percenta

Re: HTTP ERROR 400 undefined field: *

2011-02-07 Thread Chris Hostetter
: The stack trace is attached. I also saw this warning in the logs not sure >From your attachment... 853 SEVERE: org.apache.solr.common.SolrException: undefined field: score 854 at org.apache.solr.handler.component.TermVectorComponent.process(TermVectorComponent.java:142) 855 at org.ap

Re: SolrIndexWriter was not closed prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!

2011-02-07 Thread Chris Hostetter
: While reloading a core I got this following error, when does this : occur ? Prior to this exception I do not see anything wrong in the logs. well, there are realy two distinct types of "errors" in your log... : [#|2011-02-01T13:02:36.697-0500|SEVERE|sun-appserver2.1|org.apache.solr.

Re: General question about Solr Caches

2011-02-08 Thread Chris Hostetter
: In my understanding, the Current Index Searcher uses a cache instance and : when a New Index Searcher is registered a new cache instance is used which : is also auto-warmed. However, what happens when the New Index Searcher is a : view of an index which has been modified? If the entries contained

Re: jndi datasource in dataimport

2011-02-08 Thread Chris Hostetter
: It looks like you can use a jndi datsource in the data import handler. : however i can't find any syntax on this. : : Where is the best place to look for this ? (and confirm if jndi does work in : dataimporthandler) It's been a long time since i used JNDI on anything, and i've never tried it

Re: solr current workding directory or reading config files

2011-02-09 Thread Wilkes, Chris
Is your war always deployed the the same location, ie "/usr/mycomp/ myapplication/webapps/myapp.war"? If so then on startup copy the files out of your directory and put them under CATALINA_BASE/solr (usr/ mycomp/myapplication/solr) and in your war file have the META-INF/ context.xml JNDI sett

Re: Restart SolR and not Tomcat

2011-02-10 Thread Wilkes, Chris
e J2EEServer: none J2EEApplication: none beanClass: org.apache.tomcat.util.modeler.BaseModelMBean and call "reload" on it. Chris On Feb 10, 2011, at 7:45 AM, Paul Libbrecht wrote: Jenny, look inside the documentation of the manager application, I'm guessing you haven't ac

Re: edismax with windows path input?

2011-02-10 Thread Chris Hostetter
: extending edismax. Perhaps when F: does not match a given field, it : could auto escape the rest of the word? that's actually what yonik initially said it was suppose to do, but when i tried to add a param to let you control which fields would be supported using the ":" syntax i discovered i

Re: edismax with windows path input?

2011-02-10 Thread Chris Hostetter
: "essentially that FOO:BAR and FOO\:BAR would be equivalent if FOO is : not the name of a real field according to the IndexSchema" : : That part is true, but doesn't say anything about escaping. And for : some unknown reason, this no longer works. that's the only part i was refering to. -Hos

Re: Migration from Solr 1.2 to Solr 1.4

2011-02-16 Thread Chris Hostetter
: > if you don't have any custom components, you can probably just use : > your entire solr home dir as is -- just change the solr.war. (you can't : > just copy the data dir though, you need to use the same configs) : > : > test it out, and note the "Upgrading" notes in the CHANGES.txt for the :

Re: Searching for negative numbers very slow

2011-02-16 Thread Chris Hostetter
: This was my first thought but -1 is relatively common but we have other : numbers just as common. i assume that when you say that you mean "...we have other numbers (that are not negative) just as common, (but searching for them is much faster)" ? I don't have any insight into why your neg

Re: TermVector query using Solr Tutorial

2011-02-17 Thread Chris Hostetter
: I am searching the keyword 25, in the field : : 30" TFT active matrix LCD, 2560 x 1600, .25mm : dot pitch, 700:1 contrast : : I want to know the character position of matched keyword in the : corresponding field. : : usb or cabl is not what I want. your search is getting a match on the featu

Re: solr current workding directory or reading config files

2011-02-18 Thread Chris Hostetter
: I have a class (in a jar) that reads from properties (text) files.  I have these : files in the same jar file as the class. : : However, when my class reads those properties files, those files cannot be found : since solr reads from tomcat's bin directory. Can you elaborate a bit more on w

Re: Help migrating from Lucene

2011-02-18 Thread Chris Hostetter
: to our indexing service are defined in a central interface. Here is an : example of a query executed from a programmatically constructed Lucene : query. ... : solrQuery.setQuery(query.toString()); first of all, be advised that Query.toString() is not garunteed to produce a string that

Re: Dih sproc call

2011-02-18 Thread Chris Hostetter
: References: : In-Reply-To: : Subject: Dih sproc call http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even if you change the subject

Re: Best way for a query-expander?

2011-02-18 Thread Chris Hostetter
: I want to implement a query-expander, one that enriches the input by the : usage of extra parameters that, for example, a form may provide. : : Is the right way to subclass SearchHandler? : Or rather to subclass QueryComponent? This smells like the poster child for an X/Y problem (or maybe a

Re: Passing parameters to DataImportHandler

2011-02-22 Thread Chris Hostetter
: It'd be nice to be able to pass HTTP parameters into DataImportHandler : that'd be passed into the SQL as parameters, is this possible? there is a specific sub-section about this in the docs... http://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters -Hoss

Re: Date Math

2011-02-22 Thread Chris Hostetter
: org.apache.lucene.queryParser.ParseException: Cannot parse 'last_modified:-DAY': ... : Are they not supported as a short-cut for "NOW-1DAY"? I'm using Solr 1.4. No, "-1DAY" is a valid DateMath string (to the DateMathParser) but as a field value you must specify a valid date string,

Re: fq field with facets

2011-02-23 Thread Chris Hostetter
: fq={!field f=category} There are subtle nuanced cases where "field" won't work properly, which is why i usually recommend "raw", but there are also subtle nuanced cases where raw won't work either (although in my opinion those cases are much less likely in typical faceting) this is why t

Re: DataImportHandler in Solr 4.0

2011-02-23 Thread Chris Hostetter
: Curious...why was this feature removed? it hasn't been removed, it still ships with the solr releases as a contrib jar the same way it always did. what changed is that in the past it was mistakenly/foolishly/inexplicable also included in the solr.war -- even though it didn't need to be. Thi

Re: UpdateProcessor and copyField

2011-02-23 Thread Chris Hostetter
: > Maybe copy fields should be refactored to happen in a new, core, : update processor, so there is nothing special/awkward about them?  It : seems they fit as part of what an update processor is all about, : augmenting/modifying incoming documents. : : Seems reasonable. : By default, the cop

Re: taxonomy faceting

2011-02-23 Thread Chris Hostetter
: I have many taxonomies and each document can apply to some of them. I dont : know how many taxonomies they are, so i cant define a field in the schema : for each taxonomy (one field per each taxonomy). : : I want to use these feature but i need to know if i can handle the context : where each d

Re: DataImportHandler in Solr 4.0

2011-02-24 Thread Chris Hostetter
: It seems this thread has been hijacked. My initial posting was in regards to : my custom Evaluators always receiving a null context. Same Evaluators work in : 1.4.1 I'm pretty sure you are talking about a completely different thread, with a completely differnet subject ("Solr 4.0 DIH") -Hos

Re: Ramdirectory

2011-02-24 Thread Chris Hostetter
: I could not figure out how to setup the ramdirectory option in solrconfig.XML. Does anyone have an example for 1.4? it wasn't an option in 1.4. as Koji had already mentioned in the other thread where you chimed in and asked about this, it was added in the 3x branch... http://lucene.472066.n3

Re: boosting based on number of terms matched?

2011-02-25 Thread Chris Hostetter
: I'm using the edismax handler, although my question is probably the same for : dismax. When the user types a long query, I use the "mm" parameter so that : only 75% of terms need to match. This works fine, however, sometimes documents : that only match 75% of the terms show up higher in my resul

Re: Solr Multicore - cant seem to get it working?

2011-02-27 Thread Chris Wilkes
Did you copy the files into the solr/graphics/ directory? That subdirectory should be the same name as the instanceDir. That is you should have this directory structure: solr/graphics/conf/ solr/graphics/data/index/ On Feb 27, 2011, at 5:20 AM, ultranerds wrote: > Hi, > > I'm trying to get

Re: Problems with JSP pages?

2011-02-28 Thread Chris Hostetter
: I'm on Windows Vista, using the trunk. Some of the JSP pages do not : execute, but instead Jetty downloads them. : : solr/admin/get-properties.jsp for example. This is called by the 'JAVA : PROPERTIES' button in the main admin page. : : Is this a known problem/quirk for Windows? Or fallout fro

Re: solr.xml isn't loaded from classpath?

2011-02-28 Thread Chris Hostetter
: It seems like when "solr home" is absent, Solr makes an attempt to look : a few other places to load its configuration. It will try to look for : solrconfig.xml on the classpath as well. It doesn't seem like it makes : any attempt to find solr.xml though. Why is that? Read below for the

Re: Question on writing custom UpdateHandler

2011-03-01 Thread Chris Hostetter
In your first attempt, the crux of your problem was probably that you were never closing the searcher/reader. : Or how can I perform a query on the current state of the index from within an : UpdateProcessor? If you implement UpdateRequestProcessorFactory, the getInstance method is given the S

Re: multi-core solr, specifying the data directory

2011-03-01 Thread Chris Hostetter
: Unless I'm doing something wrong, in my experience in multi-core Solr in : 1.4.1, you NEED to explicitly provide an absolute path to the 'data' dir. have you looked at the example/multicore directory that was included in the 1.4.1 release? it has a solr.xml that loads two cores w/o specifying

Re: numberic or string type for non-sortable field?

2011-03-01 Thread Chris Hostetter
: > The field value is a an id.  Therefore, i can store as : > either numeric field : > or just a string.   Shall i choose string : > for efficiency? : : Trie based integer (tint) is preferred for faster faceting. range faceting/filtering yes -- not for "field" faceting which is what i think he

Re: multi-core solr, specifying the data directory

2011-03-01 Thread Chris Hostetter
: : ${solr.data.dir:./solr/data} that directive says "use the solr.data.dir system property to pick a path, if it is not set, use "./solr/data" (realtive the CWD) if you want it to use the default, then you need to eliminate it completley, or you need to change it to the empty string... ${

Re: numberic or string type for non-sortable field?

2011-03-01 Thread Chris Hostetter
: Can I know why? I thought solr is tuned for string if no sorting of facet by : range query is needed. "tuned for string" doesn't really mean anything to me, i'm not sure what that's in refrence to. nothing thta i know of is particularly optimized for strings. Almost anything can be indexed

Re: More Date Math: NOW/WEEK

2011-03-01 Thread Chris Hostetter
: Digging into the source code of DateMathParser.java, i found the following : comment: :99 // NOTE: consciously choosing not to support WEEK at this time, : 100 // because of complexity in rounding down to the nearest week 101 : // arround a month/year boundry. 102

Re: indexing mysql dateTime/timestamp into solr date field

2011-03-01 Thread Chris Hostetter
: query="select ID, title_full as TITLE_NAME, YEAR, : COUNTRY_OF_ORIGIN, modified as RELEASE_DATE from title limit 10"> Are you certian that the first 10 results returned (you have "limit 10") all have a value in the "modified" field? if modified is nullable you could ver

Re: Searching all terms - SolrJ

2011-03-01 Thread Chris Hostetter
: Yes but I want to leave the choice to the user. : : He can either search all the terms or just some. : : Is there any more flexible solution ? Even if I have to code it by hand ? the declaration in the schema dictates the default. you can override the default at query time using the "q.op" p

Re: dismax query with no/empty/*:* q parameter?

2011-03-02 Thread Chris Hostetter
: For standard query handler fq-only queries, we used q=*:*. However, with : dismax, that returns 0 results. Are fq-only queries possible with dismax? they are if you use the q.alt param. http://wiki.apache.org/solr/DisMaxQParserPlugin#q.alt -Hoss

Re: sort by price puts unknown prices first

2011-03-02 Thread Chris Hostetter
: When I sort by price ascending, documents with no price are listed : first. I would like them listed last. I tried adding the : sortMissingLast flag, even though it says it is only for strings, but it works for any field type *backed* by a string, including the SortableIntField (and it's breat

Re: multi-core solr, specifying the data directory

2011-03-02 Thread Chris Hostetter
: I wonder if what doesn't work is trying to set an explicit relative path : there, instead of using the baked in default "data". If you set an explicit : relative path, is it relative to the current core solr.home, or to the main : solr.home? it's realtive the current working dir of the process

Re: Solr Admin Interface, reworked - Go on? Go away?

2011-03-02 Thread Chris Hostetter
: given that fact that my java-knowledge is sort of non-existing .. my idea was : to rework the Solr Admin Interface. Contributions of all kinds are welcome! : Actually it's completly work-in-progress .. but i'm interested in what you : guys think. Right direction? Completly Wrong, just drop it?

Re: Solr Admin Interface, reworked - Go on? Go away?

2011-03-02 Thread Chris Hostetter
: even in this WIP-State? if so .. i'll try one tomorrow evening after work When in doubt, remember Yonik's Law Of Patches... http://wiki.apache.org/solr/HowToContribute?highlight=law+of+patches#Contributing_Code_.28Features.2C_Big_Fixes.2C_Tests.2C_etc29 A half-baked patch in Jira,

Re: memory leak during undeploying

2011-03-02 Thread Chris Hostetter
: When I did heap analysis, the culprit always seems to : be TimeLimitedCollector thread. Because of this, considerable amount of : classes are not getting unloaded. ... : > > There are couple of JIRA's related to this: : > > https://issues.apache.org/jira/browse/LUCENE-2237, : > > https:/

Re: Problem adding new requesthandler to solr branch_3x

2011-03-08 Thread Chris Hostetter
: 1.  Why the problem occurs (has something changed between 1.4.1 and 3x)? Various pieces of code dealing with config parsing have changed since 1.4.1 to be better about verifying that configs are meaningful ,ad reporting errors when unexpected things are encountered. i'm not sure of the spec

Re: -ignore words not working?

2011-03-08 Thread Chris Hostetter
: AND ((-title:"men") AND (-keywords:"men") AND (-description:"men")) ... : As soon as I put in -field:"value" it yeilds no results... even though there : are a ton of results that match the criteria :/ you didn't add -field:"value" ... you added (-field:"value") the parens are significan

Re: two QueryHandler components in one schema?

2011-03-08 Thread Chris Hostetter
: in my schema I have First off, a bit of terminoligy clarification: Search COmponents are declarred in the solrconfig.xml file. schema.xml is where you define what, inherently, the data in your index *is*. solrocnfig.xml is where you define how you want people to be able to interact with t

Re: two QueryHandler components in one schema?

2011-03-08 Thread Chris Hostetter
: So how do I define, for a given request-handler, a special query component? : I did not find in this in the schema. you mean solrocnfig.xml, again. Taken directly from the SearchHandler URL i sent you... > If you want to have a custom list of components (either omitting > defaults or adding

Re: error in log INFO org.apache.solr.core.SolrCore - webapp=/solr path=/admin/ping params={} status=0 QTime=1

2011-03-08 Thread Chris Hostetter
: I am using solr under jboss, so this might be more of a jboss config : issue, not really sure. But my logs keep getting spammed, because : solr sends it as ERROR [STDERR] INFO org.apache.solr.core.SolrCore - : webapp=/solr path=/admin/ping params={} status=0 QTime=1 : : Has anyone seen this an

Re: two QueryHandler components in one schema?

2011-03-08 Thread Chris Hostetter
: did you, Hoss, not say that components are referred to by name? How : could the search result be read from the query mySpecialQueryComponent : if it cannot be named? Simply through the pool of SolrParams? in the example i gave, "mySpecialQueryComponent" *is* the name of some component you ha

Re: dataimport

2011-03-08 Thread Chris Hostetter
: INFO: Creating a connection for entity id with URL: : jdbc:mysql://localhost/researchsquare_beta_library?characterEncoding=UTF8&zeroDateTimeBehavior=convertToNull : Feb 24, 2011 8:58:25 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 : call : INFO: Time taken for getConnection(): 137 : K

Re: Help with explain query syntax

2011-03-08 Thread Chris Hostetter
: : +DisjunctionMaxQuery((company_name:"(linguajob.pl linguajob) pl")~0.01) () : you can see the crux of your problem in this query string it seems you have a query time synonym in place to *expand* linguajob.pl into [linguajob.pl] and [linguajob] [pl] but query time synonym expansion of mul

Re: Possible to sort in .xml file?

2011-03-10 Thread Chris Hostetter
: I know its possible to do via adding sort= , but the Perl module : (WebService::Solr) doesn't seem to offer the option to pass in this value :( according to the docs, you can pass any query params you want to the sort method... http://search.cpan.org/~bricas/WebService-Solr-0.11/lib/WebSe

Re: Dismax: field not returned unless in sort clause?

2011-03-15 Thread Chris Hostetter
: We have a "D" field (string, indexed, stored, not required) that is returned : * when we search with the standard request handler : * when we search with dismax request handler _and the field is specified in : the sort parameter_ : : but is not returned when using the dismax handler and the fie

Re: Getting Category ID (primary key)

2011-03-15 Thread Chris Hostetter
: If it works, it's performant and not too messy it's a good way :-) . You can : also consider just faceting on Id, and use the id to fetch the categoryname : through sql / nosql. : That way your logic is seperated from your presentation, which makes : extending (think internationalizing, etc.) ea

Re: Sorting 0 values last

2011-03-15 Thread Chris Hostetter
: Not sure how you are indexing, but in addition to the above : suggestion by Yonik, one could ignore 0's at indexing time, : i.e., ensure that 0 values for that field are not indexed, and : use sortMissingLast. Once upon a time i had a usecase where i was indexing product data, and in thta prod

Re: Error during auto-warming of key

2011-03-16 Thread Chris Hostetter
: : Yesterday's error log contains something peculiar: : : ERROR [solr.search.SolrCache] - [pool-29-thread-1] - : Error during auto- : warming of key:+*:* : (1.0/(7.71E-8*float(ms(const(1298682616680),date(sort_date)))+1.0))^20.0:java.lang.NullPointerException : at org.apache.lucene.u

Re: 'Registering' a query / Percolation

2011-03-16 Thread Chris Hostetter
: I.E. Instruct Solr that you are interested in documents that match a : given query and then have Solr notify you (through whatever callback : mechanism is specified) if and when a document appears that matches the : query. : : We are planning on writing some software that will effectively grind

Re: FunctionQueries and FieldCache and OOM

2011-03-16 Thread Chris Hostetter
: Alright, i can now confirm the issue has been resolved by reducing precision. : The garbage collector on nodes without reduced precision has a real hard time : keeping up and clearly shows a very different graph of heap consumption. : : Consider using MINUTE, HOUR or DAY as precision in case

Re: Sorting on multiValued fields via function query

2011-03-16 Thread Chris Hostetter
: However, many of our multiValued fields are single valued for the majority : of documents in our index so we may not have noticed the incorrect sorting : behaviors. that would make sense ... if you use a multiValued field as if it were single valued, you would never enocunter a problem. if yo

Re: Faceting help

2011-03-16 Thread Chris Hostetter
: I'm not sure if I get what you are trying to achieve. What do you mean : by "constraint"? "constraint" it fairly standard terminology when refering to facets, it's used extensively in our facet docs and is even listed on solr's glossary page (allthough not specificyly in hte context of faceti

Re: Sorting on multiValued fields via function query

2011-03-17 Thread Chris Hostetter
: But if lucene now can sort a multi-valued field without crashing when there : are 'too many' unique values, and with easily described and predictable : semantics (use the minimal value in the multi-valued field as sort key) -- : then it probably makes more sense for Solr to let you do that if yo

Re: Smart Pagination queries

2011-03-17 Thread Chris Hostetter
: In order to paint "Next" links app would have to know total number of : records that user is eligible for read. getNumFound() will tell me that : there are total 4K records that Solr returned. If there wasn't any : entitlement rules then it could have been easier to determine how many : "Next"

Re: Custom search filters

2011-03-17 Thread Chris Hostetter
: Hi all, I am trying to use a custom search filter : (org.apache.lucene.search.Filter) but I am unsure of where I should configure : this. : : Would I have to create my own SearchHandler that would wrap this logic in? Any : example/suggestions out there? the easiest way to plugin a custom Filte

Re: dismax parser, parens, what do they do exactly

2011-03-23 Thread Chris Hostetter
: It looks like Dismax query parser can somehow handle parens, used for : applying, for instance, + or - to a group, distributing it. But I'm not : sure what effect they have on the overall query. parens are treated like any regular character -- they have no semantic meaning. what may be confus

Re: Detecting an empty index during start-up

2011-03-24 Thread Chris Hostetter
: I am not familiar with Solr internals, so the approach I wanted to take was : to basically check the numDocs property of the index during start-up and set : a READABLE state in the ZooKeeper node if it's greater than 0. I also : planned to create a commit hook for replication and updating which :

Re: Broken stats.js

2011-03-28 Thread Chris Hostetter
: I can't seem to find any references to this issue anywhere except : : https://issues.apache.org/jira/browse/SOLR-1750 : : (Which has more of a workaround), and it seems that the SolrInfoMBeanHandler : is not in the 1.4.1 build. correct, it will be in 3.1 however. it's not so much a workarroun

Re: DIH relating multiple DataSources

2011-03-28 Thread Chris Hostetter
: Subject: DIH relating multiple DataSources : In-Reply-To: <1301054278.18711.1433747...@webmail.messagingengine.com> : References: : : : <1301054278.18711.1433747...@webmail.messagingengine.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When start

Re: Fields not being indexed?

2011-03-28 Thread Chris Hostetter
: Subject: Fields not being indexed? : In-Reply-To: : References: : : http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not reply to an existing message, instead start a fresh email. Even if you c

Re: Solr 1.4.1 and Tika 0.9 - some tests not passing

2011-03-31 Thread Chris Hostetter
: I'm still interested on what steps I could take to get to the bottom of the : failing tests. Is there additional information that I should provide? i'm not really up to speed on what might have changed in Tika 0.9 to cause this, but the best thing to do would probably be to look at what *doe

Re: query expansion à la dismax

2011-03-31 Thread Chris Hostetter
: So I wrote my own code that filters the top level queries and expands : them, using a similar instruction as dismax within a particular query : component. : : Question 1: doesn't such a code already exist? : (I haven't found it) the DisjunctionMaxQueryParser class has support for configurin

Re: Solrj Performance check.

2011-03-31 Thread Chris Hostetter
: For eg, if I post a search url in browser, it shows the QTime in : milliseconds only. : : http://serverName/solr/mydata/select?q=computing&qt=myhandler&fq=category:1 : : But, if I query the same using Solrj from my project like below, it takes : long time(8 - 12 sec) to produce the same result

Re: [Solr Wiki] Update of "Troubleshooting HTTP Status 404 - missing core name in path" by Gabriele Kahlout

2011-04-01 Thread Chris Hostetter
Gabriele: Creating a wiki page really isn't the approprate way to ask for help diagnosing a problem -- that's why we have the user mailing list. Regarding your specific problem, note that this... : $SOLR_HOME/solr.xml: : {{{ : : : : : }}} ...is not a valid solr.xml file ... that is a co

Re: ExternalFileField with whitespaces

2011-04-01 Thread Chris Hostetter
: Subject: ExternalFileField with whitespaces ... : I think it is a bug, therefore I opened issue SOLR-2335. : : To handle this problem we now have to decide if we implement a : workaround in our application to replace whitespaces or if we try to : patch solr to work with whitepaces in dy

  1   2   3   4   5   6   7   8   9   10   >