Re: Server vs Client - JDK compatibility

2014-01-07 Thread Gnanam
Thanks Alex for the response. Alexandre Rafalovitch wrote > What features are you planning to use from SolrJ client? Because you can > always just talk to Solr server directly with HTTP query URLs and JSON > results. Because SolrJ is a Java client, we've chosen that as the default client that wi

Re: Passing variables as values in Query Filter

2014-01-07 Thread Mukundaraman valakumaresan
Hi Ahmet, Thanks a lot What I need is this . q={!lucene df=city v=$qq}&qq=customfunc(x) In this case, qq=custfunc(x) --> where custfunc is a custom function that has to be executed. Instead, how it acts now is, it takes it as a string to search if qq is a number, you will get a NumberFormatExce

Re: questions on the collections API usage (solrcloud 4.5.1)

2014-01-07 Thread Shawn Heisey
On 1/7/2014 12:55 PM, jhittner wrote: > Hi, I'm working on setting up my first SolrCloud instance and have a three > questions I was hoping for some help with. I am running Solr 4.5.1. > > 1- I have 2 different schema's and 2 solrconfigs that I currently place in a > single conf folder that get

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Alexandre Rafalovitch
HTTPClient is probably what you are looking for: http://hc.apache.org/httpclient-3.x/ . It used to be very popular. Notice that it is deprecated, but the replacement requires JDK 1.5. This old one, I think, should work with older JDKs. Then, you will need either XML or JSON parser for the results

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Shawn Heisey
On 1/7/2014 10:19 PM, Gnanam wrote: > Shawn Heisey-4 wrote >> Although SolrJ is a standalone component, it is also an integral part of >> Solr itself, so it has the same Java requirement as Solr. It is highly >> unlikely that it will work at all with a 1.3.x Java version. > > Thanks Shawn. So wh

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Gnanam
Chris Hostetter-3 wrote > Your best bet is probably to ignore SolrJ -- just pick an HTTP library and > an XML serialiation library that you are familiar with and know will run > in your client app and use them to talk to Solr with some custom code to > format your docs in XML for indexing and pa

Re: questions on the collections API usage (solrcloud 4.5.1)

2014-01-07 Thread jhittner
You are correct. I am trying to run two collections. each collection with its own solrconfig and schema. I'm just having some issues creating these separate collections by the API without having to modify the core.properties and create the empty conf directory. How do I tell the collections AP

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Walter Underwood
Doesn't 1.3 have Y2K problems? I thought we got rid of that ancient stuff a decade ago. Nothing supports 1.3. You get to use old, unsupported versions of everything. With tons of security holes. wunder On Jan 7, 2014, at 9:19 PM, Gnanam wrote: > Shawn Heisey-4 wrote >> Although SolrJ is a st

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Gnanam
Shawn Heisey-4 wrote > Although SolrJ is a standalone component, it is also an integral part of > Solr itself, so it has the same Java requirement as Solr. It is highly > unlikely that it will work at all with a 1.3.x Java version. Thanks Shawn. So which version of Solr supports JDK 1.3? Or any

RE: Range queries with Grouping is slow?

2014-01-07 Thread Smiley, David W.
Kranti, I can't speak to the specific slow-down while grouping, but if you expect to run [* TO *] queries with any frequency then you should index a boolean flag and query for that instead. You might also reduce the precisionStep value for the field you are using to 6 or even 4. But wow that'

(Nested) grouping vs. (nested) faceting (aka pivot faceting)

2014-01-07 Thread Otis Gospodnetic
Hi, https://issues.apache.org/jira/browse/SOLR-2553 - "Nested Field Collapsing" caught my attention. I'm not familiar with the implementation details of grouping (aka field collapsing) or pivot faceting but shouldn't they share a lot of code and be treated as very closely related maybe ev

Range queries with Grouping is slow?

2014-01-07 Thread Kranti Parisa
Is there any known issue with Range queries + grouping? Case1: q=id:123&group=true&sort=price asc&group.field=entityId&group.limit=2&group.ngroups=true Case2: q=id:123 AND price:[* TO *]&group=true&sort=price asc&group.field=entityId&group.limit=2&group.ngroups=true Index Size:10M/~5GB After run

Re: config JoinQParserPlugin

2014-01-07 Thread Kranti Parisa
Ray, FYI: there are more sophisticated joins available via https://issues.apache.org/jira/browse/SOLR-4787 not on trunk yet, but worth taking a look. Thanks, Kranti K. Parisa http://www.linkedin.com/in/krantiparisa On Thu, Jan 2, 2014 at 8:05 PM, Ray Cheng wrote: > Hi Chris, > > > but also e

Re: how to best convert some term in q to a fq

2014-01-07 Thread Kranti
I thought the intention to convert country as fq is to hit the filter cache for performance than boosting results. > On Dec 27, 2013, at 10:31 PM, Josh Lincoln wrote: > > what if you add your country field to qf with a strong boost? the search > experience would be slightly different than if yo

Re: how to best convert some term in q to a fq

2014-01-07 Thread Kranti
As Joel suggested it would be easy to find that outside of solr. But if you really want to do the solr way, then you would need to write custom request handler or query component. The later needs more understanding of solr/lucene APIs. The former would be relatively simple to set the fq into sol

Re: questions on the collections API usage (solrcloud 4.5.1)

2014-01-07 Thread Erick Erickson
This sounds like you really want two different collections. Using two different configs/schemas is not compatible with a single collection. Perhaps you could back up and tell us why you think you need to do this? Sounds like an XY problem. Best Erick On Jan 7, 2014 2:56 PM, "jhittner" wrote: > H

Re: Query Validation How To

2014-01-07 Thread Ahmet Arslan
Hi Michael, I would look at tests, a subclass of org.apache.solr.SolrTestCaseJ4, for example org.apache.solr.search.TestRangeQuery could be a starting point. Ahmet On Wednesday, January 8, 2014 12:21 AM, Michael Knapp wrote: Hi, My team had a request to host a web service that validates a

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-07 Thread Ahmet Arslan
Hi Amit, I see wt=javabin in the response you pasted. I think with solrJ you there are two response parsers. javabin and xml. Since there is no jsonparser, Using plain http client and issuing GET commands would be your bet.  Ahmet On Wednesday, January 8, 2014 12:07 AM, Amit Jha wrote: Hey H

Query Validation How To

2014-01-07 Thread Michael Knapp
Hi, My team had a request to host a web service that validates a query to our solr instance without actually submitting the query. I'm having some trouble getting it to work. At the moment I have successfully loaded in a SolrConfig and IndexSchema, which were built with the same config and schem

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-07 Thread Amit Jha
Hey Hoss, Thanks for replying back..Here is the response generated by solrj. *SolrJ Response*: ignore the Braces at It have copied it from big chunk Response: {responseHeader={status=0,QTime=0,params={lowercaseOperators=true,sort=score desc,cache=false,qf=content,wt=javabin,rows=100,defType=e

Perl Client for SolrCloud

2014-01-07 Thread Saumitra Srivastav
Is there any perl client for SolrCloud. There are some Solr clients in perl but they are for single node Solr. I couldn't find anyone which can connect to SolrCloud similar to SolrJ's CloudSolrServer. Regards, Saumtra -- View this message in context: http://lucene.472066.n3.nabble.com/Perl-C

Re:Indexing URLs from websites

2014-01-07 Thread Markus Jelsma
You need to use the invertlinks command to build a database with docs with inlinks and anchors. Then use the index-anchor plugin when indexing. Then you will have a multivalued field with anchors pointing to your document. Teague James schreef:I am trying to index a website that contains links

questions on the collections API usage (solrcloud 4.5.1)

2014-01-07 Thread jhittner
Hi, I'm working on setting up my first SolrCloud instance and have a three questions I was hoping for some help with. I am running Solr 4.5.1. 1- I have 2 different schema's and 2 solrconfigs that I currently place in a single conf folder that get uploaded to zookeeper automatically by tomcat (b

Re: jetty version 8.1.8.v20121106 stable?

2014-01-07 Thread Otis Gospodnetic
I don't think there's a notion of stable vs. unstable in Jetty world, just recent vs. old. This falls in the old bucket. Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Tue, Jan 7, 2014 at 11:37 AM, gpssolr2020 wrote: >

Re: Indexing URLs from websites

2014-01-07 Thread Otis Gospodnetic
You could use something like Apache Droids - http://incubator.apache.org/droids/ Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Tue, Jan 7, 2014 at 2:27 PM, Teague James wrote: > I am trying to index a website that contai

Indexing URLs from websites

2014-01-07 Thread Teague James
I am trying to index a website that contains links to documents such as PDF, Word, etc. The intent is to be able to store the URLs for the links to the documents. For example, when indexing www.example.com which has links on the page like "Example Document" which points to www.example.com/docs/ex

ANN: Solr Next

2014-01-07 Thread Yonik Seeley
It's time to start working on the next major evolution of Solr (much as we did years ago for the SolrCloud effort). To kick things off, I've started a project on github and implemented "off-heap" filters, as a first step toward taking performance to the next level. For a number of reasons, we fel

Re: How to boost documents ?

2014-01-07 Thread Ahmet Arslan
Hi Hoss, Thanks for the explanation. Very complicated stuff. I never understand NestedQParserPlugin. We want all the documents with all terms (mm=100%) get an extra 1000 points, but change nothing else. How would you restructure the following query? q=beautiful Christmas tree&mm=2&qf=title^12

Re: How to boost documents ?

2014-01-07 Thread Chris Hostetter
: http://localhost:8983/solr/collection1/select?q=ipod : belkin&wt=xml&debugQuery=true&q.op=AND&defType=edismax&bf=map(query($qq),0,0,0,100.0)&qq={!edismax}power : : The error is : : org.apache.solr.search.SyntaxError: Infinite Recursion detected parsing query : 'power' : : And the stacktrace :

SOLR suggester component - Get suggestion dump

2014-01-07 Thread Developer
I am currently using the suggester component for auto suggest. I need to blacklist few of the suggestions generated during indexing hence I am trying to get entire list of suggestions generated during indexing, is there a way to get that dump? -- View this message in context: http://lucene.47

Re: no servers hosting shard

2014-01-07 Thread patrick conant
We found a way to recover. This sequence allowed everything to start up successfully. - Stop all Solr instances - Stop all Zookeeper instances - Start all Zookeeper instances - Start Solr instances one at a time. Restarting the first Solr instance took several minutes, but the subsequent instanc

Re: SOLR Security - Displaying endpoints to public

2014-01-07 Thread Michael Della Bitta
I think generally it might be true that it's too difficult for an admin without very specific knowledge of Solr internals to utilize simple URL rewriting to prevent exploits. To show what I mean, here's a story where someone was able to exploit a Solr server through a custom webapp, which in theory

Re: no servers hosting shard

2014-01-07 Thread patrick conant
After a full bounce of Tomcat, I'm now getting a new exception (below). I can browse the Zookeeper config in the Solr admin UI, and can confirm that there's a node for '/collections/customerOrderSearch/leaders/shard2', but no node for 'collections/customerOrderSearch/leaders/shard1'. Still, any i

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-07 Thread Chris Hostetter
: We have index where date field have default value as 'NOW'. We are using : solrj to query solr and when we try to convert query : response(response.getResponse) to JSON object in java. The JSON You're going to have to show us some real code, some real data, and a real error exception that you

jetty version 8.1.8.v20121106 stable?

2014-01-07 Thread gpssolr2020
Hi all, 8.1.8.v20121106 is the stable version of jetty??? Please let me know your thoughts. Thanks.. -- View this message in context: http://lucene.472066.n3.nabble.com/jetty-version-8-1-8-v20121106-stable-tp4110005.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records

2014-01-07 Thread Yago Riveiro
You have your GC tuned? In the pass I had a lot of problems with zookeeper as a result of GC pauses because my heap was too big. Increase your heap to 20G or more, and use some of the configurations exposed in this thread http://wiki.apache.org/solr/ShawnHeisey The first works fine for me wit

solr-user@lucene.apache.org

2014-01-07 Thread cwhi
I agree, but that's the only information that was returned from the interface. I had a look through the logs and there isn't a deeper stack trace, but I noticed these errors directly before that exception that might be helpful: ERROR - 2014-01-06 16:23:12.426; org.apache.solr.common.SolrException

Re: DateField - Invalid JSON String Exception - converting Query Response to JSON Object

2014-01-07 Thread Amit Jha
I am using it. But timestamp having ":" in between causes the issue. Please help On Tue, Jan 7, 2014 at 11:46 AM, Ahmet Arslan wrote: > Hi Amit, > > If you want json response, Why don't you use wt=json? > > Ahmet > > > On Tuesday, January 7, 2014 7:34 AM, Amit Jha > wrote: > Hi, > > > We have

Re: Invalid version (expected 2, but 60) or the data in not in 'javabin' format exception while deleting 30k records

2014-01-07 Thread gpssolr2020
Thanks all for the reply. we are working on that to reduce the delete query size. But after that we faced one more issue.The issue is our batch process is able to delete 16k records but we got an OOM exception in one server.(out of 4 server in solrcloud).We are using solr 4.2 and zookeeper 3.4.5.

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Alexandre Rafalovitch
What features are you planning to use from SolrJ client? Because you can always just talk to Solr server directly with HTTP query URLs and JSON results. Do you need to support multiple Solr servers? Do you want bean mapping? Something else? Regards, Alex. Personal website: http://www.outerthou

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Chris Hostetter
: > Currently our application is running on BroadVision server which is actually : > based on very older version of JDK that is v1.3. Now we've a requirement ... : > and the client library (SolrJ) running behind a lower version (JDK 1.3), : > since the client API will be invoked/used from

Re: Server vs Client - JDK compatibility

2014-01-07 Thread Shawn Heisey
On 1/7/2014 7:30 AM, Gnanam wrote: > Currently our application is running on BroadVision server which is actually > based on very older version of JDK that is v1.3. Now we've a requirement > for searching documents and we want to integrate Apache Solr within our > application. We have also decide

Re: Minimal solr.xml since 4.4 and beyond

2014-01-07 Thread Shawn Heisey
On 1/7/2014 3:53 AM, Scatman wrote: > I'm just back to work with Solr and saw the feature, since 4.4, with the new > structure of solr.xml > > I'm just wondering, since core's properties are in the core.properties > files, what is the new minimal file for the solr.xml ? > > I saw in a topic that

Solr [version 3.6.1] filter query issue

2014-01-07 Thread anarchos78
I have indexed a small collection (about 150k documents). I give user the ability to make filtered queries using dropdown boxes. The “field query” fields are: apo_taxonomy, apo_dik, apo_number, and apo_date. Below is a portion of schema.xml:

Solr Replication Index directory disappears

2014-01-07 Thread anand chandak
Hi, We are using solr 4.4 version and am facing some issue with replication, we are trying to replicate very large index about 105G. Once the replication is done, I see the index. directory but the index directory is not present ? Why is this happening ? Also, I see with every iteration t

Unit testing custom update request processor

2014-01-07 Thread Jorge Luis Betancourt Gonzalez
Happy new year! I’ve developed some custom update request processors to accomplish some custom logic needed in some user cases. I’m trying to write test for this processor, but I’d like to test in a very similar way of how the built in processors are tested in the solr source code. Is there any

Index Sizes

2014-01-07 Thread Steven Bower
I was looking at the code for getIndexSize() on the ReplicationHandler to get at the size of the index on disk. From what I can tell, because this does directory.listAll() to get all the files in the directory, the size on disk includes not only what is searchable at the moment but potentially also

Server vs Client - JDK compatibility

2014-01-07 Thread Gnanam
Currently our application is running on BroadVision server which is actually based on very older version of JDK that is v1.3. Now we've a requirement for searching documents and we want to integrate Apache Solr within our application. We have also decided to run Apache Solr service separately in

Re: Passing variables as values in Query Filter

2014-01-07 Thread Ahmet Arslan
Hi Mukund, I am not sure what you are after but may be you can use this : q={!lucene df=city v=$qq}&qq=Adyar https://cwiki.apache.org/confluence/display/solr/Local+Parameters+in+Queries Ahmet On Tuesday, January 7, 2014 3:39 PM, Mukundaraman valakumaresan wrote: Hi The following query e

Re: Solr + velocity user to session/cookie

2014-01-07 Thread Erik Hatcher
I think the only option would be to use client-side cookies. Solr requests are stateless and there’s no server-side state maintained, no “sessions”. What are the use cases of your application? Perhaps something like Blacklight would work for you as a full featured search app with pluggable au

Passing variables as values in Query Filter

2014-01-07 Thread Mukundaraman valakumaresan
Hi The following query executes http://localhost:8983/solr/collection1/select?wt=json&indent=true&q=locality:A dyar But I wanted something like the one below which is not working. http://localhost:8983/solr/collec

Solr + velocity user to session/cookie

2014-01-07 Thread ostrowskij
Hi, I have to keep login and password in some way. And read it in my RequestHandler. Is that possible to add my own session or cookies do solr or velocity? How? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-velocity-user-to-session-cookie-tp4109965.html Sent

solr-user@lucene.apache.org

2014-01-07 Thread Erick Erickson
You need to give us a more complete stack trace to say anything intelligent, what you provided doesn't give us much to go on. Best, Erick On Jan 6, 2014 6:05 PM, "cwhi" wrote: > I'm adding dozens of documents every few minutes to a SolrCloud instance > with > 3 machines and ~ 25 million document

failed to store solr index in hadoop 2.2.0

2014-01-07 Thread javozzo
Hi, I'm new in Solr. I use solr 4.6 and hadoop 2.2.0 I tried to store solr index in the hdfs following this tutorial https://cwiki.apache.org/confluence/display/solr/Running+Solr+on+HDFS i have no error in log file but in the filesystem the index is not created. Any ideas about the problem? Than

Re: sort multiple fields using solr not working

2014-01-07 Thread Prabhudas
Hi dhanesh, This 'sort'=>array('packageId desc, sortId desc') is not working for me. I am working in the solr version 3.6. What to do? -- View this message in context: http://lucene.472066.n3.nabble.com/sort-multiple-fields-using-solr-not-working-tp2151247p4109936.html Sent from the Solr - Use

Minimal solr.xml since 4.4 and beyond

2014-01-07 Thread Scatman
Hi everyone, I'm just back to work with Solr and saw the feature, since 4.4, with the new structure of solr.xml I'm just wondering, since core's properties are in the core.properties files, what is the new minimal file for the solr.xml ? I saw in a topic that even if solr.xml wasn't create, so

Re: SOLR Security - Displaying endpoints to public

2014-01-07 Thread Raymond Wiker
Indeed it is - but you'll also need mod_proxy ("just" rewriting will not be sufficient). On Tue, Jan 7, 2014 at 3:42 AM, Otis Gospodnetic wrote: > Apache url_rewrite can help with this and it's only a few minutes to set > up. > > Otis > -- > Performance Monitoring * Log Analytics * Search Analy

AW: Index for csv-file created successfully, but no data is shown

2014-01-07 Thread Huynh, Chi-Hao
Thanks Otis, I didn't know there was a Cloudera Search Mailing list. Will try it out. -Ursprüngliche Nachricht- Von: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Gesendet: Dienstag, 7. Januar 2014 03:53 An: solr-user@lucene.apache.org Betreff: Re: Index for csv-file created succe