Re: How to use geospatial search to find the locations within polygon

2016-03-04 Thread Pradeep Chandra
Thank u for your reply sirNow, I gave the ending point as starting point to close the polygon It is showing this error: {"error":{"msg":"java.lang.NoClassDefFoundError: com/vividsolutions/jts/geom/Lineal","trace":"java.lang.RuntimeException: java.lang.NoClassDefFoundError:

Re: Exception SolrServerException: No live SolrServers available to handle this request:

2016-03-04 Thread Shawn Heisey
On 3/5/2016 12:00 AM, Shawn Heisey wrote: > Not having docValues is actually why you got the error.When I > encountered this error last year, I opened this issue: Reading back through the message thread, I noticed that you never actually included log entries with an error about the incorrect

Re: Exception SolrServerException: No live SolrServers available to handle this request:

2016-03-04 Thread Shawn Heisey
On 3/4/2016 10:44 PM, Mugeesh Husain wrote: > Thank for you consideration, I noticed all of the answer is docvalues > related but i did not define any docvalue type in my schema that why i am > little bit confuse. Not having docValues is actually why you got the error.When I encountered this

Re: Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Shawn Heisey
On 3/4/2016 5:46 AM, Cool Techi wrote: > We are using solr 4.8.1 cloud and have a single shard core and 3 replicas in > total. We are noticing the following issues, > 1) Master propagates slow to to the other nodes/replicas.2) This increase > over a period of time, i.e the data propagation

Re: Question about Solr logs

2016-03-04 Thread Shawn Heisey
On 3/4/2016 10:21 PM, Steven White wrote: > org.apache.solr.update.processor.LogUpdateProcessor; [test] > webapp=/solr path=/update params={wt=xml=2.2} {add=[5539783 > (1527883353280217088), 5539867 (1527883353296994304), , ... (101 adds)]} 0 > 1174 > > What does this log tell me? Is "1174"

Re: Exception SolrServerException: No live SolrServers available to handle this request:

2016-03-04 Thread Mugeesh Husain
Hi Elaine, Thank for you consideration, I noticed all of the answer is docvalues related but i did not define any docvalue type in my schema that why i am little bit confuse. *Thanks,* *Mugeesh Husain * Mobile No:+91-9911175322 Skype ID: mugeesh Email:muge...@gmail.com On Sat, Mar 5, 2016 at

Question about Solr logs

2016-03-04 Thread Steven White
HI folks, I am analyzing a performance issue with Solr during indexing. My simplefiled psedue code looks like so while (more-items) { for (int i = 0; i < 100; i++) { docs.add(doc); } UpdateResponse resp = solrConn.add(docs, 1); // <== yes, using "1" is

RE: Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Any suggestion here would be highly appreciated, this is hampering our production performance and we are not able to pin point any reason. > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Solr Cloud leader propagates slow to other nodes > Date: Fri, 4 Mar 2016

Re: Indexing Twitter - Hypothetical

2016-03-04 Thread Joseph Obernberger
Thank you all very much for all the responses so far. I've enjoyed reading them! We have noticed that storing data inside of Solr results in significantly worse performance (particularly faceting); so we store the values of all the fields elsewhere, but index all the data with Solr Cloud. I

Re: Exception SolrServerException: No live SolrServers available to handle this request:

2016-03-04 Thread Elaine Cario
Mugeesh, I was quite stumped, figured I'd move on to other emails, and the very next email described the issue you are having (if you remove the effect of the Solr Server exception bug). Here's a link to that email chain:

Re: Separating cores from Solr home

2016-03-04 Thread Jan Høydahl
There is also the more clean solution in https://issues.apache.org/jira/browse/SOLR-6671 (not committed). -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 4. mar. 2016 kl. 15.38 skrev Shawn Heisey : > > On 3/3/2016 4:12 AM, Tom Evans wrote: >>

Re: Spatial Search on Postal Code

2016-03-04 Thread Emir Arnautovic
Hi Manohar, I don't think there is such functionality in Solr - you need to do it on client side: 1. find some postal code polygons (you can use open street map - http://wiki.openstreetmap.org/wiki/Key:postal_code) 2. create zip to polygon lookup 3. create code that will expand zip code

Improving findability with UX patterns

2016-03-04 Thread Bjørn Solnørdal Tennøe
I'm interested in your opinions regarding a findability-focused, UX-oriented pattern library. When developing enterprise search solutions over the last 10 years, my experience has consistently been that UX-driven features that are crucial to findability rarely make it into the actual services.

Re: Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
Thank Erik, Does this zip codes index that you created is a one-to-many mapping from zip code to Lat/Lon points? If so, where did you get this mapping CSV file? Thanks, Manohar On Friday, March 4, 2016, Erik Hatcher wrote: > This is just like an implementation I

Re: Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
Thanks Emir, Obviously #2 approach is much better. I know its not straight forward. But, is it really acheivable in Solr? Like building a polygon for a postal code. If so, can you throw some light how to do? Thanks, Manohar On Friday, March 4, 2016, Emir Arnautovic

Re: What is the best way to index 15 million documents of total size 425 GB?

2016-03-04 Thread Evert R.
I have worked with Pentaho and I believe your problem might be there Try to settled a quick php script and you might get better results with it. There is no need for Data Integration on that. Just a tip. Em 04/03/2016 13:12, "Walter Underwood" escreveu: > > > On Mar

Re: How to use geospatial search to find the locations within polygon

2016-03-04 Thread Jack Krupansky
It would be nice for the doc to say that - describe when IsWithin is and isn't appropriate. And give some examples as well for people to copy/mimic. -- Jack Krupansky On Fri, Mar 4, 2016 at 10:20 AM, david.w.smi...@gmail.com < david.w.smi...@gmail.com> wrote: > First of all, assuming this is a

Re: What is the best way to index 15 million documents of total size 425 GB?

2016-03-04 Thread Walter Underwood
> On Mar 3, 2016, at 9:54 AM, Aneesh Mon N wrote: > > To be noted that all the fields are stored so as to support the atomic > updates. Are you doing all of these updates as atomic? That could be slow. If you are supplying all the fields, then just do a regular add.

Re: How to use geospatial search to find the locations within polygon

2016-03-04 Thread david.w.smi...@gmail.com
First of all, assuming this is a standard point-in-polygon situation, use the Intersects predicate -- with point data it's semantically the same as IsWithin and Intersects is much faster. I don't know why you used isDisjointTo in your 2nd example; maybe you want to find when they don't touch?

Re: Indexing Twitter - Hypothetical

2016-03-04 Thread Jack Krupansky
As always, the initial question is how you intend to query the data - query drives data modeling. How real-time do you need queries to be? How fast do you need archive queries to be? How many fields do you need to query on? How much entity recognition do you need in queries? -- Jack Krupansky

Re: Commit after every document - alternate approach

2016-03-04 Thread Shawn Heisey
On 3/3/2016 11:36 PM, sangs8788 wrote: > When a commit fails, the document doesnt get cleared out from MQ and there is > a task which runs in a background to republish the files to SOLR. If we do a > batch commit we will not know we will end up redoing the same batch commit > again. We currenlty

Re: Separating cores from Solr home

2016-03-04 Thread Shawn Heisey
On 3/3/2016 4:12 AM, Tom Evans wrote: > I'm struggling to configure solr cloud to put the index files and > core.properties in the correct places in SolrCloud 5.5. Let me explain > what I am trying to achieve: > > * solr is installed in /opt/solr > * the user who runs solr only has read only

Re: Does SolrEntityProcessor works with Solr Cloud ?

2016-03-04 Thread Shawn Heisey
On 3/3/2016 4:00 AM, Erik Hatcher wrote: > Neeraj - > > SolrEntityProcessor does not yet work with CloudSolrClient, only the direct > HTTP one as you’ve determined. Please feel free to file a JIRA for this > feature request. > > However, practically speaking, using a hard-coded HTTP end-point

Re: Spatial Search on Postal Code

2016-03-04 Thread Erik Hatcher
This is just like an implementation I recently worked on with a customer. It’s very much like this sort of thing ;) - > It’s implemented with Solr, leveraging the

Re: Spatial Search on Postal Code

2016-03-04 Thread Emir Arnautovic
Hi Manohar, This depends on your requirements/usecase. If postal code is interpreted as point than it is expected to have radius that is significantly larger than postal code diameter. In such case you can go with first approach. In order to avoid missing results from postal code in case of

Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Hi, We are using solr 4.8.1 cloud and have a single shard core and 3 replicas in total. We are noticing the following issues, 1) Master propagates slow to to the other nodes/replicas.2) This increase over a period of time, i.e the data propagation time increase as the time from which leader

Spatial Search on Postal Code

2016-03-04 Thread Manohar Sripada
Here's my requirement - User enters postal code and provides the radius. I need to find the records with in the radius from the provided postal code. There are few ways I thought through after going through the "Spatial Search" Solr wiki 1. As Latitude and Longitude positions are required for

Re: [Migration Solr4 to Solr5] Collection reload error

2016-03-04 Thread Dmitry Kan
Hi, Check the the autoCommit and autoSoftCommit nodes in the solrconfig.xml. Set them to reasonable values. The idea is that if you commit too often, searchers will be warmed up and thrown away. If at any point in time you get overlapping commits, there will be several searchers sitting on the

Re: What is the best way to index 15 million documents of total size 425 GB?

2016-03-04 Thread Charlie Hull
On 04/03/2016 07:45, Toke Eskildsen wrote: On Fri, 2016-03-04 at 12:41 +0530, Aneesh Mon N wrote: - is there any difference in posting the data in json format vs xml? - do we get any performance improvement if we generate the json/xml files, scp to the solr server and then push via

Re: Indexing Twitter - Hypothetical

2016-03-04 Thread Charlie Hull
On 03/03/2016 19:25, Toke Eskildsen wrote: Joseph Obernberger wrote: Hi All - would it be reasonable to index the Twitter 'firehose' with Solr Cloud - roughly 500-600 million docs per day indexing each of the fields (about 180)? Possible, yes. Reasonable? It is

Re: Commit after every document - alternate approach

2016-03-04 Thread Emir Arnautovic
Hi Sangeetha, It seems to me that you are using Solr as primary data store? If that is true, you should not do that - you should have some other store that is transactional and can support what you are trying to do with Solr. If you are not using Solr as primary store, and it is critical to