Re: Using Solr-3304
http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
Thanks David, that's exactly what I needed. One thing, from my experiments, the order seems to be Xmin Ymin Xmax Ymax for both the indexing and the query. Eric. Date: Fri, 21 Sep 2012 10:34:07 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
David, I tried increasing the maxDetailDist, as I need 9 decimal value precision.fieldType name=rectangle class=solr.SpatialRecursivePrefixTreeFieldType geo=false distErrPct=0.025 maxDetailDist=0.1 / But when I do, I get the following error: Data SEVERE: org.apache.solr.common.SolrException: ERROR: [doc=MV0005] Error adding field 'rectangle'='45.634801234 1.5 45.634805667 2.5' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) string Any ideas?Eric. PS: what does geo=true\false change? Date: Fri, 21 Sep 2012 10:34:07 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Using Solr-3304
For your use-case of time ranges, set geo=false (as you've done). At this point you have a quad tree but it doesn't (yet) work properly for the default min max numbers that a double can store, so you need to specify the boundary rectangle explicitly and to the particular numbers for your use-case. Use 0 for the 'Y's. Think about the smallest granularity of time you need (a minute?) and what the earliest time you need to recognize and the furthest out as measured in your time granularity (in minutes?). The boundary minX can be zero which will be your epoch, and the maxX will be the farthest out in time you can go -- who knows. Set maxDetailDist to 1. On Sep 21, 2012, at 4:44 PM, Eric Khoury [via Lucene] wrote: David, I tried increasing the maxDetailDist, as I need 9 decimal value precision.fieldType name=rectangle class=solr.SpatialRecursivePrefixTreeFieldType geo=false distErrPct=0.025 maxDetailDist=0.1 / But when I do, I get the following error: Data SEVERE: org.apache.solr.common.SolrException: ERROR: [doc=MV0005] Error adding field 'rectangle'='45.634801234 1.5 45.634805667 2.5' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) string Any ideas?Eric. PS: what does geo=true\false change? Date: Fri, 21 Sep 2012 10:34:07 -0700 From: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=0 To: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=1 Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009479.html To unsubscribe from Solr 4.0 - Join performance, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=3998827code=RFNNSUxFWUBtaXRyZS5vcmd8Mzk5ODgyN3wxMDE2NDI2OTUw. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009483.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
I have to deal with 3 parameters, time filtering, a groupid (1 to 2000) and a quality value (1 to 5), and was hoping to use a X format = Group.Ticks and Y = quality level, where ticks is the number of ticks for a given time, rounded to the minute. In other words, my field indexing would look like: field name=RightsData245.634801234 1.5 45.634805667 2.5/field. I guess I'm missing something, as I thought that would define a rectangle. Where do the min max values come into play? Date: Fri, 21 Sep 2012 13:55:24 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 For your use-case of time ranges, set geo=false (as you've done). At this point you have a quad tree but it doesn't (yet) work properly for the default min max numbers that a double can store, so you need to specify the boundary rectangle explicitly and to the particular numbers for your use-case. Use 0 for the 'Y's. Think about the smallest granularity of time you need (a minute?) and what the earliest time you need to recognize and the furthest out as measured in your time granularity (in minutes?). The boundary minX can be zero which will be your epoch, and the maxX will be the farthest out in time you can go -- who knows. Set maxDetailDist to 1. On Sep 21, 2012, at 4:44 PM, Eric Khoury [via Lucene] wrote: David, I tried increasing the maxDetailDist, as I need 9 decimal value precision.fieldType name=rectangle class=solr.SpatialRecursivePrefixTreeFieldType geo=false distErrPct=0.025 maxDetailDist=0.1 / But when I do, I get the following error: Data SEVERE: org.apache.solr.common.SolrException: ERROR: [doc=MV0005] Error adding field 'rectangle'='45.634801234 1.5 45.634805667 2.5' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) string Any ideas?Eric. PS: what does geo=true\false change? Date: Fri, 21 Sep 2012 10:34:07 -0700 From: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=0 To: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=1 Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009479.html To unsubscribe from Solr 4.0 - Join performance, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=3998827code=RFNNSUxFWUBtaXRyZS5vcmd8Mzk5ODgyN3wxMDE2NDI2OTUw. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009483.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Using Solr-3304
Spatial doesn't (yet) support 3d. If you have multi-value relationships across all 3 parameters you mentioned, then you're a bit stuck. I thought you had 1d (time) multi-value ranges without needing to correlate that to other numeric ranges that are also multi-value. On Sep 21, 2012, at 5:03 PM, Eric Khoury wrote: I have to deal with 3 parameters, time filtering, a groupid (1 to 2000) and a quality value (1 to 5), and was hoping to use a X format = Group.Ticks and Y = quality level, where ticks is the number of ticks for a given time, rounded to the minute. In other words, my field indexing would look like: field name=RightsData245.634801234 1.5 45.634805667 2.5/field. I guess I'm missing something, as I thought that would define a rectangle. Where do the min max values come into play? Date: Fri, 21 Sep 2012 13:55:24 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 For your use-case of time ranges, set geo=false (as you've done). At this point you have a quad tree but it doesn't (yet) work properly for the default min max numbers that a double can store, so you need to specify the boundary rectangle explicitly and to the particular numbers for your use-case. Use 0 for the 'Y's. Think about the smallest granularity of time you need (a minute?) and what the earliest time you need to recognize and the furthest out as measured in your time granularity (in minutes?). The boundary minX can be zero which will be your epoch, and the maxX will be the farthest out in time you can go -- who knows. Set maxDetailDist to 1. On Sep 21, 2012, at 4:44 PM, Eric Khoury [via Lucene] wrote: David, I tried increasing the maxDetailDist, as I need 9 decimal value precision.fieldType name=rectangle class=solr.SpatialRecursivePrefixTreeFieldType geo=false distErrPct=0.025 maxDetailDist=0.1 / But when I do, I get the following error: Data SEVERE: org.apache.solr.common.SolrException: ERROR: [doc=MV0005] Error adding field 'rectangle'='45.634801234 1.5 45.634805667 2.5' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) string Any ideas?Eric. PS: what does geo=true\false change? Date: Fri, 21 Sep 2012 10:34:07 -0700 From: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=0 To: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=1 Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009479.html To unsubscribe from Solr 4.0 - Join performance, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=3998827code=RFNNSUxFWUBtaXRyZS5vcmd8Mzk5ODgyN3wxMDE2NDI2OTUw. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009483.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
The requirments have evolved. :-) This is still the best solution for my needs, I'm close, I belive this can work. Removing quality from the equation, I have to deal with pairs of GroupIds and Times. If I set the Y access to 0, as you mentioned, can I create a pair of X values with the groupId as a whole part and the ticks as decimals? In other word, field name=rectangleGroupId.StartTicks 0 GroupId.EndTicks 2.5/field. From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 Date: Fri, 21 Sep 2012 21:07:21 + Spatial doesn't (yet) support 3d. If you have multi-value relationships across all 3 parameters you mentioned, then you're a bit stuck. I thought you had 1d (time) multi-value ranges without needing to correlate that to other numeric ranges that are also multi-value. On Sep 21, 2012, at 5:03 PM, Eric Khoury wrote: I have to deal with 3 parameters, time filtering, a groupid (1 to 2000) and a quality value (1 to 5), and was hoping to use a X format = Group.Ticks and Y = quality level, where ticks is the number of ticks for a given time, rounded to the minute. In other words, my field indexing would look like: field name=RightsData245.634801234 1.5 45.634805667 2.5/field. I guess I'm missing something, as I thought that would define a rectangle. Where do the min max values come into play? Date: Fri, 21 Sep 2012 13:55:24 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: Re: Using Solr-3304 For your use-case of time ranges, set geo=false (as you've done). At this point you have a quad tree but it doesn't (yet) work properly for the default min max numbers that a double can store, so you need to specify the boundary rectangle explicitly and to the particular numbers for your use-case. Use 0 for the 'Y's. Think about the smallest granularity of time you need (a minute?) and what the earliest time you need to recognize and the furthest out as measured in your time granularity (in minutes?). The boundary minX can be zero which will be your epoch, and the maxX will be the farthest out in time you can go -- who knows. Set maxDetailDist to 1. On Sep 21, 2012, at 4:44 PM, Eric Khoury [via Lucene] wrote: David, I tried increasing the maxDetailDist, as I need 9 decimal value precision.fieldType name=rectangle class=solr.SpatialRecursivePrefixTreeFieldType geo=false distErrPct=0.025 maxDetailDist=0.1 / But when I do, I get the following error: Data SEVERE: org.apache.solr.common.SolrException: ERROR: [doc=MV0005] Error adding field 'rectangle'='45.634801234 1.5 45.634805667 2.5' msg=Y values [-1.7976931348623157E308 to Infinity] not in boundary Rect(minX=-1.7976931348623157E308,maxX=1.7976931348623157E308,minY=-1.7976931348623157E308,maxY=1.7976931348623157E308) string Any ideas?Eric. PS: what does geo=true\false change? Date: Fri, 21 Sep 2012 10:34:07 -0700 From: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=0 To: [hidden email]x-msg://330/user/SendEmail.jtp?type=nodenode=4009479i=1 Subject: Re: Using Solr-3304 http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4 Definitely needs some updating; I will try to get to that this weekend. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009454.html Sent from the Solr - User mailing list archive at Nabble.comhttp://Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009479.html To unsubscribe from Solr 4.0 - Join performance, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=3998827code=RFNNSUxFWUBtaXRyZS5vcmd8Mzk5ODgyN3wxMDE2NDI2OTUw. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009483.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
If you can stick to two dimensions then great. Remember to set the boundary attribute on the field type as I described so that spatial knows the numerical boundaries that all the data must fit in. e.g. boundary=0 0 10 2.5 (substituting whatever appropriate number of time units you need for 10 there). - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009488.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
When I said boundary I meant worldBounds. Oh, and set distErrPct=0 to get precise shapes; the default is non-zero. It'll use more disk space of course, and all the more reason to carefully choose your world bounds carefully. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009490.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Using Solr-3304
Thanks David, I'll play around with it. I appreciate the help,Eric. Date: Fri, 21 Sep 2012 14:47:36 -0700 From: dsmi...@mitre.org To: solr-user@lucene.apache.org Subject: RE: Using Solr-3304 When I said boundary I meant worldBounds. Oh, and set distErrPct=0 to get precise shapes; the default is non-zero. It'll use more disk space of course, and all the more reason to carefully choose your world bounds carefully. - Author: http://www.packtpub.com/apache-solr-3-enterprise-search-server/book -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-Join-performance-tp3998827p4009490.html Sent from the Solr - User mailing list archive at Nabble.com.
