Re: Performing DIH on predefined list of IDS

2015-02-21 Thread Shawn Heisey
On 2/21/2015 1:46 AM, steve wrote: Careful with the GETs! There is a real, hard limit on the length of a GET url (in the low hundreds of characters). That's why a POST is so much better for complex queries; the limit is in the hundreds of MegaBytes. The limit on a GET command (including the

Re: Performing DIH on predefined list of IDS

2015-02-21 Thread Walter Underwood
Am an expert? Not sure, but I worked on an enterprise search spider and search engine for about a decade (Ultraseek Server) and I’ve done customer-facing search for another 6+ years. Let the server reject URLs it cannot handle. Great servers will return a 414, good servers will return a 400,

Re: Performing DIH on predefined list of IDS

2015-02-21 Thread Shawn Heisey
On 2/21/2015 6:33 PM, Walter Underwood wrote: Never do POST for a read-only request. Never. That only guarantees that you cannot reproduce the problem by looking at the logs. If your design requires extremely long GET requests, you may need to re-think your design. I agree with those

RE: Performing DIH on predefined list of IDS

2015-02-21 Thread steve
And I'm familiar with the setup and configuration using Python, JavaScript, and PHP; not at all with Java. Date: Sat, 21 Feb 2015 01:52:07 -0700 From: osta...@gmail.com To: solr-user@lucene.apache.org Subject: RE: Performing DIH on predefined list of IDS That's right, but I am not sure

RE: Performing DIH on predefined list of IDS

2015-02-21 Thread SolrUser1543
That's right, but I am not sure that if it is works with Get I will able to use Post without changing it. -- View this message in context: http://lucene.472066.n3.nabble.com/Performing-DIH-on-predefined-list-of-IDS-tp4187589p4187838.html Sent from the Solr - User mailing list archive

Re: Performing DIH on predefined list of IDS

2015-02-21 Thread SolrUser1543
from any point in case of failure. -- View this message in context: http://lucene.472066.n3.nabble.com/Performing-DIH-on-predefined-list-of-IDS-tp4187589p4187835.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Performing DIH on predefined list of IDS

2015-02-21 Thread steve
@lucene.apache.org Subject: Re: Performing DIH on predefined list of IDS Yes, you right, I am not using a DB. SolrEntityProcessor is using a GET method, so I will need to send relatively big URL ( something like a hundreds of ids ) hope it will be possible. Any way I think

Re: Performing DIH on predefined list of IDS

2015-02-21 Thread Walter Underwood
. Date: Sat, 21 Feb 2015 01:42:03 -0700 From: osta...@gmail.com To: solr-user@lucene.apache.org Subject: Re: Performing DIH on predefined list of IDS Yes, you right, I am not using a DB. SolrEntityProcessor is using a GET method, so I will need to send relatively big URL ( something

RE: Performing DIH on predefined list of IDS

2015-02-21 Thread steve
...@wunderwood.org Subject: Re: Performing DIH on predefined list of IDS Date: Sat, 21 Feb 2015 09:50:46 -0800 To: solr-user@lucene.apache.org The HTTP protocol does not set a limit on GET URL size, but individual web servers usually do. You should get a response code of “414 Request-URI Too Long

Performing DIH on predefined list of IDS

2015-02-20 Thread SolrUser1543
.472066.n3.nabble.com/Performing-DIH-on-predefined-list-of-IDS-tp4187589.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performing DIH on predefined list of IDS

2015-02-20 Thread SolrUser1543
/Performing-DIH-on-predefined-list-of-IDS-tp4187589p4187753.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Performing DIH on predefined list of IDS

2015-02-20 Thread Shawn Heisey
On 2/20/2015 3:46 PM, Shawn Heisey wrote: If the URL parameter is idlist then you can use ${dih.request.idlist} in your SELECT statement. I realized after I sent this that you are not using a database ... the list would simply go in the query you send to the other server. I don't know whether

Re: Performing DIH on predefined list of IDS

2015-02-20 Thread Shawn Heisey
On 2/20/2015 2:57 PM, SolrUser1543 wrote: That's the reason that I want to run on predefined list of IDs. In this case I will able to restart from any point and to know about filed IDs. You can include information on a URL parameter and then use that URL parameter inside your dih config. If

Re: Performing DIH on predefined list of IDS

2015-02-20 Thread Mikhail Khludnev
this message in context: http://lucene.472066.n3.nabble.com/Performing-DIH-on-predefined-list-of-IDS-tp4187589.html Sent from the Solr - User mailing list archive at Nabble.com. -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics http://www.griddynamics.com mkhlud

Re: Performing DIH on predefined list of IDS

2015-02-20 Thread Erick Erickson
another way and I am trying to reinvent the wheel? -- View this message in context: http://lucene.472066.n3.nabble.com/Performing-DIH-on-predefined-list-of-IDS-tp4187589.html Sent from the Solr - User mailing list archive at Nabble.com.