: Doesn't this bulk upload sound a bit like Simon's GData server? That, : too, uses APP, I believe.
bulk *upload* is really an afterthough of SOLR-66 ... from yonik's initial description of the issue, he seems to be trying to address "boostrap" problems for quickly indexing a lot of data from a *local* file with minimal markup/parsing (ie: tab delimited or CSV) Personaly, i think we may be getting a little too side tracked by discussions of uploading/transforming and APP ... those are all decent ideas, but they are seperate issues. I think if we had a basic mechanims for parsing CSV files that assumed homogenous fields, we would get pretty damn far for a lot of people -- even if we didn't address multi-value fields. ----- Original Message ---- From: Walter Underwood <[EMAIL PROTECTED]> To: solr-dev@lucene.apache.org Sent: Tuesday, November 7, 2006 2:36:37 PM Subject: Re: [jira] Commented: (SOLR-66) bulk data loader On 11/7/06 11:22 AM, "Yonik Seeley (JIRA)" <[EMAIL PROTECTED]> wrote: > Yes, posting queries work because it's all form-data (query args). > But, what if we want to post a complete file, *and* some extra info/parameters > about how that file should be handled? One approach is the Atom Publishing Protocol. That is pretty clear about content and metainformation. It isn't designed to solve every problem, but it handles a broad range of publishing, so it could be a good fit for many uses of Solr. APP is nearly finished. The latest draft is here (second URL also has HTML versions). http://www.ietf.org/internet-drafts/draft-ietf-atompub-protocol-11.txt http://tools.ietf.org/wg/atompub/draft-ietf-atompub-protocol/ wunder -- Walter Underwood Search Guru, Netflix : -Hoss
