Frankly, if you can create a script that'll turn your data into valid
CSV, that might be the easiest, quickest way to ingest your data.
Pragmatic, at least. Avoids the complexity of DIH, allows you to
script the export from your DB in the most efficient manner you can,
and so on.
Solr's CSV update handler is FAST!
Erik
On Jun 3, 2010, at 2:56 AM, David Stuart wrote:
On 3 Jun 2010, at 03:51, Blargy <zman...@hotmail.com> wrote:
Would dumping the databases to a local file help at all?
I would suspect not especally with the size of your data. But it
would be good to know how long that takes i.e. Creating a SQL script
that just pulls that data out how long does that take?
Also have many fields are you indexing per document 10,50,100?
-- View this message in context: http://lucene.472066.n3.nabble.com/Importing-large-datasets-f
tp863447p866538.html
Sent from the Solr - User mailing list archive at Nabble.com.
