I don't remember if I already mentioned this: you can split the xml
file * into smaller pieces then import it using importDump.php.

Use a loop to make a file like this and then run it:
#!/bin/bash
php maintenance/importDump.php < /path/pagexml.1
wait
php maintenance/importDump.php < /path/pagexml.2
...

I haven't tried to start many php importDump.php processes working on
different xml files simultaneously, will it work?

* = 
http://blog.prashanthellina.com/2007/10/17/ways-to-process-and-use-wikipedia-dumps/

_______________________________________________
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Reply via email to