First I create a single large file that has one doc per line from Wikipedia content, using this alg
Anybody disagree that the 1-line-per-doc format is better (at least for Wikipedia)? If so, I'll get rid of the intermediate one-file-per-doc step. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]