> way of thinking.� What if every feed was during polling checked for > language and compared to it's tag?� You could automatically mark them > for repair.� I suspect (though I am no language expert) that a quick > scan for things like the/le/s� could quickly give you an educated guess > of english/french/spanish.� There are probably 8-10 most common > languages.
automated language identification is *very* hard to do well. simple regex hunts might get you up to 80% or so, but that really isn't very satisfactory when compared to human-processing of all the feeds. [Non-text portions of this message have been removed] ------------------------ Yahoo! Groups Sponsor --------------------~--> $4.98 domain names from Yahoo!. Register anything. http://us.click.yahoo.com/Q7_YsB/neXJAA/yQLSAA/IRislB/TM --------------------------------------------------------------------~-> If you're getting "too much mail" then send a message to: [EMAIL PROTECTED] (this will tell it to stop sending you mail) To change your membership use THIS WEB PAGE: http://finance.groups.yahoo.com/group/syndic8/join (here you can set your mail to digest, no mail or LEAVE the list) To find more info about Syndicated XML newsfeeds visit http://www.syndic8.com/ Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/syndic8/ <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
