Re: Does LWP know anything (or need to know anything) about Unicode?

2004-10-11 Thread Nick Ing-Simmons
Rick Measham <[EMAIL PROTECTED]> writes: >G'day Unicode Gurus and other assorted members of the perl Unicode >community. > >I have a script that attempts to collect translations from Babelfish. >I've posted it below. > >It uses LWP::Useragent to turn an English phrase into Japanese (or any >other l

Re: Does LWP know anything (or need to know anything) about Unicode?

2004-10-11 Thread Marco Baroni
LWP I believe just ships octets about. But it should have a mechanism to tell you the meta-data that HTTP marked those octets with - in this case there should be something like a content-transfer-encoding header that tells _you_ what name to feed to Encode to get bytes as Unicode. You then have to