Re: solution... (damn m$!!) RE: newbie: foreign characters

[Glenn Linderman]

On approximately 1/2/2004 1:09 AM, came the following characters from
the keyboard of Tom Roos:
use utf8;
use Encode;
[snip.....]

$resolvefile = "itemstrings.txt";
open (RESOLV, $resolvefile) || die "Cant read $resolvefile\n";
while ($mydata = <RESOLV>)
{
        @my_isutfstuff = map {ord $_} split //, $mydata;
I'm glad you figured out a solution from my and Rob's comments, and 
possibly other research.  But I'd like an explanation of why your 
solution calculates @my_isutfstuff, and then doesn't seem to use it? 
This question results from my being completely ignorant of the Perl 
Encode and utf8 modules.  And I may need to become less ignorant of them 
soon, and I may need to start reading Notepad Unicode files soon, so 
this topic was very interesting to be, and I'm glad I was able to 
contribute a little to your understanding of the problem, so that I 
might also benefit from your solution.

        $newdata = decode("utf16be", $mydata);
        print $newdata."\n";
}
close RESOLV;


-----Original Message-----
From: Glenn Linderman [mailto:[EMAIL PROTECTED]
Sent: 31 December 2003 08:28
To: Sisyphus
Cc: Tom Roos; [EMAIL PROTECTED]
Subject: Re: newbie: foreign characters
On approximately 12/30/2003 8:01 PM, came the following characters from
the keyboard of Sisyphus:

Glenn Linderman wrote:


I don't know, under the assumption that the data is in 16-bit Unicode, 
whether your reply hit any marks or not, but I don't think that either 
cp1252 or cp850 deal with 16-bit Unicode correctly.

Yep ... I know stuff-all about dealing with 16-bit Unicode ... and 
didn't realise that the extra spaces were symptomatic of its presence.
However, if the notepad file is displaying correctly, wouldn't that mean 
that cp1252 is dealing with the 16-bit Unicode correctly ?


Oh, maybe cp1252 is the Unicode page... I can't keep track of codepages 
very well... they are too numerous...


Hopefully the OP will get back to us and let us know if the codeset 
conversion stuff was in any way helpful :-)

Cheers,
Rob


------------------------------------------------------------------------

ÿþi
e
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
e
e
t
e
t
í
i
e
n
n
í
o
,
n
í
i
n
n
í
e
e
í
.
e
e
e
í
í
.Ng0
0;eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'`L0B0Š0~0Y00S0n0îOck×0í0°0é0à0’0À0¦0ó0í0ü0É0W0f0
0³0ó0Ô0å0ü0¿0’0ÝOw‹W0f0O0`0U0D00¤0ó0¹0È0ü0ë0Œ_k0o0
0³0ó0Ô0å0ü0¿0n0?Qw?ÕRL
[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED]'[EMAIL PROTECTED] 0h0D0F0?1_'` Nckj0 0n09eŠHrg0Y00S0n0îOck×0í0°0é0à0k0ˆ0c0f0
0INckj0 0h0D0F0?1_'` Nckj0 
Ng0
0;eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'`L0B0Š0~0Y00S0n0îOck×0í0°0é0à0’0À0¦0ó0í0ü0É0W0f0
0³0ó0Ô0å0ü0¿0’0ÝOw‹W0f0O0`0U0D00¤0ó0¹0È0ü0ë0Œ_k0o0
0³0ó0Ô0å0ü0¿0n0?Qw?ÕRL0Å
[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL 
PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'[EMAIL PROTECTED];eƒd€L0×0í0°0é0à0’0Ÿ[Lˆg0M0‹0ïSý€'`L0B0Š
[EMAIL PROTECTED] NÐ?Lˆz?^0N}? NÐ?Lˆz?^0N}? NÐ?Lˆz?^0N}? NÐ?Lˆz?^0N}? NÐ?Lˆz?^0N}? NÐ?Lˆz?^0N}? NS_?O—_Q?u˜ïSåNû‹ÖS,g0W‡eöN&[EMAIL PROTECTED](u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ N?O(u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ N?O(u 
Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ N?O(u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ N?O(u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ 0OUL˜0ËzsSN      [EMAIL PROTECTED] 0‰[hQ'`OUL˜ÿsŠ0}ÇŒ
ŠËŠÃS±• Nf„v?O(u€?O(u*g“}ˆc
k„v²}Ùz†O€‹ÖS¨`,g_jû–f?
[EMAIL PROTECTED](u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ N?O(u Ng×S?›NOUL˜q_ÿ—)N„vz_0¨`ïSåNž_ 
--
Glenn -- http://nevcal.com/
===========================
The best part about procrastination is that you are never bored,
because you have all kinds of things that you should be doing.
_______________________________________________
Perl-Win32-Users mailing list
[EMAIL PROTECTED]
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs