[HACKERS] Wrong charset mappings

2003-02-06 Thread Thomas O'Dowd
Hi all,

One Japanese character has been causing my head to swim lately. I've
finally tracked down the problem to both Java 1.3 and Postgresql.

The problem character is namely:
utf-16: 0x301C
utf-8: 0xE3809C
SJIS: 0x8160
EUC_JP: 0xA1C1
Otherwise known as the WAVE DASH character.

The confusion stems from a very similar character 0xFF5E (utf-16) or
0xEFBD9E (utf-8) the FULLWIDTH TILDE.

Java has just lately (1.4.1) finally fixed their mappings so that 0x301C
maps correctly to both the correct SJIS and EUC-JP character. Previously
(at least in 1.3.1) they mapped SJIS to 0xFF5E and EUC to 0x301C,
causing all sorts of trouble.

Postgresql at least picked one of the two characters namely 0xFF5E, so
conversions in and out of the database to/from sjis/euc seemed to be
working. Problem is when you try to view utf-8 from the database or if
you read the data into java (utf-16) and try converting to euc or sjis
from there.

Anyway, I think postgresql needs to be fixed for this character. In my
opinion what needs to be done is to change the mappings...

euc-jp - utf-8- euc-jp
====
0xA1C1 - 0xE3809C0xA1C1

sjis   - utf-8- sjis
====
0x8160 - 0xE3809C0x8160

As to what to do with the current mapping of 0xEFBD9E (utf-8)? It
probably should be removed. Maybe you could keep the mapping back to the
sjis/euc characters to help backward compatibility though. I'm not sure
what is the correct approach there.

If anyone can tell me how to edit the mappings under:
src/backend/utils/mb/Unicode/

and rebuild postgres to use them, then I can test this out locally.

Looking forward to your replies.

Tom.



---(end of broadcast)---
TIP 6: Have you searched our list archives?

http://archives.postgresql.org



Re: [HACKERS] current build fail

2002-09-02 Thread Thomas O'Dowd

Yeah, it seems to require Ant 1.5 now. This should probably go in the
configure script, ie a test for Ant 1.5 if java enabled?

Tom.

On Mon, 2002-09-02 at 16:30, Tatsuo Ishii wrote:
 I see:
 
 /usr/jakarta-ant-1.4.1/bin/ant -buildfile ./build.xml all \
   -Dmajor=7 -Dminor=3 -Dfullversion=7.3devel -Ddef_pgport=5432 -Denable_debug=yes
 Buildfile: ./build.xml
 
 BUILD FAILED
 
 /usr/local/src/pgsql/current/pgsql/src/interfaces/jdbc/./build.xml:51: Class 
org.apache.tools.ant.taskdefs.condition.And doesn't support the nested isset 
element.
 
 Is my ant 1.4.1 is too old to build PostgreSQL?
 --
 Tatsuo Ishii
 
 ---(end of broadcast)---
 TIP 3: if posting/reading through Usenet, please send an appropriate
 subscribe-nomail command to [EMAIL PROTECTED] so that your
 message can get through to the mailing list cleanly
-- 
Thomas O'Dowd. - Nooping - http://nooper.com
[EMAIL PROTECTED] - Testing - http://nooper.co.jp/labs


---(end of broadcast)---
TIP 2: you can get off all lists at once with the unregister command
(send unregister YourEmailAddressHere to [EMAIL PROTECTED])



Re: [HACKERS] Deadlock situation using foreign keys (reproduceable)

2002-08-25 Thread Thomas O'Dowd

Hi all,

I've been having a lot of trouble with deadlocks in 7.2.1 because of
foreign keys. I dug out a couple of messages from the list archives
which cover this topic.

One particular message indicates a fix was being worked on.

Date: Thu, 11 Apr 2002 09:03:06 -0700 (PDT)
From: Stephan Szabo

Please see past disussions on the fact that the lock grabbed is too
strong.  I'm going to (when I get time to work on it) try out a lower
strength lock that Alex Hayward made a patch for that should
limit/prevent these cases.  Thanks for sending a nice simple test case
to try against :)
--

My question is if this is now resolved for 7.3? I'm trying to figure out
what I can do with my 7.2.1 problems... Has anyone got a back-ported
patch, perhaps against 7.2.2?

Any help appreciated, thanks!

Tom.
-- 
Thomas O'Dowd. - Nooping - http://nooper.com
[EMAIL PROTECTED] - Testing - http://nooper.co.jp/labs


---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]