Processing of default ignorable code points

2004-08-05 Thread Peter Kirk
In TUS 4.0 Section 5.3, p.111, the following is stated of default ignorable code points: These characters are also ignored except with respect to specific, defined processes; for example, ZERO WIDTH NON-JOINER is ignored in collation. ... For more information, see Section 5.20, Default

Re: Processing of default ignorable code points

2004-08-05 Thread Asmus Freytag
At 11:11 AM 8/5/2004, Peter Kirk wrote: In TUS 4.0 Section 5.3, p.111, the following is stated of default ignorable code points: These characters are also ignored except with respect to specific, defined processes; for example, ZERO WIDTH NON-JOINER is ignored in collation. ... For more

Re: Processing of default ignorable code points

2004-08-05 Thread Peter Kirk
On 05/08/2004 21:54, Asmus Freytag wrote: ... This has some quite serious implication for processing of texts including ZW(N)J, variation selectors etc. How these characters are treated is important, but there isn't as much of an issue here as you make it out to be. ... Thank you for the