More about vim7: problem with regex subst and combining chars

[Ron Aaron]

The same problem exists if one uses "substitute()" or if one uses the
grouping operator and \1 ... the combining characters get removed.

I'm trying to look at the differences between regexp.c for vim6.4 and
vim7.0, but there are a ton of changes, and I don't know the code :(

Re: vim7: problem with regex subst and combining chars

[Ron Aaron]

> I notice other problems.  For example, $ (in Normal mode) takes me to
> the fifth character.  (With 'ruler' set, I see 17-5 in the status line.)
> Maybe there is a null byte in the fifth or sixth multi-byte character?

I think "$" and "ruler" are working correctly; the other 'characters' are
combining characters and you cannot navigate to them directly.  But if you
do 'ga' on the second character, you'll see it's composed of two
characters (05dc and 05b0).

Thanks for verifying the problem isn't just my builds :)

Re: vim7: problem with regex subst and combining chars

[Benji Fisher]

On Wed, May 17, 2006 at 08:34:22AM -0700, Ron Aaron wrote:
> Arrgh!  I can't send this message to the list, for some reason!  Maybe
> because it has strange characters in it?
> 
> OK:  you can download my test.zip from here:
> 
> http://ronware.org/test.zip
> 
> In it you will find a file 'test.txt' which is UTF8 and will tell you how
> to  see the problem I am finding with using s/// with combining
> characters.

 I can confirm the problem (on Linux, GTK2, enc=utf-8, vim 7.0.000).
Maybe I can get the offending characters to the list.  The following
should be a no-op:

:s/.*/&

but it is not on the following line of voweled Hebrew:

הִלְכּוֹת

I notice other problems.  For example, $ (in Normal mode) takes me to
the fifth character.  (With 'ruler' set, I see 17-5 in the status line.)
Maybe there is a null byte in the fifth or sixth multi-byte character?


--Benji Fisher

Re: vim7: problem with regex subst and combining chars

[Ron Aaron]

Arrgh!  I can't send this message to the list, for some reason!  Maybe
because it has strange characters in it?

OK:  you can download my test.zip from here:

http://ronware.org/test.zip

In it you will find a file 'test.txt' which is UTF8 and will tell you how
to  see the problem I am finding with using s/// with combining
characters.

Re: vim7: problem with regex subst and combining chars

[Yakov Lerner]

On 5/16/06, Ron Aaron <[EMAIL PROTECTED]> wrote:

> (I've attached the zip with the following text in case it doesn't come
> through for you).
>
> If you do:
>
>   :s/.*/hi&/

Verified this happens on Linux as well.


I don't see original post of this thread. From whom to whom it
was sent, and when ?

Yakov

Re: vim7: problem with regex subst and combining chars

[Ron Aaron]

>> (I've attached the zip with the following text in case it doesn't come
>> through for you).
>>
>> If you do:
>>
>>  :s/.*/hi&/
>
> Verified this happens on Linux as well.

And furthermore verified it does NOT happen on vim 6.4

Re: vim7: problem with regex subst and combining chars

[Ron Aaron]

> (I've attached the zip with the following text in case it doesn't come
> through for you).
>
> If you do:
>
>   :s/.*/hi&/

Verified this happens on Linux as well.