In perl.git, the branch smoke-me/khw-encode has been created
<http://perl5.git.perl.org/perl.git/commitdiff/a2bea4410fccddb9eff1142db7582d67710d5abc?hp=0000000000000000000000000000000000000000>
at a2bea4410fccddb9eff1142db7582d67710d5abc (commit)
- Log -----------------------------------------------------------------
commit a2bea4410fccddb9eff1142db7582d67710d5abc
Author: Karl Williamson <[email protected]>
Date: Wed Sep 28 15:05:17 2016 -0600
later
M embed.fnc
M embed.h
M ext/XS-APItest/t/utf8.t
M lib/utf8.t
M proto.h
M t/io/utf8.t
M t/lib/warnings/utf8
M t/op/pack.t
M t/op/utf8decode.t
M utf8.c
commit 1bb4232936a28ed37b439abbf7d36c4cc7daa7b2
Author: Karl Williamson <[email protected]>
Date: Wed Sep 28 10:19:03 2016 -0600
utf8.c: Consolidate duplicate error msg text
This text is generated in 2 places; consolidate into one place.
M embed.fnc
M embed.h
M proto.h
M utf8.c
commit b35a72a4ab9b5088fd9055d79ea0452f824c34db
Author: Karl Williamson <[email protected]>
Date: Wed Sep 28 20:42:30 2016 -0600
utf8n_to_uvchr() Fix EBCDIC bug with overlongs
The comment removed in this commit was wrong, and so was the code it
described. On EBCDIC platforms, there are malformations that need to be
converted from Unicode to native. When I wrote that I wasn't thinking
about overlongs, which can evaluate to any code point. The new tests in
d566bd20c27a46aecd668d2f739b9515f46ac74f caught this.
M utf8.c
commit fe09146d26b011c331eeba272c11f54219f1e6ac
Author: Karl Williamson <[email protected]>
Date: Thu Sep 15 09:09:07 2016 -0600
XXX incomplete: Add sv_utf8_decode_flags
M embed.fnc
M embed.h
M proto.h
M sv.c
M sv.h
commit 616a4419a60f23161f23044fccf9ae118936331a
Author: Karl Williamson <[email protected]>
Date: Wed Sep 14 22:40:23 2016 -0600
customized
M t/porting/customized.dat
commit 0d4e517b886e70caa8183dcf36ce4d0b98cda484
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:20:52 2016 -0600
Use core REPLACEMENT CHARACTER definition
This allows the code to now work on EBCDIC as well.
M cpan/Encode/Encode/encode.h
commit 197908187d872546d516828f0aab55d6f23122d2
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:16:00 2016 -0600
XXX commit msg: Encode.xs: Rmv unused function
M cpan/Encode/Encode.xs
commit aeed81164509bc5ae40047b38a1827cb9d85d3c6
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:12:39 2016 -0600
Encode.xs: white-space only
M cpan/Encode/Encode.xs
commit 21d562970bc2e3a62a63e2a6fb0a53ed72d2a853
Author: Karl Williamson <[email protected]>
Date: Thu Sep 1 12:12:06 2016 -0600
XXX maybe more in commit msg: Speed up Encode UTF-8 validation checking
This replaces the current scheme for checking UTF-8 validity by one
in which normal processing doesn't require having to decode the UTF-8
into code points. The copying of characters individually from the input
to the output is changed to be a single operation for each entire span
of valid input at once.
Thus in the normal case, what ends up happening is a tight loop to
check the validity, and then a memmove of the entire input to the
output, then return.
If an error is found, it copies all the valid input before the error,
then handles the character in error, then positions to the next input
position, and repeats the whole process starting from there.
It uses the functionality available from the Perl 5 core to to look at
just the bytes that comprise the UTF-8 to make the determination,
converting to code points only those that are defective some how in
order to display them in warnings and error messages.
Thus, this does not need to know about the intricacies of UTF-8
malformations, relying on the core to handle this.
This cannot be pushed to CPAN until Devel::PPPort has been updated to
implement all the functions now needed.
M cpan/Encode/Encode.pm
M cpan/Encode/Encode.xs
-----------------------------------------------------------------------
--
Perl5 Master Repository
