In perl.git, the branch smoke-me/khw-ebcdic has been created
<http://perl5.git.perl.org/perl.git/commitdiff/e833c9b86dbb89ce1636c2a4355dee842e54a4a4?hp=0000000000000000000000000000000000000000>
at e833c9b86dbb89ce1636c2a4355dee842e54a4a4 (commit)
- Log -----------------------------------------------------------------
commit e833c9b86dbb89ce1636c2a4355dee842e54a4a4
Author: Karl Williamson <[email protected]>
Date: Sat Oct 18 18:56:13 2014 -0600
Document length-1 variable name rules
This cleans up the existing documentation with added details, and
documents the effect of recent changes.
M pod/perldata.pod
M pod/perldelta.pod
commit c3e0fa67a4383d2840690ad0875f38c5a24c6f26
Author: Karl Williamson <[email protected]>
Date: Sun Oct 19 23:03:44 2014 -0600
Don't allow literal control chars in var names in EBCDIC
Currently, a variable name of length-1 may have as its name some of the
possible control characters, though this usage is deprecated. It is a
pain to fix this to work properly on EBCDIC, and since the use of these
is deprecated, the pumpking agreed with me to not to bother with doing
so.
M t/lib/warnings/toke
M t/uni/variables.t
M toke.c
commit bcdae0e1a30052b9aeb19458f33a71118ed1b04e
Author: Karl Williamson <[email protected]>
Date: Sun Oct 19 10:35:04 2014 -0600
Deprecate all length-1 non-graphic variable names
v5.20 deprecated all otherwise-legal control characters as length-1
variable names. This extends this to include all non-graphic
characters. The practical effect of this occurs only when not under
"use utf8", and affects just the C1 controls (code points 0x80
through 0xFF), NO-BREAK SPACE, and SOFT HYPHEN.
M pod/perldelta.pod
M pod/perldiag.pod
M t/uni/variables.t
M toke.c
commit eaa0712583758936bd077c94fa1eb43e86529087
Author: Karl Williamson <[email protected]>
Date: Sun Oct 19 09:42:25 2014 -0600
toke.c: Simplify macro for length-1 variable names
It turns out that any non-NUL, non-space ASCII character that gets this
far in the program is a valid length-1 variable. So, can simplify the
expression in the macro that tests for legal ones.
M t/uni/variables.t
M toke.c
commit 8696e7081055dca0c889a7242d5d8615927edac4
Author: Karl Williamson <[email protected]>
Date: Sun Oct 19 09:20:44 2014 -0600
t/uni/variables.t: Add tests for the generated warnings
M t/uni/variables.t
commit b9b9f0d442c0ab79294e1f0c01e7252ab146a1ab
Author: Karl Williamson <[email protected]>
Date: Sat Oct 18 19:00:01 2014 -0600
t/uni/variables.t: White-space only
Indent to newly-formed (by the previous commit) blocks
M t/uni/variables.t
commit e4c2f782191114ce28d0fdcba3c4a22e5123e4c6
Author: Karl Williamson <[email protected]>
Date: Sat Oct 18 08:56:00 2014 -0600
t/uni/variables.t: Add tests
The length-1 variables in the ASCII range had not been systematically
tested until this commit
M t/uni/variables.t
commit 440ef7e02dc400b94bac383ddb035c6e6d345508
Author: Karl Williamson <[email protected]>
Date: Mon Oct 20 09:30:01 2014 -0600
t/uni/variables.t: Add test skips
A future commit will change the behavior of this test depending on
whether it is run on an EBCDIC vs ASCII platform. In the loop, add
skips so the total number run per iteration is the same no matter what
branches (and tests) get run in the iteration. This will allow the
ASCII and EBCDIC test plan to have the same number. This in turn will
prevent platform-specific failures when adding/subtracting tests in this
file.
M t/uni/variables.t
commit 2bd5b500b663f189f250f2e2ca085255aa934b5c
Author: Karl Williamson <[email protected]>
Date: Fri Oct 17 23:27:24 2014 -0600
t/uni/variables.t: Rename variable
A future commit will be using the current variable name for a different
purpose.
M t/uni/variables.t
commit 63a61f822191fbd6a05b614ee6da1804269b1043
Author: Karl Williamson <[email protected]>
Date: Fri Oct 17 11:43:06 2014 -0600
t/uni/variables.t: Clarify some test names
I found it hard to read use utf8 instead of 'use utf8', etc, but more
importantly, this changes a bunch of tests so the character in related
tests is only named in the first such, and more description is used.
This is in preparation for a future commit.
M t/uni/variables.t
commit 71de2d1ab3bef4b40b70b31defc49dad06f91128
Author: Karl Williamson <[email protected]>
Date: Mon Apr 1 22:28:08 2013 -0600
t/uni/variables.t: Fix to run under EBCDIC
M t/uni/variables.t
commit 01c0a90f720cacdd9423ea4f9e11a0e4d524a62c
Author: Karl Williamson <[email protected]>
Date: Fri Oct 17 22:54:21 2014 -0600
t/uni/variables.t: Remove duplicate test
The same exact test was repeated.
M t/uni/variables.t
commit fd1a9b7da43cc7e28c055b91ca6bb7312d712002
Author: Karl Williamson <[email protected]>
Date: Fri Oct 17 11:50:13 2014 -0600
t/uni/variables.t: Remove unused param to sprintf
M t/uni/variables.t
commit 5fd5960059337aad5b82ec8e55cde5a2eb78cfcb
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 22:24:13 2014 -0600
toke.c: Fix potential buffer overflow
Malformed UTF-8 input could have potentially caused a read off the end
of the buffer here until this commit.
M toke.c
commit 60a80158f24781ac44af1ead0c547c8d8eaa8e94
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 22:03:30 2014 -0600
perlebcdic: Add clarification
M pod/perlebcdic.pod
commit e29e9841cb58515fad8b522e164c5582f4e1611b
Author: Karl Williamson <[email protected]>
Date: Wed Jun 26 15:40:53 2013 -0600
uvoffuni_to_utf8_flags() die if platform can't handle
On non EBCDIC platforms currently any UV is encodable as UTF-8. (This
would change if there were 128-bit words). Thus, much code assumes that
nothing can go wrong when converting to UTF-8, and hence does no error
checking.
However, UTF-EBCDIC is only capable of representing code points below
2**32, so if there are 64-bit words, this function can fail.
Prior to this patch, there was no real overflow check, and garbage was
returned by this function if called with too large a number.
While not ideal, the easiest thing to do is to just die for such a
number, like we do for division by 0. This involves changing only code
within this function, and not its many callers.
M pod/perldiag.pod
M t/lib/warnings/utf8
M utf8.c
commit f438ef4e40310c2e5f10d23b1662750a36565698
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 19:24:53 2014 -0600
dquote_static.c: Forbid \c{ on EBCDIC
Unlike ASCII platforms where \c{ evaluates to a semi-colon, and raises a
fatal error because that result is not a control character, on EBCDIC
platforms it does evaluate to a control, but we have to forbid it anyway
because unescaped "{" now is special as a part of larger sequences, and
we don't want to get the parser confused.
M dquote_static.c
M pod/perldiag.pod
M t/lib/warnings/toke
commit 5138af97bcd12f817239cc4bf9a6f07ae031558b
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 19:44:07 2014 -0600
utf8.h: EBCDIC fix
These macros are supposed to accommodate larger than a byte inputs.
Therefore, under EBCDIC, we have to use a different macro which handles
the larger values. On ASCII platforms, these called macros are no-ops
so it doesn't matter there.
M utf8.h
commit c6a5eb7952e25150bf3a3d701bf376c04805d3d6
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 19:55:42 2014 -0600
handy.h: Two EBCDIC fixes
In EBCDIC only macros, an argument previously was failed to be
dereferenced, and there was an extra ==. A few comment changes as well
M handy.h
commit d49caf5d4a806a302a231301fa570baac0c92631
Author: Karl Williamson <[email protected]>
Date: Thu Oct 16 20:45:17 2014 -0600
lib/locale.t: Add some \Q
More places in this file need to have \Q to quote things. This was
noticed in EBCDIC testing.
M lib/locale.t
commit 59e4c365255f671fb3f4e433245852be8a0cda4b
Author: Karl Williamson <[email protected]>
Date: Wed Apr 17 21:47:41 2013 -0600
t/re/regexp.t: Add ability to skip depending on platform
This adds the capability to specify that a test is to be done only on an
ASCII platform, or only on an EBCDIC.
M t/re/regexp.t
commit 8099bf916498645fea160cf911be1bac6a2cae47
Author: Karl Williamson <[email protected]>
Date: Tue Apr 16 15:49:06 2013 -0600
t/re/regexp.t: Generalize for non-ASCII platforms
This adds code to the processing of the tests in t/re/re_tests to
automatically convert most character constants from unicode to native
character sets. This allows most tests in t/re/re_tests to be run on
both platforms without change. A later commit will add the capability
to skip individual tests if on the wrong platform, so those few tests
that this commit doesn't work for can be accommodated
M t/re/regexp.t
commit a294f25066e5c63d758679044d65c41ea049c632
Author: Karl Williamson <[email protected]>
Date: Mon Jul 7 16:59:19 2014 -0600
charset_tools.pl: Fix changed function name
The function has changed names, but this file did not get updated to
reflect that.
M t/charset_tools.pl
commit 51e34d5dcdf362d5d44084e9b03183831aae9cb4
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:43:26 2014 -0600
EBCDIC doesn't have real UTF-8 locales.
At least on the system that we have tested on. There are locales that
say they are UTF-8, but they're not; they're EBCDIC 1047.
M locale.c
M t/loc_tools.pl
commit abd716c3875bb83a0979380dd0c55468c4e8b77b
Author: Yaroslav Kuzmin <[email protected]>
Date: Wed Jul 2 22:22:23 2014 -0600
Fix ebcdic error of nostdio.h
M nostdio.h
commit 66895e755f6e4f26c3a7ab989a6185e14754e72f
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:41:22 2014 -0600
regcomp.c: isASCII should be isASCII_uni
It doesn't effectively matter, but isACII_uni is the one that is
supposed to be used for UVs.
M regcomp.c
commit f93816f7d991bd7c6c0a7083655bbed4ac06b75a
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:24:50 2014 -0600
Fix isASCII for EBCDIC
Prior to this commit isASCII on EBCDIC platforms was defined as the
isascii() libc function. It turns out that this doesn't work properly.
It needed to be this way back when EBCDIC was bootstrapped onto the
target machine, but now, various header files are furnished with the
requisite definitions, so this is no longer necessary.
The problem with isascii() is that it is locale-dependent, unlike on
ASCII platforms. This means that instead of getting a standard ASCII
definition, it returns whatever the underlying locale says, even if
there is no 'use locale' anywhere in the program. Starting with this
commit, the isASCII definition now comes from the l1_char_class_tab.h
file which we know is accurate and not locale-dependent.
This header can be used in compilations of utility programs where perl.h
is not available. For these, there are alternate, more complicated
definitions, should they be needed in those utility programs. Several
of those definitions prior to this commit also used locale-sensitive
isfoo() functions. The bulk of this commit refactors those definitions
to not use these functions as much as possible. As noted in the
added comments in the code, the one remaining use of such a function is
only for the lesser-used control characters. Likely these aren't used
in the utility programs.
M handy.h
commit 2b87b05fbb6974947b2c87be58734b02b975c9f7
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:21:16 2014 -0600
handy.h: Add missing macro
This section of code is normally not compiled, but when circumstances
call for it to be compiled, it may be missing the macro defined in this
commit, which is trivial on ASCII platforms, so just define it if
missing
M handy.h
commit 9e2fa60ac2359257944f42605cb89e1205cffa43
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:16:59 2014 -0600
handy.h: Need macro definition for normally non-compiled code
This section of code is compiled only when perl.h is not available, i.e.
for utility programs. I periodically test that it still works, and this
time a macro was added to the other branch of the #if, but not this one.
This commit adds a trivial one to the missing area.
M handy.h
commit bce492c3ff149ddada1366ff0527d7af38a90b49
Author: Karl Williamson <[email protected]>
Date: Wed Oct 8 11:12:12 2014 -0600
handy.h: Comments only
Removes obsolete comment, and adds text to make it easier to find
matching #else and #endif of a #if
M handy.h
commit 59aaf3e0213a645295c411efed79a677854844ce
Author: Yaroslav Kuzmin <[email protected]>
Date: Sun Sep 28 10:02:17 2014 -0600
perlio: Fix to work with MVS Dataset
M AUTHORS
M perlio.c
commit ba4cd2090866648955b7f3fe5426a56a0cbb5a51
Author: Karl Williamson <[email protected]>
Date: Sun Aug 24 10:12:49 2014 -0600
mktables: Use chr() instead of pack()
The input is the native code point, not the Unicode one, and so it is a
bug that pack(U) works. The W format is what should be used, but I
think chr() is easier to read.
M lib/unicore/mktables
commit 48e88685fb2c168f3b5b25e19e97ead87033a940
Author: Karl Williamson <[email protected]>
Date: Sun Jun 22 21:29:28 2014 -0600
utf8.c: Improve debug message
This function was called with an empty string "" because that string was
not actually needed in the function, except to better identify the
source when there is an error. So change to specify the actual source.
M utf8.c
commit 2a6d7902116c7da9b8c4be60fb3d82f77bde9c45
Author: Karl Williamson <[email protected]>
Date: Mon Jun 9 12:28:10 2014 -0600
regcomp.c: EBCDIC fix
M regcomp.c
commit 167ec60717ec58d0cb674a20d1213ca50a35ae86
Author: Karl Williamson <[email protected]>
Date: Wed Feb 27 21:59:11 2013 -0700
makedepend.SH: Split too long lines; properly join
I had thought that a continuation introduced a space. But no,
a continuation can happen in the middle of a token.
And this splits lines that are getting very long to avoid preprocessor
limitations.
M makedepend.SH
commit c3914dddf835adf12108e2ae04817a341376cad7
Author: Karl Williamson <[email protected]>
Date: Wed Feb 27 15:51:28 2013 -0700
makedepend.SH: White-space only
Align continuation backslashes
M makedepend.SH
commit 2eba5f54575e9052c1d4b4cf88647a94ced4995a
Author: Karl Williamson <[email protected]>
Date: Wed Feb 27 14:39:28 2013 -0700
makedepend.SH: Remove some unnecessary white space
Multi-line preprocessor directives are now joined into single lines.
This can create lines too long for the preprocessor to handle. This
commit removes blanks adjoining comments that get deleted. This makes
things somewhat less likely to exceed the limit.
This commit also fixes several [] which were meant to each match a tab
or a blank, but editors converted the tabs to blanks
M makedepend.SH
commit 42fa67e0a8d24b63ba086629c18beef2a88782c5
Author: Karl Williamson <[email protected]>
Date: Wed Feb 27 14:30:51 2013 -0700
makedepend.SH: Retain '/**/' comments
These comments may actually be necessary.
M makedepend.SH
commit f2ec897420195da80ca51261967302628499969c
Author: Karl Williamson <[email protected]>
Date: Tue Feb 26 09:00:18 2013 -0700
makedepend.SH: Comment out unnecessary code
This causes problems currently for z/OS. But, since we don't know why
it was there, I'm leaving it in as a placeholder.
M makedepend.SH
commit 046c92762a6d2a4ec060d9228af659173bc8eb04
Author: Andy Dougherty <[email protected]>
Date: Wed Feb 27 13:06:07 2013 -0500
Disable gcc-style function attributes on z/OS.
John Goodyear <[email protected]> reports that the z/OS C compiler
supports the attribute keyword, but not exactly the same as gcc.
Instead of a "warning", the compiler emits an "INFORMATIONAL" message
that Configure fails to detect. Until Configure is fixed, just disable
the attributes altogether.
John Goodyear
M hints/os390.sh
commit fc5829ac6ad83a615ed34729c86ffbdbbf2f6c94
Author: Andy Dougherty <[email protected]>
Date: Wed Feb 27 09:12:13 2013 -0500
Change os390 custom cppstdin script to use fgrep.
Grep appears to be limited to 2048 characters, and truncates
the output for cppstin. Fgrep apparently doesn't have that limit.
Thanks to John Goodyear <[email protected]> for reporting this.
M hints/os390.sh
-----------------------------------------------------------------------
--
Perl5 Master Repository