Package: bsdmainutils Version: 6.1.10 Severity: normal The current 'colrm' and 'cut' commands don't treat a UTF-8 character as a 'character' even under a UTF-8 locale, instead they treat a 'byte' as a 'character', this makes them unusable on UTF-8 text files.
I only checked these two commands for UTF-8 usability, but I guess other text-processing commands in bsdmainutils may also have the same problem. The upstream commands in FreeBSD have already been fixed 4 years ago to support multibyte characters, we should incorporate their changes into Debian to make Debian truly universal. The upstream FreeBSD versions I'm referring to are: http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.bin/colrm/ http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.bin/cut/ For your reference, the following link shows the modification in upstream to support multibyte chars: http://www.freebsd.org/cgi/cvsweb.cgi/src/usr.bin/colrm/colrm.c.diff?r1=text&tr1=1.11&r2=text&tr2=1.12 Thanks a lot. -- System Information: Debian Release: 5.0 APT prefers stable APT policy: (1999, 'stable'), (990, 'testing'), (99, 'unstable') Architecture: i386 (i686) Kernel: Linux 2.6.26-1-686 (SMP w/1 CPU core) Locale: LANG=zh_HK.UTF-8, LC_CTYPE=zh_HK.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/bash Versions of packages bsdmainutils depends on: ii bsdutils 1:2.13.1.1-1 Basic utilities from 4.4BSD-Lite ii debianutils 2.30 Miscellaneous utilities specific t ii libc6 2.7-18 GNU C Library: Shared libraries ii libncurses5 5.7+20081213-1 shared libraries for terminal hand bsdmainutils recommends no packages. Versions of packages bsdmainutils suggests: ii cpp 4:4.3.2-2 The GNU C preprocessor (cpp) pn vacation <none> (no description available) ii wamerican [wordlist] 6-2.3 American English dictionary words ii wbritish [wordlist] 6-2.3 British English dictionary words f ii whois 4.7.30 an intelligent whois client -- no debconf information -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org