Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-21 Thread Zbigniew Jędrzejewski-Szmek
On Wed, Nov 21, 2018 at 12:13:41PM +, Peter Robinson wrote:
> On Wed, Nov 21, 2018 at 12:09 PM Zbigniew Jędrzejewski-Szmek
>  wrote:
> >
> > On Tue, Nov 06, 2018 at 09:21:09AM -0600, Dennis Gilmore wrote:
> > > the build group in koji is defined as
> > > 
> > > build
> > > build
> > > None
> > > false
> > > true
> > > 
> > >   bash
> >
> > Hmm, where is this defined?
> 
> In koji:
> koji list-groups f30

Thanks. https://pagure.io/releng/issue/7926.

> > >  and in f30 comps the buildsys-build group is
> > > 
> > > buildsys-build
> >
> > https://pagure.io/fedora-comps/pull-request/346

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-21 Thread Peter Robinson
On Wed, Nov 21, 2018 at 12:09 PM Zbigniew Jędrzejewski-Szmek
 wrote:
>
> On Tue, Nov 06, 2018 at 09:21:09AM -0600, Dennis Gilmore wrote:
> > the build group in koji is defined as
> > 
> > build
> > build
> > None
> > false
> > true
> > 
> >   bash
>
> Hmm, where is this defined?

In koji:
koji list-groups f30

> >  and in f30 comps the buildsys-build group is
> > 
> > buildsys-build
>
> https://pagure.io/fedora-comps/pull-request/346
>
> Zbyszek
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: 
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-21 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 09:21:09AM -0600, Dennis Gilmore wrote:
> the build group in koji is defined as 
> 
> build
> build
> None
> false
> true
> 
>   bash

Hmm, where is this defined?

>  and in f30 comps the buildsys-build group is 
> 
> buildsys-build

https://pagure.io/fedora-comps/pull-request/346

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-12 Thread Rafal Luzynski
11.11.2018 21:33 Joël Krähemann  wrote:
> 
> Hi all,
> 
> I don't care as long you leave the C locale on the system.

IIUC, the C locale is built in and impossible to remove. When Zbyszek
said "remove anything-not-C.UTF-8" he probably meant removal of
actual national langpacks (including English) rather than removal
of other generic locales like C or POSIX.

I think that people were using en_US.UTF-8 as a way to force use of
UTF-8 which is possible with C.UTF-8 as well.

Regards,

Rafal
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-11 Thread Joël Krähemann
Hi all,

I don't care as long you leave the C locale on the system.

http://git.savannah.nongnu.org/cgit/gsequencer.git/tree/ags/lib/ags_regex.c?h=2.1.x#n43

FYI: the regexp engine behaves different as providing multi-byte input
as with C.UTF-8. In contrary
the C locale allows you to do match character ranges using 1 single
byte per character.

Bests,
Joël

On Sun, Nov 11, 2018 at 7:26 PM Todd Zullinger  wrote:
>
> Hi Zbigniew,
>
> Zbigniew Jędrzejewski-Szmek wrote:
> > I'll do a mass update to use C.UTF-8 for the packages in the list that
> > follows, next week. I'll do test builds locally, and I'll only push to
> > dist-git if the local builds succeed. Let me know if you want your
> > package to be excluded.
>
> > git  amahdal besser82 chrisw pcahyna pstodulk skisela tmz
>
> I'll take care of git soon.
>
> Thanks,
>
> --
> Todd
> ~~
> Telephone, n. An invention of the devil which abrogates some of the
> advantages of making a disagreeable person keep his distance.
> -- Ambrose Bierce, "The Devil's Dictionary"
>
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: 
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-11 Thread Todd Zullinger
Hi Zbigniew,

Zbigniew Jędrzejewski-Szmek wrote:
> I'll do a mass update to use C.UTF-8 for the packages in the list that
> follows, next week. I'll do test builds locally, and I'll only push to
> dist-git if the local builds succeed. Let me know if you want your
> package to be excluded.

> git  amahdal besser82 chrisw pcahyna pstodulk skisela tmz

I'll take care of git soon.

Thanks,

-- 
Todd
~~
Telephone, n. An invention of the devil which abrogates some of the
advantages of making a disagreeable person keep his distance.
-- Ambrose Bierce, "The Devil's Dictionary"



signature.asc
Description: PGP signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-07 Thread Rafal Luzynski
6.11.2018 23:15 Zbigniew Jędrzejewski-Szmek  wrote:
> [...]
> Things are the way they are so that without the additional step of
> specifying glibc-minimal-langpack, one get's all the locales by
> default. This design was chosen for maximum backwards compatibility when
> the langpack split was being made.

This case has been discussed during this year's Flock. Indeed,
glibc-all-langpacks was introduced for backward compatibility when upgrading
the Fedora systems predating langpacks. But it is considered a bug that
glibc-all-langpacks is installed by default. The intention of splitting
langpacks was to have only selected locales installed rather than all.

> Installing no locales by default would probably be the default if we
> were starting from scratch today, but when the split was made, a
> different choice was made. I don't see enough benefit to revisit this.

Sure, this may need a separate discussion.

Regards,

Rafal
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Emmanuel Seyman
* Zbigniew Jędrzejewski-Szmek [05/11/2018 23:24] :
>
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.

[snip ]

> perl-libintl-perleseyman

This package had a test in its test suite that only worked if LANG=en_US was
set. Upstream released a new version with this test disabled so I've updated
the package in rawhide and removed the locale setting.

You can ignore this package.

Emmanuel
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 10:14:58PM +0100, Rafal Luzynski wrote:
> 6.11.2018 00:24 Zbigniew Jędrzejewski-Szmek  wrote:
> > 
> > Dear maintainers,
> > 
> > I'm working again on implementing
> > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > [...]
> > 
> > Once that's done, I'll file the PRs to actually replace
> > glibc-langpacks-all
> > with glibc-minimal-langpacks in mock and koji.
> 
> Sorry if it's been discussed already before but one thing makes me wonder.
> If glibc requires glibc-langpack and then we create glibc-minimal-langpack
> which is empty and its only purpose is to provide glibc-langpack and thus
> satisfy the dependency, then maybe we should just drop glibc-langpack
> dependency from glibc and it would solve the problem? glibc-all-langpacks
> could be removed rather than replaced with glibc-minimal-langpack.
> The existence of glibc-minimal-langpack proves that glibc is able to work
> without any external locale data.
> 
> Otherwise your change looks correct to me (although I am aware of the
> objections expressed in this thread).

Things are the way they are so that without the additional step of
specifying glibc-minimal-langpack, one get's all the locales by
default. This design was chosen for maximum backwards compatibility when
the langpack split was being made.

Installing no locales by default would probably be the default if we
were starting from scratch today, but when the split was made, a
different choice was made. I don't see enough benefit to revisit this.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Rafal Luzynski
6.11.2018 00:24 Zbigniew Jędrzejewski-Szmek  wrote:
> 
> Dear maintainers,
> 
> I'm working again on implementing
> https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> [...]
> 
> Once that's done, I'll file the PRs to actually replace
> glibc-langpacks-all
> with glibc-minimal-langpacks in mock and koji.

Sorry if it's been discussed already before but one thing makes me wonder.
If glibc requires glibc-langpack and then we create glibc-minimal-langpack
which is empty and its only purpose is to provide glibc-langpack and thus
satisfy the dependency, then maybe we should just drop glibc-langpack
dependency from glibc and it would solve the problem? glibc-all-langpacks
could be removed rather than replaced with glibc-minimal-langpack.
The existence of glibc-minimal-langpack proves that glibc is able to work
without any external locale data.

Otherwise your change looks correct to me (although I am aware of the
objections expressed in this thread).

Regards,

Rafal
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 09:21:09AM -0600, Dennis Gilmore wrote:
> What is the change you are planning to put into mock and koji?

In both cases, we know that bash and other utilities will pull in
glibc, which Requires glibc-langpack, and pulls in glibc-all-langpacks
by default. My plan is to add glibc-minimal-langpack to those lists.
It also provides glibc-langpack, and will prevent glibc-all-langpacks
from being pulled in automatically.

Zbyszek

> the build group in koji is defined as 
> 
> 
> build
> build
> None
> false
> true
> 
>   bash
>   bzip2
>   coreutils
>   cpio
>   diffutils
>   fedora-release
>   findutils
>   gawk
>   grep
>   gzip
>   info
>   make
>   patch
>   redhat-rpm-config
>   rpm-build
>   sed
>   shadow-utils
>   tar
>   unzip
>   util-linux
>   which
>   xz
> 
>   
>  and in f30 comps the buildsys-build group is 
> 
> buildsys-build
> <_name>Buildsystem building group
> <_description/>
> false
> false
> 
>   bash
>   bzip2
>   coreutils
>   cpio
>   diffutils
>   fedora-release
>   findutils
>   gawk
>   grep
>   gzip
>   info
>   make
>   patch
>   redhat-rpm-config
>   rpm-build
>   sed
>   shadow-utils
>   tar
>   unzip
>   util-linux
>   which
>   xz
> 
>   
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Dennis Gilmore
El lun, 05-11-2018 a las 23:24 +, Zbigniew Jędrzejewski-Szmek
escribió:
> Dear maintainers,
> 
> I'm working again on implementing
> https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> will be backwards and forwards compatible, in the sense that packages
> that use C.UTF-8 should build OK on older and newer Fedoras.
> 
> Once that's done, I'll file the PRs to actually replace glibc-
> langpacks-all
> with glibc-minimal-langpacks in mock and koji.

What is the change you are planning to put into mock and koji?

the build group in koji is defined as 


build
build
None
false
true

  bash
  bzip2
  coreutils
  cpio
  diffutils
  fedora-release
  findutils
  gawk
  grep
  gzip
  info
  make
  patch
  redhat-rpm-config
  rpm-build
  sed
  shadow-utils
  tar
  unzip
  util-linux
  which
  xz

  
 and in f30 comps the buildsys-build group is 

buildsys-build
<_name>Buildsystem building group
<_description/>
false
false

  bash
  bzip2
  coreutils
  cpio
  diffutils
  fedora-release
  findutils
  gawk
  grep
  gzip
  info
  make
  patch
  redhat-rpm-config
  rpm-build
  sed
  shadow-utils
  tar
  unzip
  util-linux
  which
  xz

  

These are what mock uses to create the minimal buildroot in both cases,
neither includes anything with glibc, greping through the mock code for
glibc turns up nothing.  I mention all of this because glibc-all-
langpacks is pulled into the buildroot entirely by dependencies, the
only change needed is to whatever package is pulling in glibc-all-
langpacks to no longer pull it in. 

Dennis



signature.asc
Description: This is a digitally signed message part
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 03:53:56PM +0100, David Woodhouse wrote:
> On Mon, 2018-11-05 at 23:24 +, Zbigniew Jędrzejewski-Szmek wrote:
> > Dear maintainers,
> > 
> > I'm working again on implementing
> > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> > will be backwards and forwards compatible, in the sense that packages
> > that use C.UTF-8 should build OK on older and newer Fedoras.
> > 
> > Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
> > with glibc-minimal-langpacks in mock and koji.
> > 
> > I'll do a mass update to use C.UTF-8 for the packages in the list that
> > follows, next week. I'll do test builds locally, and I'll only push to
> > dist-git if the local builds succeed. Let me know if you want your
> > package to be excluded.
> 
> The self-tests for OpenConnect explicitly use cs_CZ.ISO8859-2 for
> pathological password handling — using a password of "ĂŻ" (U+0102
> U+017B) in the local charset and making sure it works correctly.
> 
> Do I just need to BuildRequire glibc-langpacks-all manually to make
> that work again?

That, or glibc-langpack-cs. (cs is 0.5 MB, glibc-all-langpacks is 25 MB).

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Florian Weimer
* David Woodhouse:

> The self-tests for OpenConnect explicitly use cs_CZ.ISO8859-2 for
> pathological password handling — using a password of "ĂŻ" (U+0102
> U+017B) in the local charset and making sure it works correctly.
>
> Do I just need to BuildRequire glibc-langpacks-all manually to make
> that work again?

Yes, or depend on the cs langpack.  Similar for any test that needs a
non-UTF-8 locale.

Thanks,
Florian
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Florian Weimer
* Panu Matilainen:

> On 11/06/2018 02:13 PM, Mike FABIAN wrote:
>> Panu Matilainen  さんはかきました:
>>
>>> On 11/06/2018 12:15 PM, Zbigniew Jędrzejewski-Szmek wrote:
 On Tue, Nov 06, 2018 at 12:10:04PM +0200, Panu Matilainen wrote:
> On 11/06/2018 03:05 AM, Kevin Kofler wrote:
>> Zbigniew Jędrzejewski-Szmek wrote:
>>> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
>>> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.
>>
>> But there are probably many more packages where the setting is hidden in
>> upstream build scripts.
>
> Build- and various other scripts.
>
> Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?

 It was never Fedora-specific. The original justification in 2013 or so
 was "other distros already do it". It's just glibc upstream that doesn't
 have it.

 We still carry
 https://src.fedoraproject.org/rpms/glibc/blob/master/f/glibc-c-utf8-locale.patch,
 so it seems this hasn't been upstream.
>>>
>>> Ugh, this is a rather cumbersome situation for other projects:
>>> supporting and using C.UTF-8 isn't going to happen large scale until
>>> it's upstreamed. And it does make one wonder what exactly is
>>> preventing it from being upstreamed in glibc.
>>
>> The current C.UTF-8 locale doesn’t sort correctly. It should sort
>> according to code point order, but it does that only partly. It is sort
>> of a quick hack. The glibc developers are working on a better solution
>> but this takes more time.
>>
>
> Hmm. Not sorting correctly doesn't sound so good when LANG=C (and now
> C.UTF-8) is quite commonly used exactly for that purpose.

Not all looks fixable to me in the current setting.  We expose the table
layout via nl_langinfo, so that's part of the ABI, and the tables just
cannot express the sorting order with less than three to four bytes per
codepoint.  That's a lot of data even if we restrict ourselves to the
modern UTF-8 range (those codepoints addressable using UTF-16 surrogate
pairs).

I think we could generate the tables on the fly if they are ever
requested using nl_langinfo.  Not many applications seem to do that.
Internally within glibc, we could use a different interface to avoid the
table generation.

The table layout also has significant problems with expressing proper
collation tables.  We need to investigate this more deeply, but my
impression is that the collation and collation sequence tables
constitute a significant fraction of the locale data on disk.  Changing
the table layout again has ABI implications there, similar to those for
C.UTF-8, except that the on-the-fly conversation code will be more
difficult to write.

Thanks,
Florian
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread David Woodhouse
On Mon, 2018-11-05 at 23:24 +, Zbigniew Jędrzejewski-Szmek wrote:
> Dear maintainers,
> 
> I'm working again on implementing
> https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> will be backwards and forwards compatible, in the sense that packages
> that use C.UTF-8 should build OK on older and newer Fedoras.
> 
> Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
> with glibc-minimal-langpacks in mock and koji.
> 
> I'll do a mass update to use C.UTF-8 for the packages in the list that
> follows, next week. I'll do test builds locally, and I'll only push to
> dist-git if the local builds succeed. Let me know if you want your
> package to be excluded.

The self-tests for OpenConnect explicitly use cs_CZ.ISO8859-2 for
pathological password handling — using a password of "ĂŻ" (U+0102
U+017B) in the local charset and making sure it works correctly.

Do I just need to BuildRequire glibc-langpacks-all manually to make
that work again?


smime.p7s
Description: S/MIME cryptographic signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Panu Matilainen

On 11/06/2018 02:13 PM, Mike FABIAN wrote:

Panu Matilainen  さんはかきました:


On 11/06/2018 12:15 PM, Zbigniew Jędrzejewski-Szmek wrote:

On Tue, Nov 06, 2018 at 12:10:04PM +0200, Panu Matilainen wrote:

On 11/06/2018 03:05 AM, Kevin Kofler wrote:

Zbigniew Jędrzejewski-Szmek wrote:

The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.


But there are probably many more packages where the setting is hidden in
upstream build scripts.


Build- and various other scripts.

Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?


It was never Fedora-specific. The original justification in 2013 or so
was "other distros already do it". It's just glibc upstream that doesn't
have it.

We still carry
https://src.fedoraproject.org/rpms/glibc/blob/master/f/glibc-c-utf8-locale.patch,
so it seems this hasn't been upstream.


Ugh, this is a rather cumbersome situation for other projects:
supporting and using C.UTF-8 isn't going to happen large scale until
it's upstreamed. And it does make one wonder what exactly is
preventing it from being upstreamed in glibc.


The current C.UTF-8 locale doesn’t sort correctly. It should sort
according to code point order, but it does that only partly. It is sort
of a quick hack. The glibc developers are working on a better solution
but this takes more time.



Hmm. Not sorting correctly doesn't sound so good when LANG=C (and now 
C.UTF-8) is quite commonly used exactly for that purpose.


- Panu -
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
Dear maintainers,

I'm working again on implementing
https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
will be backwards and forwards compatible, in the sense that packages
that use C.UTF-8 should build OK on older and newer Fedoras.

Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
with glibc-minimal-langpacks in mock and koji.

I'll do a mass update to use C.UTF-8 for the packages in the list that
follows, next week. I'll do test builds locally, and I'll only push to
dist-git if the local builds succeed. Let me know if you want your
package to be excluded.

Zbyszek

Maintainers by package:
OpenTK   orphan
apache-poi   gil lef mbooth
ardour5  nphilipp tartina
bash-completion  mrunge ooprala sheltren svashisht
borgbackup   bpereto fschwarz
clover2  mtasaka
elixir   codeblock fnux martinlanghoff puiterwijk s4504kr
fail2ban athimm atkac jgu orion
fantasdicmtasaka
felix-osgi-core  jcapik mizdebsk
fmf  psss
gfan jjames pcpa tremble
ghc  petersen
git  amahdal besser82 chrisw pcahyna pstodulk skisela tmz
hibernate3   gil lef
hive coolsvap moceap orphan pmackinn
hunspell-az  caolanm
hunspell-fa  caolanm
hunspell-ga  caolanm
hunspell-gv  caolanm
hunspell-ky  caolanm
ibus-typing-booster  anishpatil mfabian
ipython  churchyard cstratak dcantrel ignatenkobrain lbalhar mrunge 
salimma tomspur
jblaszbyszek
kgb-bot  averi
langtablemfabian
lazygal  rathann
libmp4v2 amigadave moezroy rathann sergiomb thias
libraqm  moceap
migemo   mtasaka
# migemo is special, I'll just add BR:glibc-langpack-ja
mongodb  hhorak jpacner maxamillion mskalick panovotn strobert 
tdawson
openqa   adamwill
paraview deji orion sagitter
passengerjkaluza kanarip tdawson
php-horde-Horde-Imap-Client remi
php-horde-Horde-JavascriptMinify remi
php-horde-Horde-Util remi
php-kdyby-events orphan
php-kdyby-strict-objects orphan
php-latteorphan
php-nette-application orphan
php-nette-bootstrap  orphan
php-nette-cachingorphan
php-nette-component-model orphan
php-nette-database   orphan
php-nette-deprecated orphan
php-nette-di orphan
php-nette-finder orphan
php-nette-forms  orphan
php-nette-http   orphan
php-nette-mail   orphan
php-nette-neon   orphan
php-nette-php-generator orphan
php-nette-reflection orphan
php-nette-robot-loader orphan
php-nette-safe-stream orphan
php-nette-security   orphan
php-nette-tester orphan
php-nette-tokenizer  orphan
php-nette-utils  orphan
php-phpspec  remi siwinski
php-tracyorphan
pyp2rpm  bkabrda cstratak ishcherb kevin mcyprian rkuska
python-CommonMarkjujens
python-acoustid  terjeros
python-blessed   abompard aviso
python-click cstratak fab mstuchli rkuska
python-deprecation   jpena
python-djangobkabrda churchyard jdornak mrunge salimma sgallagh
python-djangoql  vkrizan
python-evic  besser82
python-execnet   ktdreyer thm
python-ipython_genutils orion
python-mapniktomh
python-mtg   tc01
python-musicbrainzngs amluto
python-pankoclient   pkilambi
python-path  laxathom
python-pexpect   amcnabb fabiand ignatenkobrain radez tomspur
python-pypandoc  orion zbyszek
python-pytest-pep8   cstratak orion
python-pythonz-bdmcyprian orphan
python-seesawtc01
python-setproctitle  hguemar stevetraylen
python-setuptools_git apevec
python-sphinx-autodoc-typehints tdecacqu
python-sphinx-intl   jujens
python-spur  orion
python-tablestnorth zbyszek
python-vcstools  cottsay rmattes
python-webassets dcallagh kumarpraveen pjp sundaram
python-whitenoisepiotrp
python2-django1.11   pviktori
python2-ipython  lbalhar
rubygem-gettext  mtasaka sseago
rubygem-http_parser.rb ilgrad spredzy
rubygem-nokogiri kanarip mtasaka tdawson tremble
rubygem-org-ruby vondruch
rubygem-ruby-openid  orphan
udiskie  jstanek
varnish  ingvar luhliarik
xorg-x11-drv-intel   ajax glisse

Packages by maintainer:
abompard   python-blessed
adamwill   openqa
ajax   xorg-x11-drv-intel
amahdalgit
amcnabbpython-pexpect
amigadave  libmp4v2
amluto python-musicbrainzngs
anishpatil ibus-typing-booster
apevec python-setuptools_git
athimm fail2ban
atkac  fail2ban
averi  kgb-bot
aviso  python-blessed
besser82   git python-evic
bkabrdapyp2rpm python-django
bperetoborgbackup
caolanmhunspell-az hunspell-fa hunspell-ga hunspell-gv hunspell-ky
chrisw git

Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Nico Kadel-Garcia
On Tue, Nov 6, 2018 at 8:58 AM Dominik 'Rathann' Mierzejewski
 wrote:
>
> On Tuesday, 06 November 2018 at 00:24, Zbigniew Jędrzejewski-Szmek wrote:
> > Dear maintainers,
> >
> > I'm working again on implementing
> > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> > will be backwards and forwards compatible, in the sense that packages
> > that use C.UTF-8 should build OK on older and newer Fedoras.
> >
> > Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
> > with glibc-minimal-langpacks in mock and koji.
> >
> > I'll do a mass update to use C.UTF-8 for the packages in the list that
> > follows, next week. I'll do test builds locally, and I'll only push to
> > dist-git if the local builds succeed. Let me know if you want your
> > package to be excluded.
> >
> > Zbyszek
> [...]
> > Packages by maintainer:
> [...]
> > rathannlazygal libmp4v2
>
> Please add BR: glibc-langpack-en instead of changing locale for these.
>
> Regards,
> Dominik

From pain with other packages that require language settings, such as
Chef, I'd really encourage enabling the existing defaults rather than
trying to modify all the packages. That way lies a lot of work for our
friends doing EPEL backports.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages [MORE PACKAGES]

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 12:05:03PM +, Paul Howarth wrote:
> On Tue, 6 Nov 2018 10:25:58 +
> Zbigniew Jędrzejewski-Szmek  wrote:
> 
> > pghmcfcperl-Perl-Critic perl-Perl-OSType perl-Text-Hunspell
> > perl-Text-SpellChecker
> 
> These packages all set either LANG or LC_ALL to en_US for the purposes
> of setting the correct language for the spell check in their test
> suites. They all build-require hunspell-en to provide the required
> dictionary. Are they also going to need glibc-langpack-en?

They are going to need to declare BR:glibc-langpack-en.
(The dependency was already there, just implicit.)

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 02:05:06PM +0100, Dominik 'Rathann' Mierzejewski wrote:
> On Tuesday, 06 November 2018 at 13:13, Florian Weimer wrote:
> > * Zbigniew Jędrzejewski-Szmek:
> > 
> > > Dear maintainers,
> > >
> > > I'm working again on implementing
> > > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> > > will be backwards and forwards compatible, in the sense that packages
> > > that use C.UTF-8 should build OK on older and newer Fedoras.
> > 
> > I think this is a very bad idea.  The C.UTF-8 locale is Fedora-specific.
> > It is not upstream, and it is known to be broken in many ways.  It may
> > or may not match what other distributions use.
> > 
> > I have argued for some time that the locale must be upstreamed, but
> > unfortunately, I'm notglibc-langpack-minimal getting anywhere.
> 
> Can we use glibc-langpack-en instead of glibc-langpack-minimal and keep
> en_US.UTF-8 locale as default?

glibc-langpack-en is 6MB, glibc-langpack-minimal is ~0. Pretty much
all packages don't need an actual language.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 02:07:06PM +0100, Dominik 'Rathann' Mierzejewski wrote:
> On Tuesday, 06 November 2018 at 00:24, Zbigniew Jędrzejewski-Szmek wrote:
> > Dear maintainers,
> > 
> > I'm working again on implementing
> > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> > will be backwards and forwards compatible, in the sense that packages
> > that use C.UTF-8 should build OK on older and newer Fedoras.
> > 
> > Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
> > with glibc-minimal-langpacks in mock and koji.
> > 
> > I'll do a mass update to use C.UTF-8 for the packages in the list that
> > follows, next week. I'll do test builds locally, and I'll only push to
> > dist-git if the local builds succeed. Let me know if you want your
> > package to be excluded.
> > 
> > Zbyszek
> [...]
> > Packages by maintainer:
> [...]
> > rathannlazygal libmp4v2
> 
> Please add BR: glibc-langpack-en instead of changing locale for these.
OK.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Dominik 'Rathann' Mierzejewski
On Tuesday, 06 November 2018 at 00:24, Zbigniew Jędrzejewski-Szmek wrote:
> Dear maintainers,
> 
> I'm working again on implementing
> https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> will be backwards and forwards compatible, in the sense that packages
> that use C.UTF-8 should build OK on older and newer Fedoras.
> 
> Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
> with glibc-minimal-langpacks in mock and koji.
> 
> I'll do a mass update to use C.UTF-8 for the packages in the list that
> follows, next week. I'll do test builds locally, and I'll only push to
> dist-git if the local builds succeed. Let me know if you want your
> package to be excluded.
> 
> Zbyszek
[...]
> Packages by maintainer:
[...]
> rathannlazygal libmp4v2

Please add BR: glibc-langpack-en instead of changing locale for these.

Regards,
Dominik
-- 
Fedora   https://getfedora.org  |  RPMFusion   http://rpmfusion.org
There should be a science of discontent. People need hard times and
oppression to develop psychic muscles.
-- from "Collected Sayings of Muad'Dib" by the Princess Irulan
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Dominik 'Rathann' Mierzejewski
On Tuesday, 06 November 2018 at 13:13, Florian Weimer wrote:
> * Zbigniew Jędrzejewski-Szmek:
> 
> > Dear maintainers,
> >
> > I'm working again on implementing
> > https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> > will be backwards and forwards compatible, in the sense that packages
> > that use C.UTF-8 should build OK on older and newer Fedoras.
> 
> I think this is a very bad idea.  The C.UTF-8 locale is Fedora-specific.
> It is not upstream, and it is known to be broken in many ways.  It may
> or may not match what other distributions use.
> 
> I have argued for some time that the locale must be upstreamed, but
> unfortunately, I'm not getting anywhere.

Can we use glibc-langpack-en instead of glibc-langpack-minimal and keep
en_US.UTF-8 locale as default?

Regards,
Dominik
-- 
Fedora   https://getfedora.org  |  RPMFusion   http://rpmfusion.org
There should be a science of discontent. People need hard times and
oppression to develop psychic muscles.
-- from "Collected Sayings of Muad'Dib" by the Princess Irulan
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Florian Weimer
* Zbigniew Jędrzejewski-Szmek:

> Dear maintainers,
>
> I'm working again on implementing
> https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
> will be backwards and forwards compatible, in the sense that packages
> that use C.UTF-8 should build OK on older and newer Fedoras.

I think this is a very bad idea.  The C.UTF-8 locale is Fedora-specific.
It is not upstream, and it is known to be broken in many ways.  It may
or may not match what other distributions use.

I have argued for some time that the locale must be upstreamed, but
unfortunately, I'm not getting anywhere.

Thanks,
Florian
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Mike FABIAN
Panu Matilainen  さんはかきました:

> On 11/06/2018 12:15 PM, Zbigniew Jędrzejewski-Szmek wrote:
>> On Tue, Nov 06, 2018 at 12:10:04PM +0200, Panu Matilainen wrote:
>>> On 11/06/2018 03:05 AM, Kevin Kofler wrote:
 Zbigniew Jędrzejewski-Szmek wrote:
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.

 But there are probably many more packages where the setting is hidden in
 upstream build scripts.
>>>
>>> Build- and various other scripts.
>>>
>>> Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?
>>
>> It was never Fedora-specific. The original justification in 2013 or so
>> was "other distros already do it". It's just glibc upstream that doesn't
>> have it.
>>
>> We still carry
>> https://src.fedoraproject.org/rpms/glibc/blob/master/f/glibc-c-utf8-locale.patch,
>> so it seems this hasn't been upstream.
>
> Ugh, this is a rather cumbersome situation for other projects:
> supporting and using C.UTF-8 isn't going to happen large scale until
> it's upstreamed. And it does make one wonder what exactly is
> preventing it from being upstreamed in glibc.

The current C.UTF-8 locale doesn’t sort correctly. It should sort
according to code point order, but it does that only partly. It is sort
of a quick hack. The glibc developers are working on a better solution
but this takes more time.

>   - Panu -
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: 
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
>

-- 
Mike FABIAN 
睡眠不足はいい仕事の敵だ。
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages [MORE PACKAGES]

2018-11-06 Thread Paul Howarth
On Tue, 6 Nov 2018 10:25:58 +
Zbigniew Jędrzejewski-Szmek  wrote:

> pghmcfcperl-Perl-Critic perl-Perl-OSType perl-Text-Hunspell
> perl-Text-SpellChecker

These packages all set either LANG or LC_ALL to en_US for the purposes
of setting the correct language for the spell check in their test
suites. They all build-require hunspell-en to provide the required
dictionary. Are they also going to need glibc-langpack-en?

Paul.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Panu Matilainen

On 11/06/2018 12:15 PM, Zbigniew Jędrzejewski-Szmek wrote:

On Tue, Nov 06, 2018 at 12:10:04PM +0200, Panu Matilainen wrote:

On 11/06/2018 03:05 AM, Kevin Kofler wrote:

Zbigniew Jędrzejewski-Szmek wrote:

The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.


But there are probably many more packages where the setting is hidden in
upstream build scripts.


Build- and various other scripts.

Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?


It was never Fedora-specific. The original justification in 2013 or so
was "other distros already do it". It's just glibc upstream that doesn't
have it.

We still carry
https://src.fedoraproject.org/rpms/glibc/blob/master/f/glibc-c-utf8-locale.patch,
so it seems this hasn't been upstream.


Ugh, this is a rather cumbersome situation for other projects: 
supporting and using C.UTF-8 isn't going to happen large scale until 
it's upstreamed. And it does make one wonder what exactly is preventing 
it from being upstreamed in glibc.


- Panu -
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages [MORE PACKAGES]

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 10:08:04AM +, Tom Hughes wrote:
> On 05/11/2018 23:24, Zbigniew Jędrzejewski-Szmek wrote:
> 
> >I'll do a mass update to use C.UTF-8 for the packages in the list that
> >follows, next week. I'll do test builds locally, and I'll only push to
> >dist-git if the local builds succeed. Let me know if you want your
> >package to be excluded.
> 
> I've done mapnik (which seems to be missing from your list for
> some reason) and python-mapnik.

Arghhh! regexp failure on my part. I missed a bunch of packages.

Maintainers by package:
ant  akurtakov jcapik kdaniel mizdebsk msrb
aspectjweavergil rfenkhuber
autoarchive  fab
c++-gtk-utilsairwave echevemaster
espeak-ngolysonek
hyphen-grc   caolanm
kgb-bot  averi
mecab-java   mtasaka
perl-App-PFT dacav
perl-Glib-Object-Introspection berrange ddick
perl-PFT dacav
perl-Perl-Critic jplesnik pghmcfc ppisar
perl-Perl-OSType pghmcfc
perl-Text-Hunspell   pghmcfc
perl-Text-SpellChecker pghmcfc
perl-libintl-perleseyman
pl   bagnara mef ppisar
po4a athimm sergiomb sharkcz
python-argh  cstratak
python-autopep8  mrunge ndipanov
python-cairocffi brouhaha jdulaney
python-congressclient mflobo
python-cotyledon apevec pkilambi
python-enchant   cstratak mmraka
python-evic  besser82
python-httpbin   adamwill
python-httpretty jamielennox
python-jsonpatch apevec dprince skottler
python-jsonpointer   apevec dprince skottler
python-muranoclient  mflobo
python-netaddr   jcholast jeckersb jhrozek
python-pankoclient   pkilambi
python-pifpafhguemar pkilambi
python-ptyprocessignatenkobrain orion tomspur
python-pymrunge thm
python-rospkgcottsay rmattes
python-scandir   aviso salimma
python-sphinxaviso cstratak salimma toshio
python-tenacity  pkilambi
python-webtest   bkabrda lmacken ricky
python-yaql  mflobo
pywebdav sharkcz
rubygem-asciidoctor  fale ktdreyer mojavelinux
rubygem-charlock_holmes axilleas ktdreyer
rubygem-coderay  jaruga
rubygem-em-http-request jackorp
rubygem-fast_gettext vondruch
rubygem-gettext-setup domcleal
rubygem-highline jamielinux stahnma tdawson
rubygem-hpricot  kanarip mtasaka
rubygem-i18n humaton jstribny stahnma vondruch
rubygem-jekyll-feed  decathorpe
rubygem-kramdown mtasaka
rubygem-marc mtasaka
rubygem-minitest humaton jstribny mkent mmorsi skottler smoitra stahnma 
vondruch
rubygem-mustache vondruch
rubygem-nokogiri kanarip mtasaka tdawson tremble
rubygem-pangomtasaka
rubygem-power_assert mtasaka
rubygem-rack jaruga jstribny mmorsi smoitra stevetraylen vondruch
rubygem-redisaxilleas
rubygem-rspec-core   bkearney mtasaka skottler tdawson vondruch
rubygem-rspec-expectations bkearney mtasaka skottler tdawson vondruch
rubygem-rspec-mocks  bkearney mtasaka skottler tdawson vondruch
rubygem-rspec-support mtasaka
rubygem-rspec2-core  mtasaka
rubygem-rspec2-expectations mtasaka
rubygem-taskjuggler  orphan
rubygem-tilt ktdreyer valtri vondruch
udiskie  jstanek

Packages by maintainer:
adamwill   python-httpbin
airwavec++-gtk-utils
akurtakov  ant
apevec python-cotyledon python-jsonpatch python-jsonpointer
athimm po4a
averi  kgb-bot
aviso  python-scandir python-sphinx
axilleas   rubygem-charlock_holmes rubygem-redis
bagnarapl
berrange   perl-Glib-Object-Introspection
besser82   python-evic
bkabrdapython-webtest
bkearney   rubygem-rspec-core rubygem-rspec-expectations rubygem-rspec-mocks
brouhaha   python-cairocffi
caolanmhyphen-grc
cottsaypython-rospkg
cstratak   python-argh python-enchant python-sphinx
dacav  perl-App-PFT perl-PFT
ddick  perl-Glib-Object-Introspection
decathorpe rubygem-jekyll-feed
domcleal   rubygem-gettext-setup
dprincepython-jsonpatch python-jsonpointer
echevemaster c++-gtk-utils
eseymanperl-libintl-perl
fabautoarchive
fale   rubygem-asciidoctor
gilaspectjweaver
hguemarpython-pifpaf
humatonrubygem-i18n rubygem-minitest
ignatenkobrain python-ptyprocess
jackorprubygem-em-http-request
jamielennox python-httpretty
jamielinux rubygem-highline
jaruga rubygem-coderay rubygem-rack
jcapik ant
jcholast   python-netaddr
jdulaney   python-cairocffi
jeckersb   python-netaddr
jhrozekpython-netaddr
jplesnik   perl-Perl-Critic
jstanekudiskie
jstribny   rubygem-i18n rubygem-minitest rubygem-rack
kanariprubygem-hpricot rubygem-nokogiri
kdanielant
ktdreyer   rubygem-asciidoctor rubygem-charlock_holmes rubygem-tilt
lmackenpython-webtest
mefpl
mflobo python-congressclient python-muranoclient python-yaql
mizdebsk   ant
mkent  rubygem-minitest
mmorsi rubygem-minitest rubygem-rack
mmraka python-enchant
mojavelinux rubygem-asciidoctor
mrunge python-autopep8 python-py

Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 12:10:04PM +0200, Panu Matilainen wrote:
> On 11/06/2018 03:05 AM, Kevin Kofler wrote:
> >Zbigniew Jędrzejewski-Szmek wrote:
> >>The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> >>(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.
> >
> >But there are probably many more packages where the setting is hidden in
> >upstream build scripts.
> 
> Build- and various other scripts.
> 
> Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?

It was never Fedora-specific. The original justification in 2013 or so
was "other distros already do it". It's just glibc upstream that doesn't
have it.

We still carry
https://src.fedoraproject.org/rpms/glibc/blob/master/f/glibc-c-utf8-locale.patch,
so it seems this hasn't been upstream.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Panu Matilainen

On 11/06/2018 03:05 AM, Kevin Kofler wrote:

Zbigniew Jędrzejewski-Szmek wrote:

The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.


But there are probably many more packages where the setting is hidden in
upstream build scripts.


Build- and various other scripts.

Is C.UTF-8 glibc upstream now, or is it still Fedora-specific?

- Panu -
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Miro Hrončok

On 06. 11. 18 0:24, Zbigniew Jędrzejewski-Szmek wrote:

Dear maintainers,

I'm working again on implementing
https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
will be backwards and forwards compatible, in the sense that packages
that use C.UTF-8 should build OK on older and newer Fedoras.

Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
with glibc-minimal-langpacks in mock and koji.

I'll do a mass update to use C.UTF-8 for the packages in the list that
follows, next week. I'll do test builds locally, and I'll only push to
dist-git if the local builds succeed. Let me know if you want your
package to be excluded.



Note for Python package owners:

Since Python 3.7 upstream (and 3.6 in Fedora 26+ [0])
the locale is automatically coerced from C to C.utf-8 [1].


If you set LANG=en_US.utf-8 (or similar) for your Python 3 
tests/docs/..., consider trying to remove the statement entirely before 
converting it to LANG=C.utf-8. The same applies if you already use 
LANG=C.utf-8.



Zbyszek: I'm going to do this in ipython and python-django.


[0] https://fedoraproject.org/wiki/Changes/python3_c.utf-8_locale
[1] https://www.python.org/dev/peps/pep-0538/
--
Miro Hrončok
--
Phone: +420777974800
IRC: mhroncok
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-06 Thread Zbigniew Jędrzejewski-Szmek
On Tue, Nov 06, 2018 at 02:05:27AM +0100, Kevin Kofler wrote:
> Zbigniew Jędrzejewski-Szmek wrote:
> > The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> > (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.
> 
> But there are probably many more packages where the setting is hidden in 
> upstream build scripts.

That is possible, but I don't think it'll be that widespread. Gnarly
upstream build scripts tend to be old, and not all systems always had
en_US.UTF-8, so those script should do some autodetection of the available
encodings. Anyway, we'll see.

> > This will be backwards and forwards compatible, in the sense that packages
> > that use C.UTF-8 should build OK on older and newer Fedoras.
> 
> Older Fedoras only since F22 updates / F24 GA, see:
> https://bugzilla.redhat.com/show_bug.cgi?id=902094
>
> And what about EL?

Neither version of EPEL seems to support C.UTF-8. So if somebody wants
to support F30+ and EPEL (or F21-) from the same branch, they should
probably add additional BR and use one of the more heavyweight locales.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-05 Thread Kevin Kofler
Zbigniew Jędrzejewski-Szmek wrote:
> The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
> (and similarly for LANG=, LC_CTYPE=, etc.) in all spec files.

But there are probably many more packages where the setting is hidden in 
upstream build scripts.

> This will be backwards and forwards compatible, in the sense that packages
> that use C.UTF-8 should build OK on older and newer Fedoras.

Older Fedoras only since F22 updates / F24 GA, see:
https://bugzilla.redhat.com/show_bug.cgi?id=902094

And what about EL?

Kevin Kofler
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


mass-removal of LANG=anything-not-C.UTF-8 in packages

2018-11-05 Thread Zbigniew Jędrzejewski-Szmek
Dear maintainers,

I'm working again on implementing
https://fedoraproject.org/wiki/Changes/Remove_glibc-langpacks-all_from_buildroot.
The first step is to replace LC_ALL=en_US.UTF-8 with LC_ALL=C.UTF-8
(and similarly for LANG=, LC_CTYPE=, etc.) in all spec files. This
will be backwards and forwards compatible, in the sense that packages
that use C.UTF-8 should build OK on older and newer Fedoras.

Once that's done, I'll file the PRs to actually replace glibc-langpacks-all
with glibc-minimal-langpacks in mock and koji.

I'll do a mass update to use C.UTF-8 for the packages in the list that
follows, next week. I'll do test builds locally, and I'll only push to
dist-git if the local builds succeed. Let me know if you want your
package to be excluded.

Zbyszek

Maintainers by package:
OpenTK   orphan
apache-poi   gil lef mbooth
ardour5  nphilipp tartina
bash-completion  mrunge ooprala sheltren svashisht
borgbackup   bpereto fschwarz
clover2  mtasaka
elixir   codeblock fnux martinlanghoff puiterwijk s4504kr
fail2ban athimm atkac jgu orion
fantasdicmtasaka
felix-osgi-core  jcapik mizdebsk
fmf  psss
gfan jjames pcpa tremble
ghc  petersen
git  amahdal besser82 chrisw pcahyna pstodulk skisela tmz
hibernate3   gil lef
hive coolsvap moceap orphan pmackinn
hunspell-az  caolanm
hunspell-fa  caolanm
hunspell-ga  caolanm
hunspell-gv  caolanm
hunspell-ky  caolanm
ibus-typing-booster  anishpatil mfabian
ipython  churchyard cstratak dcantrel ignatenkobrain lbalhar mrunge 
salimma tomspur
jblaszbyszek
kgb-bot  averi
langtablemfabian
lazygal  rathann
libmp4v2 amigadave moezroy rathann sergiomb thias
libraqm  moceap
migemo   mtasaka
# migemo is special, I'll just add BR:glibc-langpack-ja
mongodb  hhorak jpacner maxamillion mskalick panovotn strobert 
tdawson
openqa   adamwill
paraview deji orion sagitter
passengerjkaluza kanarip tdawson
php-horde-Horde-Imap-Client remi
php-horde-Horde-JavascriptMinify remi
php-horde-Horde-Util remi
php-kdyby-events orphan
php-kdyby-strict-objects orphan
php-latteorphan
php-nette-application orphan
php-nette-bootstrap  orphan
php-nette-cachingorphan
php-nette-component-model orphan
php-nette-database   orphan
php-nette-deprecated orphan
php-nette-di orphan
php-nette-finder orphan
php-nette-forms  orphan
php-nette-http   orphan
php-nette-mail   orphan
php-nette-neon   orphan
php-nette-php-generator orphan
php-nette-reflection orphan
php-nette-robot-loader orphan
php-nette-safe-stream orphan
php-nette-security   orphan
php-nette-tester orphan
php-nette-tokenizer  orphan
php-nette-utils  orphan
php-phpspec  remi siwinski
php-tracyorphan
pyp2rpm  bkabrda cstratak ishcherb kevin mcyprian rkuska
python-CommonMarkjujens
python-acoustid  terjeros
python-blessed   abompard aviso
python-click cstratak fab mstuchli rkuska
python-deprecation   jpena
python-djangobkabrda churchyard jdornak mrunge salimma sgallagh
python-djangoql  vkrizan
python-evic  besser82
python-execnet   ktdreyer thm
python-ipython_genutils orion
python-mapniktomh
python-mtg   tc01
python-musicbrainzngs amluto
python-pankoclient   pkilambi
python-path  laxathom
python-pexpect   amcnabb fabiand ignatenkobrain radez tomspur
python-pypandoc  orion zbyszek
python-pytest-pep8   cstratak orion
python-pythonz-bdmcyprian orphan
python-seesawtc01
python-setproctitle  hguemar stevetraylen
python-setuptools_git apevec
python-sphinx-autodoc-typehints tdecacqu
python-sphinx-intl   jujens
python-spur  orion
python-tablestnorth zbyszek
python-vcstools  cottsay rmattes
python-webassets dcallagh kumarpraveen pjp sundaram
python-whitenoisepiotrp
python2-django1.11   pviktori
python2-ipython  lbalhar
rubygem-gettext  mtasaka sseago
rubygem-http_parser.rb ilgrad spredzy
rubygem-nokogiri kanarip mtasaka tdawson tremble
rubygem-org-ruby vondruch
rubygem-ruby-openid  orphan
udiskie  jstanek
varnish  ingvar luhliarik
xorg-x11-drv-intel   ajax glisse

Packages by maintainer:
abompard   python-blessed
adamwill   openqa
ajax   xorg-x11-drv-intel
amahdalgit
amcnabbpython-pexpect
amigadave  libmp4v2
amluto python-musicbrainzngs
anishpatil ibus-typing-booster
apevec python-setuptools_git
athimm fail2ban
atkac  fail2ban
averi  kgb-bot
aviso  python-blessed
besser82   git python-evic
bkabrdapyp2rpm python-django
bperetoborgbackup
caolanmhunspell-az hunspell-fa hunspell-ga hunspell-gv hunspell-ky
chrisw git