[Bug libc/17318] New: [RFE] Provide a C.UTF-8 locale by default

[Bug libc/17318] New: [RFE] Provide a C.UTF-8 locale by default

[ncoghlan at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

            Bug ID: 17318
           Summary: [RFE] Provide a C.UTF-8 locale by default
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: libc
          Assignee: unassigned at sourceware dot org
          Reporter: ncoghlan at gmail dot com
                CC: drepper.fsp at gmail dot com

Fedora doesn't currently provide the C.UTF-8 locale. In the RFE requesting it
(https://bugzilla.redhat.com/show_bug.cgi?id=902094), it was suggested that a
more appropriate would be for it to be provided as part of upstream glibc, at
which point Fedora would inherit it by default.

Hence, this RFE to request the inclusion of a C.UTF-8 locale by default.

My personal interest relates to Python 3, where "LANG=C" misconfigures a few
aspects to use ASCII, when they really should be using UTF-8. While I'd
actually like to fix that on the Python side in the long run, being able to set
"LANG=C.UTF-8" instead is a solution that already works for existing versions
of Python 3.

Bug #16621 suggests that C.UTF-8 may actually require special casing in glibc
in order to be handled correctly. If that's accurate, then it would strengthen
the case for including the locale in the upstream library.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[pbrobinson at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Peter Robinson <pbrobinson at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |pbrobinson at gmail dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[hadess at hadess dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Bastien Nocera <hadess at hadess dot net> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |hadess at hadess dot net

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[mcepl at cepl dot eu]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset="UTF-8", Size: 3090 bytes --]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Matěj Cepl <mcepl at cepl dot eu> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |mcepl at cepl dot eu

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-27395-listarch-glibc-bugs=sources.redhat.com@sourceware.org Tue Feb 10 07:40:36 2015
Return-Path: <glibc-bugs-return-27395-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 18980 invoked by alias); 10 Feb 2015 07:40:36 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 18827 invoked by uid 48); 10 Feb 2015 07:40:32 -0000
From: "rayslava at gmail dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug build/17950] New: Build fails with -msse
Date: Tue, 10 Feb 2015 07:40:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: build
X-Bugzilla-Version: 2.21
X-Bugzilla-Keywords:
X-Bugzilla-Severity: minor
X-Bugzilla-Who: rayslava at gmail dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter cc attachments.created
Message-ID: <bug-17950-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-02/txt/msg00130.txt.bz2
Content-length: 799

https://sourceware.org/bugzilla/show_bug.cgi?id\x17950

            Bug ID: 17950
           Summary: Build fails with -msse
           Product: glibc
           Version: 2.21
            Status: NEW
          Severity: minor
          Priority: P2
         Component: build
          Assignee: unassigned at sourceware dot org
          Reporter: rayslava at gmail dot com
                CC: carlos at redhat dot com

Created attachment 8115
  --> https://sourceware.org/bugzilla/attachment.cgi?id15&actioníit
Patch proposal

Build both with -msse and -Werror causes build error:

  cc1: all warnings being treated as errors
  dl-runtime.c:1:0: error: SSE instruction set disabled, using 387 arithmetics
[-Werror]

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |carlos at redhat dot com

--- Comment #1 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to Nick Coghlan from comment #0)
> Fedora doesn't currently provide the C.UTF-8 locale. In the RFE requesting
> it (https://bugzilla.redhat.com/show_bug.cgi?id=902094), it was suggested
> that a more appropriate would be for it to be provided as part of upstream
> glibc, at which point Fedora would inherit it by default.
> 
> Hence, this RFE to request the inclusion of a C.UTF-8 locale by default.
> 
> My personal interest relates to Python 3, where "LANG=C" misconfigures a few
> aspects to use ASCII, when they really should be using UTF-8. While I'd
> actually like to fix that on the Python side in the long run, being able to
> set "LANG=C.UTF-8" instead is a solution that already works for existing
> versions of Python 3.
> 
> Bug #16621 suggests that C.UTF-8 may actually require special casing in
> glibc in order to be handled correctly. If that's accurate, then it would
> strengthen the case for including the locale in the upstream library.

I agree that this is a good idea. Someone needs to do the work and submit it to
libc-alpha. It's not all that easy, and consensus needs to be reached about the
inclusion of ~1.5MB of UTF-8 data into the runtime.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[vapier at gentoo dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Mike Frysinger <vapier at gentoo dot org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |vapier at gentoo dot org

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[ncoghlan at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #2 from Nick Coghlan <ncoghlan at gmail dot com> ---
Reference to the glic-alpha mailing list discussion with additional technical
details: https://sourceware.org/ml/libc-alpha/2015-02/msg00247.html

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/17318] [RFE] Provide a C.UTF-8 locale by default

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Marko Myllynen <myllynen at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |myllynen at redhat dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[jsm28 at gcc dot gnu.org]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Joseph Myers <jsm28 at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|libc                        |locale

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[vapier at gentoo dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Mike Frysinger <vapier at gentoo dot org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Blocks|                            |16621


Referenced Bugs:

https://sourceware.org/bugzilla/show_bug.cgi?id=16621
[Bug 16621] C.UTF-8 locales should be regarded like C w.r.t. $LANGUAGE
precedence
-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[vincent-srcware at vinc17 dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Vincent Lefèvre <vincent-srcware at vinc17 dot net> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |vincent-srcware at vinc17 dot net

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-29587-listarch-glibc-bugs=sources.redhat.com@sourceware.org Sun Aug 30 04:38:27 2015
Return-Path: <glibc-bugs-return-29587-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 114677 invoked by alias); 30 Aug 2015 04:38:24 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 114638 invoked by uid 48); 30 Aug 2015 04:38:20 -0000
From: "ncoghlan at gmail dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug locale/16621] C.UTF-8 locales should be regarded like C w.r.t. $LANGUAGE precedence
Date: Sun, 30 Aug 2015 04:38:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: locale
X-Bugzilla-Version: 2.18
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: ncoghlan at gmail dot com
X-Bugzilla-Status: RESOLVED
X-Bugzilla-Resolution: INVALID
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: security-
X-Bugzilla-Changed-Fields:
Message-ID: <bug-16621-131-VYMpS7c7Vl@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-16621-131@http.sourceware.org/bugzilla/>
References: <bug-16621-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-08/txt/msg00627.txt.bz2
Content-length: 974

https://sourceware.org/bugzilla/show_bug.cgi?id\x16621

--- Comment #5 from Nick Coghlan <ncoghlan at gmail dot com> ---
While it's true that glibc itself doesn't provide a C.UTF-8 locale, does that
really make this bug report invalid?

The Debian-derived family of distros default to adding a C.UTF-8 locale at the
distro level, but it doesn't quite work as expected, as it's missing some of
the special casing afforded the default C locale. The specific one covered by
this BZ is the face that LC_ALL=C will make glibc ignore the LANGUAGE setting,
but LC_ALL=C.UTF-8 doesn't.

Another possible way of phrasing the request would be for all "C.*" locales to
ignore the LANGUAGE setting the same way the unmodified "C" locale does, rather
than special casing "C.UTF-8". I'm not *personally* aware of any such locales
in widespread use other than "C.UTF-8", but that doesn't mean there aren't any.

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[mikaela at mikaela dot info]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Mikaela Suomalainen <mikaela at mikaela dot info> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |mikaela at mikaela dot info

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[ranky at gmx dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

strank <ranky at gmx dot net> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |ranky at gmx dot net

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #14 from Carlos O'Donell <carlos at redhat dot com> ---
Created attachment 12631
  --> https://sourceware.org/bugzilla/attachment.cgi?id=12631&action=edit
0001-Add-new-C.UTF-8-locale.patch.gz

Patch implementing new C.UTF-8.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #15 from Carlos O'Donell <carlos at redhat dot com> ---
Posted RFC for fixed C-UTF-8:
https://sourceware.org/pipermail/libc-alpha/2020-June/115224.html

The problem is with the fix it's a 28MiB locale :-(

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #16 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to Carlos O'Donell from comment #15)
> Posted RFC for fixed C-UTF-8:
> https://sourceware.org/pipermail/libc-alpha/2020-June/115224.html
> 
> The problem is with the fix it's a 28MiB locale :-(

I am working on reducing this to the point where the C.UTF-8 locale is as-fast
and as small as the C locale with regards to sorting. Since UTF-8 is sortable
via strcmp given the prefix ordering of the bytes, we should be able to bypass
the locale collation table code for UTF-8.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #17 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to Carlos O'Donell from comment #16)
> (In reply to Carlos O'Donell from comment #15)
> > Posted RFC for fixed C-UTF-8:
> > https://sourceware.org/pipermail/libc-alpha/2020-June/115224.html
> > 
> > The problem is with the fix it's a 28MiB locale :-(
> 
> I am working on reducing this to the point where the C.UTF-8 locale is
> as-fast and as small as the C locale with regards to sorting. Since UTF-8 is
> sortable via strcmp given the prefix ordering of the bytes, we should be
> able to bypass the locale collation table code for UTF-8.

Note that without splitting the C.UTF-8 locale LC_COLLATION into strict byte
boundary crossings the higher code point sorting is broken in Fedora and other
distributions. We will fix this when we fix the charmap parser to behave
sensibly when generating byte ranges for UTF-8 (instead of following the POSIX
rule blindly, which is not required).

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[aurelien at aurel32 dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Aurelien Jarno <aurelien at aurel32 dot net> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |aurelien at aurel32 dot net

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[accounts+sourceware at carldong dot me]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

accounts+sourceware at carldong dot me changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |accounts+sourceware@carldon
                   |                            |g.me

--- Comment #18 from accounts+sourceware at carldong dot me ---
Is there anything a bystander (who needs it for Arch Linux) can do to help?

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[vincent-srcware at vinc17 dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #19 from Vincent Lefèvre <vincent-srcware at vinc17 dot net> ---
Note that Debian provides a C.UTF-8 locale (this is not the same patch), but
this breaks iconv:

$ export LC_ALL=C.UTF-8
$ echo a─b | iconv -f utf-8 -t ascii//TRANSLIT
aiconv: illegal input sequence at position 1

where the "─" in "a─b" is U+2500 BOX DRAWINGS LIGHT HORIZONTAL. This error is
specific to C.UTF-8 (for instance, LC_ALL=C and LC_ALL=en_US.utf8 are both
fine). My bug report:

  https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=973647

So my question: With the proposed patch here, does iconv work correctly?

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #20 from Florian Weimer <fweimer at redhat dot com> ---
(In reply to Vincent Lefèvre from comment #19)
> Note that Debian provides a C.UTF-8 locale (this is not the same patch), but
> this breaks iconv:
> 
> $ export LC_ALL=C.UTF-8
> $ echo a─b | iconv -f utf-8 -t ascii//TRANSLIT
> aiconv: illegal input sequence at position 1
> 
> where the "─" in "a─b" is U+2500 BOX DRAWINGS LIGHT HORIZONTAL. This error
> is specific to C.UTF-8 (for instance, LC_ALL=C and LC_ALL=en_US.utf8 are
> both fine). My bug report:
> 
>   https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=973647
> 
> So my question: With the proposed patch here, does iconv work correctly?

Fedora's C.UTF-8 locale does not have this particular problem.

I have not reviewed the patch posted here, but an upstream implementation will
have basic transliteration support as well, so this should not be a problem.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[mcepl at cepl dot eu]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #21 from Matěj Cepl <mcepl at cepl dot eu> ---
(In reply to Florian Weimer from comment #20)
> Fedora's C.UTF-8 locale does not have this particular problem.

Neither I see it on OpenSUSE:

~@stitny$ export LC_ALL=C.UTF-8
~@stitny$ locale
LANG=cs_CZ.UTF-8
LC_CTYPE="C.UTF-8"
LC_NUMERIC="C.UTF-8"
LC_TIME="C.UTF-8"
LC_COLLATE="C.UTF-8"
LC_MONETARY="C.UTF-8"
LC_MESSAGES="C.UTF-8"
LC_PAPER="C.UTF-8"
LC_NAME="C.UTF-8"
LC_ADDRESS="C.UTF-8"
LC_TELEPHONE="C.UTF-8"
LC_MEASUREMENT="C.UTF-8"
LC_IDENTIFICATION="C.UTF-8"
LC_ALL=C.UTF-8
~@stitny$ echo a─b | iconv -f utf-8 -t ascii//TRANSLIT
a-b
~@stitny$

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[vincent-srcware at vinc17 dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #22 from Vincent Lefèvre <vincent-srcware at vinc17 dot net> ---
(In reply to Florian Weimer from comment #20)
> I have not reviewed the patch posted here, but an upstream implementation
> will have basic transliteration support as well, so this should not be a
> problem.

Note that there is also basic transliteration in the Debian patch. The issue is
just that when iconv runs under C.UTF-8, it fails on some characters. This even
succeeds with a non-existing locale, such as:

  echo a─b | LC_ALL=foo /usr/bin/iconv -f utf-8 -t ascii//TRANSLIT

However, it may be a more general issue with iconv since I've just noticed that
the behavior on "é" in the C locale is buggy too.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[mcepl at cepl dot eu]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #23 from Matěj Cepl <mcepl at cepl dot eu> ---
(In reply to Vincent Lefèvre from comment #22)
> Note that there is also basic transliteration in the Debian patch. The issue
> is just that when iconv runs under C.UTF-8, it fails on some characters.
> This even succeeds with a non-existing locale, such as:
> 
>   echo a─b | LC_ALL=foo /usr/bin/iconv -f utf-8 -t ascii//TRANSLIT
> 
> However, it may be a more general issue with iconv since I've just noticed
> that the behavior on "é" in the C locale is buggy too.

I am not sure what to think about this one:

~@stitny$ echo a─b | LC_ALL=foo /usr/bin/iconv -f utf-8 -t ascii//TRANSLIT
a-b
~@stitny$ echo é | LC_ALL=foo /usr/bin/iconv -f utf-8 -t ascii//TRANSLIT
?
~@stitny$ echo é | LC_ALL=C.UTF-8 /usr/bin/iconv -f utf-8 -t ascii//TRANSLITe
~@stitny$ rpm -qf /usr/bin/iconv
glibc-2.32-3.1.x86_64
~@stitny$

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[mcepl at cepl dot eu]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #24 from Matěj Cepl <mcepl at cepl dot eu> ---
That é example lost EOL, it got transliterated correctly:

~@stitny$ echo é | LC_ALL=C.UTF-8 /usr/bin/iconv -f utf-8 -t ascii//TRANSLIT
e
~@stitny$ 
ZZ

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[vincent-srcware at vinc17 dot net]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

--- Comment #25 from Vincent Lefèvre <vincent-srcware at vinc17 dot net> ---
(In reply to Vincent Lefèvre from comment #22)
> However, it may be a more general issue with iconv since I've just noticed
> that the behavior on "é" in the C locale is buggy too.

I've reported bug 26984 about this one.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Assignee|unassigned at sourceware dot org   |carlos at redhat dot com

--- Comment #26 from Carlos O'Donell <carlos at redhat dot com> ---
Posted v4 for review.
https://sourceware.org/pipermail/libc-alpha/2021-April/125543.html

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
   Target Milestone|---                         |2.35
             Status|NEW                         |RESOLVED

--- Comment #27 from Carlos O'Donell <carlos at redhat dot com> ---
This is fixed in glibc 2.35 with the following commit that uses the new
"codepoint_collation" support for LC_COLLATE.

commit 466f2be6c08070e9113ae2fdc7acd5d8828cba50
Author: Carlos O'Donell <carlos@redhat.com>
Date:   Wed Sep 1 15:19:19 2021 -0400

    Add generic C.UTF-8 locale (Bug 17318)


commit f5117c6504888fab5423282a4607c552b90fd3f9
Author: Carlos O'Donell <carlos@redhat.com>
Date:   Thu Jul 29 22:45:39 2021 -0400

    Add 'codepoint_collation' support for LC_COLLATE.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |lautgesetz at gmail dot com

--- Comment #28 from Carlos O'Donell <carlos at redhat dot com> ---
*** Bug 21302 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug locale/17318] [RFE] Provide a C.UTF-8 locale by default

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=17318
Bug 17318 depends on bug 21302, which changed state.

Bug 21302 Summary: strcoll does not correctly follow locale-specified order in some cases
https://sourceware.org/bugzilla/show_bug.cgi?id=21302

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|ASSIGNED                    |RESOLVED
         Resolution|---                         |DUPLICATE

-- 
You are receiving this mail because:
You are on the CC list for the bug.