[Bug libc/18412] New: 'locale -a' outputs encoding errors

[Bug libc/18412] New: 'locale -a' outputs encoding errors

[eggert at gnu dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

            Bug ID: 18412
           Summary: 'locale -a' outputs encoding errors
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: libc
          Assignee: unassigned at sourceware dot org
          Reporter: eggert at gnu dot org
                CC: drepper.fsp at gmail dot com
  Target Milestone: ---

Here are the symptoms, on Fedora 21:

$ locale | grep LC_ALL
LC_ALL=en_US.UTF-8
$ locale -a | grep en_US
Binary file (standard input) matches

The problem is that 'locale -a' is attempting to output the string "bokmål",
but it does so using a Latin-1 encoding, which is an encoding error in a UTF-8
locale.  'locale -a' should always output properly-encoded text.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-28221-listarch-glibc-bugs=sources.redhat.com@sourceware.org Wed May 13 23:01:47 2015
Return-Path: <glibc-bugs-return-28221-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 50598 invoked by alias); 13 May 2015 23:01:47 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 49950 invoked by uid 55); 13 May 2015 23:01:43 -0000
From: "joseph at codesourcery dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug libc/18412] 'locale -a' outputs encoding errors
Date: Wed, 13 May 2015 23:01:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: libc
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: joseph at codesourcery dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Resolution:
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields:
Message-ID: <bug-18412-131-BWA0rGb60y@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-18412-131@http.sourceware.org/bugzilla/>
References: <bug-18412-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-05/txt/msg00086.txt.bz2
Content-length: 390

https://sourceware.org/bugzilla/show_bug.cgi?id\x18412

--- Comment #1 from joseph at codesourcery dot com <joseph at codesourcery dot com> ---
libc-alpha discussion: starts
<https://sourceware.org/ml/libc-alpha/2015-01/msg00379.html>, my comments
<https://sourceware.org/ml/libc-alpha/2015-01/msg00382.html>.

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[eggert at gnu dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

--- Comment #2 from Paul Eggert <eggert at gnu dot org> ---
Created attachment 8315
  --> https://sourceware.org/bugzilla/attachment.cgi?id=8315&action=edit
Remove badly-encoded lines from locale.aliases

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[eggert at gnu dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

--- Comment #3 from Paul Eggert <eggert at gnu dot org> ---
Thanks for reminding me about the old discussion; I'd forgotten it, and filed
this bug report only because I personally ran into the bug again.  Let's bite
the bullet and fix it; I created a proposed patch.  We should stamp out those
poorly-encoded locale aliases anyway.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |carlos at redhat dot com

--- Comment #4 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to Paul Eggert from comment #3)
> Thanks for reminding me about the old discussion; I'd forgotten it, and
> filed this bug report only because I personally ran into the bug again. 
> Let's bite the bullet and fix it; I created a proposed patch.  We should
> stamp out those poorly-encoded locale aliases anyway.

I wanted to have some kind of compatibility for the removed entries, but the
more I think about it the more work it will be. We'll need another
configuration file to handle the compat entries, and to allow users to remove
them, and that's a terrible solution.

Could we skip printing non-ASCII aliases? Document that as the expected
behaviour? Then add comments in locale.alias saying these two aliases are not
printed, but can be used for old program comaptibility?

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[eggert at gnu dot org]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

--- Comment #5 from Paul Eggert <eggert at gnu dot org> ---
> Could we skip printing non-ASCII aliases? Document that as the expected
> behaviour?

We could, if someone wanted to implement all that.  But it'll be better simply
to remove the two bad aliases, as that'll be easier to document and so will be
easier on the users.  We survived just fine when we removed obsolete Norse
aliases before (LC_ALL='no@bokmal' -- remember that?) and we'll survive just
fine removing these two bad aliases too.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

--- Comment #6 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to Paul Eggert from comment #5)
> > Could we skip printing non-ASCII aliases? Document that as the expected
> > behaviour?
> 
> We could, if someone wanted to implement all that.  But it'll be better
> simply to remove the two bad aliases, as that'll be easier to document and
> so will be easier on the users.  We survived just fine when we removed
> obsolete Norse aliases before (LC_ALL='no@bokmal' -- remember that?) and
> we'll survive just fine removing these two bad aliases too.

I guess your right in that respect, it is simpler and easier to explain.

OK to commit from my end.

I'd post to libc-alpha and look for one more person to OK this change and then
I'd consider it consensus to remove the non-ASCII alias.

Bonus if someone already gave consent in the original discussion, in which case
I think we should fix it and move forward.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/18412] 'locale -a' outputs encoding errors

[cvs-commit at gcc dot gnu.org]

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

--- Comment #7 from cvs-commit at gcc dot gnu.org <cvs-commit at gcc dot gnu.org> ---
This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "GNU C Library master sources".

The branch, master has been updated
       via  333e1ba4e53456a603621274177ae9393b9d5385 (commit)
      from  60dce8b9044155bb04eb310fb0fc5e9607b7d2e6 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -----------------------------------------------------------------
https://sourceware.org/git/gitweb.cgi?p=glibc.git;h=333e1ba4e53456a603621274177ae9393b9d5385

commit 333e1ba4e53456a603621274177ae9393b9d5385
Author: Paul Eggert <eggert@cs.ucla.edu>
Date:   Fri May 22 14:57:11 2015 -0700

    Remove obsolete aliases that broke 'locale -a'

    [BZ #18412]
    * intl/locale.alias: Remove obsolete aliases "bokm�l" and "fran�ais"
    which caused 'locale -a' to output Latin-1 data in UTF-8 locales,
    breaking some applications that use 'locale -a' output.
    Change the encoding of this file from Latin-1 to ASCII to avoid
    other potential problems with people grepping this file.

-----------------------------------------------------------------------

Summary of changes:
 ChangeLog         |   10 ++++++++++
 NEWS              |    4 ++--
 intl/locale.alias |   13 +++++++++++--
 3 files changed, 23 insertions(+), 4 deletions(-)

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-28341-listarch-glibc-bugs=sources.redhat.com@sourceware.org Fri May 22 22:29:56 2015
Return-Path: <glibc-bugs-return-28341-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 88541 invoked by alias); 22 May 2015 22:29:56 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 88488 invoked by uid 48); 22 May 2015 22:29:52 -0000
From: "eggert at gnu dot org" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug libc/18412] 'locale -a' outputs encoding errors
Date: Fri, 22 May 2015 22:29:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: libc
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: eggert at gnu dot org
X-Bugzilla-Status: RESOLVED
X-Bugzilla-Resolution: FIXED
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: security-
X-Bugzilla-Changed-Fields: bug_status resolution
Message-ID: <bug-18412-131-Tf4cT9Iw87@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-18412-131@http.sourceware.org/bugzilla/>
References: <bug-18412-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-05/txt/msg00206.txt.bz2
Content-length: 1266

https://sourceware.org/bugzilla/show_bug.cgi?id=18412

Paul Eggert <eggert at gnu dot org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |FIXED

--- Comment #8 from Paul Eggert <eggert at gnu dot org> ---
(In reply to Carlos O'Donell from comment #6)

> Bonus if someone already gave consent in the original discussion, in which
> case I think we should fix it and move forward.

I think that we have consensus enough so I changed the new comments to use
ASCII only (a bit safer if people are grepping locale.aliases directly),
installed it as commit 333e1ba4e53456a603621274177ae9393b9d5385, and am marking
this bug as fixed.

Hmm, I see that <https://sourceware.org/bugzilla/show_bug.cgi?id=18412> got
confused by the mixed-encoding patch and the web page is transliterating
perfectly good characters like 'å' (U+00E5 LATIN SMALL LETTER A WITH RING
ABOVE) in the patch to a blotch (U+FFFD REPLACEMENT CHARACTER) on the web. Oh
well the patch itself should be good.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-28342-listarch-glibc-bugs=sources.redhat.com@sourceware.org Sat May 23 01:47:30 2015
Return-Path: <glibc-bugs-return-28342-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 109269 invoked by alias); 23 May 2015 01:47:30 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 109240 invoked by uid 55); 23 May 2015 01:47:24 -0000
From: "cvs-commit at gcc dot gnu.org" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug dynamic-link/18410] Incorrect handling of missing DT_PLTRELSZ
Date: Sat, 23 May 2015 01:47:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: dynamic-link
X-Bugzilla-Version: 2.21
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: cvs-commit at gcc dot gnu.org
X-Bugzilla-Status: NEW
X-Bugzilla-Resolution:
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: security-
X-Bugzilla-Changed-Fields:
Message-ID: <bug-18410-131-QdAyNhrDp7@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-18410-131@http.sourceware.org/bugzilla/>
References: <bug-18410-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-05/txt/msg00207.txt.bz2
Content-length: 1563

https://sourceware.org/bugzilla/show_bug.cgi?id\x18410

--- Comment #2 from cvs-commit at gcc dot gnu.org <cvs-commit at gcc dot gnu.org> ---
This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "GNU C Library master sources".

The branch, master has been updated
       via  3e058c9d7eab6d6361e7cda5ba1394bc1757c9f6 (commit)
      from  333e1ba4e53456a603621274177ae9393b9d5385 (commit)

Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.

- Log -----------------------------------------------------------------
https://sourceware.org/git/gitweb.cgi?p=glibc.git;h>058c9d7eab6d6361e7cda5ba1394bc1757c9f6

commit 3e058c9d7eab6d6361e7cda5ba1394bc1757c9f6
Author: H.J. Lu <hjl.tools@gmail.com>
Date:   Fri May 22 17:46:42 2015 -0700

    Don't issue an error if DT_PLTRELSZ is missing

    A shared object doesn't need PLT if there are no PLT relocations.  It
    shouldn't be an error if DT_PLTRELSZ is missing.

        [BZ #18410]
        * elf/dl-reloc.c (_dl_relocate_object): Don't issue an error
        for missing DT_PLTRELSZ.

-----------------------------------------------------------------------

Summary of changes:
 ChangeLog      |    6 ++++++
 NEWS           |    4 ++--
 elf/dl-reloc.c |   14 +++-----------
 3 files changed, 11 insertions(+), 13 deletions(-)

--
You are receiving this mail because:
You are on the CC list for the bug.