[Bug locale/18927] Different strings should never collate as equal

["egmont at gmail dot com" <sourceware-bugzilla@sourceware.org>]

https://sourceware.org/bugzilla/show_bug.cgi?id=18927

--- Comment #10 from Egmont Koblinger <egmont at gmail dot com> ---
The 0x01 byte, bytes of an invalid UTF-8, and bytes of unrecognized Unicode
codepoints (e.g. U+AC00) all get converted to the exact same token, that is,
e.g. any two of "가" (U+AC00), "각" (U+AC01), "\x01\x01\x01" (^A^A^A),
"\x80\x80\x80" (invalid), "\xd0\xfe\xff" (invalid) etc. collate the same.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-29713-listarch-glibc-bugs=sources.redhat.com@sourceware.org Wed Sep 09 19:46:35 2015
Return-Path: <glibc-bugs-return-29713-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 122125 invoked by alias); 9 Sep 2015 19:46:35 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 122089 invoked by uid 48); 9 Sep 2015 19:46:31 -0000
From: "egmont at gmail dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug locale/18927] Different strings should never collate as equal
Date: Wed, 09 Sep 2015 19:46:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: locale
X-Bugzilla-Version: 2.21
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: egmont at gmail dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Resolution:
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields:
Message-ID: <bug-18927-131-PtygkkYPlP@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-18927-131@http.sourceware.org/bugzilla/>
References: <bug-18927-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2015-09/txt/msg00112.txt.bz2
Content-length: 737

https://sourceware.org/bugzilla/show_bug.cgi?id\x18927

--- Comment #11 from Egmont Koblinger <egmont at gmail dot com> ---
(In reply to joseph@codesourcery.com from comment #8)

> [...] (although if they normalize
> the same, I'd expect them to collate together relative to all other
> strings - differences in normalization being of the lowest precedence in
> collation).

All the currently available UTF-8 unittests fail if converted to NFD. It would
be nice to have what you described, but apparently there's no generic solution
for that, and addressing them individually in locale definitions is probably a
no-go. Filed a low-prio bug 18943 for that.

--
You are receiving this mail because:
You are on the CC list for the bug.