From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 48) id C063E3858C62; Wed, 3 Jan 2024 16:09:42 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org C063E3858C62 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1704298182; bh=JrkLw57OyqCrvD33jS0YT8SE+H+G+hM2W7Y6dHOBtCE=; h=From:To:Subject:Date:In-Reply-To:References:From; b=uaS4dsT5N8YX0Crll2u+tc1V7douhKM2g/0dyU08fgDz4oNJpHLWyWyG7NaJDSG0U 09Tsyc4oYF4A604F17DOH+igO805e04cSylHVuT+q0YWI98OwcsobeTwLNjUYD5eQL Osqoyuifc6E6kyhFMtopZ2MRZUGVDvbQ/Yoo0+JU= From: "maiku.fabian at gmail dot com" To: libc-locales@sourceware.org Subject: [Bug localedata/10501] bn_IN collation does not have canonical equivalence definitions Date: Wed, 03 Jan 2024 16:09:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: glibc X-Bugzilla-Component: localedata X-Bugzilla-Version: 2.10 X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: maiku.fabian at gmail dot com X-Bugzilla-Status: NEW X-Bugzilla-Resolution: X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: libc-locales at sourceware dot org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: security- X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://sourceware.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 List-Id: https://sourceware.org/bugzilla/show_bug.cgi?id=3D10501 Mike FABIAN changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |maiku.fabian at gmail dot = com --- Comment #4 from Mike FABIAN --- glibc-2.38 seems to sort the way you want to: mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%) $ cat bn_IN.UTF-8.in =E0=A6=95=E0=A7=87=E0=A6=BE =E0=A6=95=E0=A7=88 =E0=A6=95=E0=A7=8B=20 mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%) $ LC_ALL=3Dbn_IN.UTF-8 sort < bn_IN.UTF-8.in =E0=A6=95=E0=A7=88 =E0=A6=95=E0=A7=87=E0=A6=BE =E0=A6=95=E0=A7=8B=20 mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%) $ rpm -q glibc glibc-2.38-14.fc39.x86_64 mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%) $=20 The Bengali locale bn_IN just includes the standard iso sort order LC_COLLATE % Copy the template from ISO/IEC 14651 copy "iso14651_t1" % END LC_COLLATE That iso sort order should be the same as DUCET: https://unicode.org/reports/tr10/#Default_Unicode_Collation_Element_Table It used to be extremely out of date but in 2018 I did an update to the 2016 version, see this commit: commit 9479b6d5e08eacce06c6ab60abc9b2f4eb8b71e4 Author: Mike FABIAN Date: Tue Jan 30 17:59:00 2018 +0100 Update iso14651_t1_common file to ISO14651_2016_TABLE1_en.txt [BZ #14095] [BZ #14095] - Review / update collation data from Unicode / ISO 146= 51 File downloaded from: http://standards.iso.org/iso-iec/14651/ed-4/ISO14651_2016_TABLE1_en= .txt Updating this file alone is not enough, there are problems in the n= ew file which need to be fixed and the collation rules for many locales need to be adapted. This is done by the following patches. This update also fixes the problem that many characters are treated= as identical when sorting because they were not yet in the old iso14651_t1_common file, see: https://bugzilla.redhat.com/show_bug.cgi?id=3D1336308 - Infinite (=E2=88=9E) and empty set (=E2=88=85) are treated as if = they were the same character by sort and uniq [BZ #14095] * localedata/locales/iso14651_t1_common: Update file to latest version from ISO (ISO14651_2016_TABLE1_en.txt). This might have fixed the problem reported here. --=20 You are receiving this mail because: You are the assignee for the bug.=