[Bug localedata/10501] bn_IN collation does not have canonical equivalence definitions

["maiku.fabian at gmail dot com" <sourceware-bugzilla@sourceware.org>]

https://sourceware.org/bugzilla/show_bug.cgi?id=10501

Mike FABIAN <maiku.fabian at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |maiku.fabian at gmail dot com

--- Comment #4 from Mike FABIAN <maiku.fabian at gmail dot com> ---
glibc-2.38 seems to sort the way you want to:

mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%)
$ cat bn_IN.UTF-8.in
কো
কৈ
কো 
mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%)
$ LC_ALL=bn_IN.UTF-8 sort < bn_IN.UTF-8.in
কৈ
কো
কো 
mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%)
$ rpm -q glibc
glibc-2.38-14.fc39.x86_64
mfabian@hathi:/local/mfabian/src/glibc/localedata (master $%)
$ 

The Bengali locale bn_IN just includes the standard iso sort order

LC_COLLATE
% Copy the template from ISO/IEC 14651
copy "iso14651_t1"

%
END LC_COLLATE

That iso sort order should be the same as DUCET:

https://unicode.org/reports/tr10/#Default_Unicode_Collation_Element_Table

It used to be extremely out of date but in 2018 I did an update to the 2016
version,
see this commit:

    commit 9479b6d5e08eacce06c6ab60abc9b2f4eb8b71e4
    Author: Mike FABIAN <mfabian@redhat.com>
    Date:   Tue Jan 30 17:59:00 2018 +0100

        Update iso14651_t1_common file to ISO14651_2016_TABLE1_en.txt [BZ
#14095]

        [BZ #14095] - Review / update collation data from Unicode / ISO 14651

        File downloaded from:
        http://standards.iso.org/iso-iec/14651/ed-4/ISO14651_2016_TABLE1_en.txt

        Updating this file alone is not enough, there are problems in the new
        file which need to be fixed and the collation rules for many locales
        need to be adapted. This is done by the following patches.

        This update also fixes the problem that many characters are treated as
        identical when sorting because they were not yet in the old
        iso14651_t1_common file, see:

        https://bugzilla.redhat.com/show_bug.cgi?id=1336308
        - Infinite (∞) and empty set (∅) are treated as if they were the same
character by sort and uniq

                [BZ #14095]
                * localedata/locales/iso14651_t1_common: Update file to
                latest version from ISO (ISO14651_2016_TABLE1_en.txt).

This might have fixed the problem reported here.

-- 
You are receiving this mail because:
You are the assignee for the bug.