[Bug localedata/18399] New: Review / update charmap data

[Bug localedata/18399] New: Review / update charmap data

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18399

            Bug ID: 18399
           Summary: Review / update charmap data
           Product: glibc
           Version: 2.21
            Status: NEW
          Severity: normal
          Priority: P2
         Component: localedata
          Assignee: unassigned at sourceware dot org
          Reporter: myllynen at redhat dot com
                CC: joseph at codesourcery dot com, libc-locales at sourceware dot org,
                    maiku.fabian at gmail dot com
  Target Milestone: ---

The localedata/charmaps/* files are probably, judging by comments in them,
based on the corresponding standards and are thus fine as-is. However, there
are at least few charmaps which should be reviewed and updated or even
added/removed if deemed appropriate.

- ISO_10646 was not updated as part of bug 14094 work and thus looks outdated.
Its use of mnemonics could also be reconsidered.

- POSIX Portable Character Set charmap is not available, should it?

http://pubs.opengroup.org/onlinepubs/000095399/basedefs/xbd_chap06.html
http://pubs.opengroup.org/onlinepubs/009695399/basedefs/xbd_chap07.html#tag_07_02

- ISO_8859-1,GL looks like ISO-8859-1 written in mnemonics but the name is
derived from its author and thus it doesn't look like a general purpose
character map that should be part of glibc so perhaps it could be removed?

Thanks.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/18399] Review / update charmap data

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18399

--- Comment #1 from Marko Myllynen <myllynen at redhat dot com> ---
Actually charmaps using mnemonics won't work since the mnemonics files have
been removed:

2000-07-07  Ulrich Drepper  <drepper@redhat.com>

        * locales/POSIX: Remove repertoire map reference.
        * locales/ar_SA: Remove repertoire map reference.

        * repertoiremaps/charids.894: Removed.
        * repertoiremaps/mnemonics.ds: Removed.
        * repertoiremaps/mnemonics.ja: Removed.
        * repertoiremaps/mnemonics.ko: Removed.
        * repertoiremaps/mnemonics.zh: Removed.

A quick grep indicates that the following charmaps are still using mnemonics:

ISO_10646
ISO_8859-1,GL
JIS_C6220-1969-JP
JIS_C6229-1984-A
JIS_C6229-1984-B-ADD
JIS_C6229-1984-HAND
JIS_C6229-1984-HAND-ADD
JIS_C6229-1984-KANA
NATS-DANO-ADD
NATS-SEFI-ADD

Also, if doing changes for charmaps, it's probably a good idea to check whether
any related changes are needed for possibly corresponding iconv modules under
iconvdata/.

Thanks.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/18399] Review / update charmap data

[keld at keldix dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18399

--- Comment #2 from keld at keldix dot com <keld at keldix dot com> ---
On Tue, May 12, 2015 at 01:11:53PM +0000, myllynen at redhat dot com wrote:
> https://sourceware.org/bugzilla/show_bug.cgi?id=18399
> 
> --- Comment #1 from Marko Myllynen <myllynen at redhat dot com> ---
> Actually charmaps using mnemonics won't work since the mnemonics files have
> been removed:
> 
> 2000-07-07  Ulrich Drepper  <drepper@redhat.com>
> 
>         * locales/POSIX: Remove repertoire map reference.
>         * locales/ar_SA: Remove repertoire map reference.
> 
>         * repertoiremaps/charids.894: Removed.
>         * repertoiremaps/mnemonics.ds: Removed.
>         * repertoiremaps/mnemonics.ja: Removed.
>         * repertoiremaps/mnemonics.ko: Removed.
>         * repertoiremaps/mnemonics.zh: Removed.
> 
> A quick grep indicates that the following charmaps are still using mnemonics:
> 
> ISO_10646
> ISO_8859-1,GL
> JIS_C6220-1969-JP
> JIS_C6229-1984-A
> JIS_C6229-1984-B-ADD
> JIS_C6229-1984-HAND
> JIS_C6229-1984-HAND-ADD
> JIS_C6229-1984-KANA
> NATS-DANO-ADD
> NATS-SEFI-ADD
> 
> Also, if doing changes for charmaps, it's probably a good idea to check whether
> any related changes are needed for possibly corresponding iconv modules under
> iconvdata/.

Some mnemonics are mandated by the POSIX standard, ISO/IEC 9945.

I think it was an error to remove the more extensive mnemonics,, the hex
codes make the locales much harder to proofread.

Best regrads
Keld

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/18399] Review / update charmap data

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=18399

--- Comment #3 from Marko Myllynen <myllynen at redhat dot com> ---
(In reply to keld@keldix.com from comment #2)
> Some mnemonics are mandated by the POSIX standard, ISO/IEC 9945.

Checking for commonly used mnemonics like "dollar-sign" ("grep -ri dollar-sign
glibc.git") shows that they are unimplemented. If you think this is important,
perhaps filing a separate bug would be best.

> I think it was an error to remove the more extensive mnemonics,, the hex
> codes make the locales much harder to proofread.

There are nowadays some tips in the upstream manual page which help checking
locales (see http://man7.org/linux/man-pages/man1/locale.1.html).

Thanks.

-- 
You are receiving this mail because:
You are on the CC list for the bug.