[Bug localedata/24314] New: charmaps: Some of UTF-8 characters have invalid width

["stlman at poczta dot fm" <sourceware-bugzilla@sourceware.org>]

https://sourceware.org/bugzilla/show_bug.cgi?id=24314

            Bug ID: 24314
           Summary: charmaps: Some of UTF-8 characters have invalid width
           Product: glibc
           Version: unspecified
            Status: UNCONFIRMED
          Severity: normal
          Priority: P2
         Component: localedata
          Assignee: unassigned at sourceware dot org
          Reporter: stlman at poczta dot fm
                CC: libc-locales at sourceware dot org
  Target Milestone: ---

Some characters are assigned invalid width in localedata/charmaps/UTF-8 file
(lines below 47072). For example \u2693 (ANCHOR) is described as double-width
character.

There is a procedure for deriving the data from the standard files, which says
that double width characters come from EastAsianWidth.txt file.

  grep '^[^;]*;[WF]' EastAsianWidth.txt | grep 2693

returns no results which means the line 47261 (as of commit c5f65462a2) which
says

  <U2693> 2

is wrong. At least 28 other characters seem to be improperly classified as
double-width too. Use the following command to find them.

  perl -ne 'next if (1..47080 or /\.\.\./);  print if (/2$/);'
localedata/charmaps/UTF-8

None of these characters can be found in the output of 

  grep '^[^;]*;[WF]' EastAsianWidth.txt

Apparently the localedata/unicode-gen/utf8_gen.py script has failed to filter
out these characters.

-- 
You are receiving this mail because:
You are on the CC list for the bug.