[Bug libc/16969] New: Outdated wcwidth character database

[Bug libc/16969] New: Outdated wcwidth character database

[johannes at kyriasis dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16969

            Bug ID: 16969
           Summary: Outdated wcwidth character database
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: libc
          Assignee: unassigned at sourceware dot org
          Reporter: johannes at kyriasis dot com
                CC: drepper.fsp at gmail dot com

The wcwidth characted database in glibc is very outdated, which leads to
programs not being able to display some characters properly. To work around
this issue programs such as vim and xterm works it by ignoring whether glibc
says that a given character is printable or not.

According to a mail[1] to a thread on the linux-utf8@nl.linux.org mailinglist
there are even characters from Unicode 4 that isn't supported yet.

One workaround is to use another wcwidth, like mgk25's[2]. Example can be seen
here[3].


[1]: http://article.gmane.org/gmane.comp.internationalization.linux/6572
[2]: http://www.cl.cam.ac.uk/~mgk25/ucs/wcwidth.c
[3]: https://theos.kyriasis.com/~kyrias/wcwidth.png

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/16969] Outdated wcwidth character database

[johannes at kyriasis dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16969

--- Comment #1 from Johannes Löthberg <johannes at kyriasis dot com> ---
Bug 4335 seems to be caused by the same issue, too.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22355-listarch-glibc-bugs=sources.redhat.com@sourceware.org Tue May 20 19:46:00 2014
Return-Path: <glibc-bugs-return-22355-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 20740 invoked by alias); 20 May 2014 19:46:00 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 20714 invoked by uid 48); 20 May 2014 19:45:57 -0000
From: "johannes at kyriasis dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug libc/16969] Outdated wcwidth character database
Date: Tue, 20 May 2014 19:46:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: libc
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: johannes at kyriasis dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: cc
Message-ID: <bug-16969-131-b5JRHeDhNt@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-16969-131@http.sourceware.org/bugzilla/>
References: <bug-16969-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00138.txt.bz2
Content-length: 413

https://sourceware.org/bugzilla/show_bug.cgi?id=16969

Johannes Löthberg <johannes at kyriasis dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |johannes at kyriasis dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22356-listarch-glibc-bugs=sources.redhat.com@sourceware.org Tue May 20 22:06:55 2014
Return-Path: <glibc-bugs-return-22356-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 18601 invoked by alias); 20 May 2014 22:06:55 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 18537 invoked by uid 55); 20 May 2014 22:06:50 -0000
From: "joseph at codesourcery dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug libc/16969] Outdated wcwidth character database
Date: Tue, 20 May 2014 22:06:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: libc
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: joseph at codesourcery dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields:
Message-ID: <bug-16969-131-nmxtV04I9R@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-16969-131@http.sourceware.org/bugzilla/>
References: <bug-16969-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00139.txt.bz2
Content-length: 499

https://sourceware.org/bugzilla/show_bug.cgi?id\x16969

--- Comment #2 from joseph at codesourcery dot com <joseph at codesourcery dot com> ---
Isn't this just part of bug 14094 - updating the Unicode data
(localedata/charmaps/UTF-8 in this case) and ensuring there is automation
to make future updates easier?  Again, we could do with someone who takes
on the role of Unicode expert for glibc to deal with such bugs.

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/16969] Outdated wcwidth character database

[johannes at kyriasis dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16969

Johannes Löthberg <johannes at kyriasis dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |DUPLICATE

--- Comment #3 from Johannes Löthberg <johannes at kyriasis dot com> ---
Ah, missed that one. I guess it's mostly the same, yes, tho that one seems to
only talk about adding the new things, not about adding the parts of the old
Unicode standards that aren't added yes, but then without those parts that bug
is incomplete.

*** This bug has been marked as a duplicate of bug 14094 ***

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22358-listarch-glibc-bugs=sources.redhat.com@sourceware.org Tue May 20 22:13:56 2014
Return-Path: <glibc-bugs-return-22358-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 23504 invoked by alias); 20 May 2014 22:13:56 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 23356 invoked by uid 48); 20 May 2014 22:13:51 -0000
From: "johannes at kyriasis dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug localedata/14094] Update locale data to Unicode 6.1
Date: Tue, 20 May 2014 22:13:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: localedata
X-Bugzilla-Version: 2.15
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: johannes at kyriasis dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: cc
Message-ID: <bug-14094-131-AoZJEJraUZ@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-14094-131@http.sourceware.org/bugzilla/>
References: <bug-14094-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00141.txt.bz2
Content-length: 556

https://sourceware.org/bugzilla/show_bug.cgi?id=14094

Johannes Löthberg <johannes at kyriasis dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |johannes at kyriasis dot com

--- Comment #2 from Johannes Löthberg <johannes at kyriasis dot com> ---
*** Bug 16969 has been marked as a duplicate of this bug. ***

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22359-listarch-glibc-bugs=sources.redhat.com@sourceware.org Wed May 21 07:37:51 2014
Return-Path: <glibc-bugs-return-22359-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 6395 invoked by alias); 21 May 2014 07:37:50 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 6369 invoked by uid 48); 21 May 2014 07:37:47 -0000
From: "ma.jiang at zte dot com.cn" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug dynamic-link/16971] New: SEGV in do_sym
Date: Wed, 21 May 2014 07:37:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: dynamic-link
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: critical
X-Bugzilla-Who: ma.jiang at zte dot com.cn
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter
Message-ID: <bug-16971-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00142.txt.bz2
Content-length: 1756

https://sourceware.org/bugzilla/show_bug.cgi?id\x16971

            Bug ID: 16971
           Summary: SEGV in do_sym
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: critical
          Priority: P2
         Component: dynamic-link
          Assignee: unassigned at sourceware dot org
          Reporter: ma.jiang at zte dot com.cn

In function do_sym(IN dl-sym.c), match could be NULL. At line 108,
match->l_scope will cause a SEGV.

94   struct link_map *l = _dl_find_dso_for_object (caller);
95   /* If the address is not recognized the call comes from the main
96      program (we hope).  */
97   struct link_map *match = l ? l : GL(dl_ns)[LM_ID_BASE]._ns_loaded;
98
99   if (handle == RTLD_DEFAULT)
100     {
101       /* Search the global scope.  We have the simple case where
102          we look up in the scope of an object which was part of
103          the initial binary.  And then the more complex part
104          where the object is dynamically loaded and the scope
105          array can change.  */
106       if (RTLD_SINGLE_THREAD_P)
107         result = GLRO(dl_lookup_symbol_x) (name, match, &ref,
108                                            match->l_scope, vers, 0,
109                                            flags |
DL_LOOKUP_ADD_DEPENDENCY,
110                                            NULL);

When a static program use 'dlsym(NULL, "symX")' (without any previous dlopen),
match will become NULL. This bug can be reproduced on mips but not on x86 which
always have a linux-gate.so even linked static. I think at line 98, a simple
check should be added as follow.

if (!match)
  return NULL;

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug libc/16969] Outdated wcwidth character database

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16969

Florian Weimer <fweimer at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
              Flags|                            |security-

-- 
You are receiving this mail because:
You are on the CC list for the bug.