[Bug localedata/15616] New: Characters outside the Pinyin collation are incorrectly sorted

[Bug localedata/15616] New: Characters outside the Pinyin collation are incorrectly sorted

[mcaropreso@yammer-inc.com]

http://sourceware.org/bugzilla/show_bug.cgi?id=15616

            Bug ID: 15616
           Summary: Characters outside the Pinyin collation are
                    incorrectly sorted
           Product: glibc
           Version: 2.15
            Status: NEW
          Severity: normal
          Priority: P2
         Component: localedata
          Assignee: unassigned at sourceware dot org
          Reporter: mcaropreso@yammer-inc.com
                CC: libc-locales at sourceware dot org

Created attachment 7077
  --> http://sourceware.org/bugzilla/attachment.cgi?id=7077&action=edit
Test file

If you set LC_COLLATE to zh_CN and sort the attached file using:

sort testdata

you can see that characters not included into the pinyin collation
(/usr/share/i18n/locales/iso14651_t1_pinyin) are not sorted (they are left in
place)
For example, in the testfile we have 㐀","㐀丁" and "㐀且" and even if they start
with the same character they are not sorted together.

It would be useful to sort those characters according to their codepoint in
Unicode. I tried to put an UNDEFINED rule at the end of the iso14651_t1_pinyin
collation but it didn't fix the problem.

Mario

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-18924-listarch-glibc-bugs=sources.redhat.com@sourceware.org Thu Jun 13 18:54:19 2013
Return-Path: <glibc-bugs-return-18924-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 20781 invoked by alias); 13 Jun 2013 18:54:19 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 20748 invoked by uid 48); 13 Jun 2013 18:54:14 -0000
From: "siddhesh at redhat dot com" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug nptl/15618] New: Possible access beyond memory bounds in pthread_attr_getaffinity
Date: Thu, 13 Jun 2013 18:54:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: nptl
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: siddhesh at redhat dot com
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter cc
Message-ID: <bug-15618-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2013-06/txt/msg00103.txt.bz2
Content-length: 2090

http://sourceware.org/bugzilla/show_bug.cgi?id\x15618

            Bug ID: 15618
           Summary: Possible access beyond memory bounds in
                    pthread_attr_getaffinity
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: nptl
          Assignee: unassigned at sourceware dot org
          Reporter: siddhesh at redhat dot com
                CC: drepper.fsp at gmail dot com

Description:

pthread_attr_getaffinity_np may corrupt memory by writing beyond bounds of the
input cpuset buffer if the given buffer is smaller than the buffer in the
thread attributes.

Reproducer:

#include <pthread.h>
#include <stdio.h>
#include <sched.h>
#include <errno.h>


#define RETURN_IF_FAIL(f, ...) \
  ({                                                                          \
    int ret = f (__VA_ARGS__);                                                \
    if (ret != 0)                                                             \
      {                                                                       \
        printf ("%s:%d: %s returned %d (errno = %d)\n", __FILE__, __LINE__,   \
                #f, ret, errno);                                              \
        return ret;                                                           \
      }                                                                       \
  })

int
main (void)
{
  for (int i = 0; i < 10; i++)
    {
      pthread_attr_t attr;
      cpu_set_t *cpuset = CPU_ALLOC (512);
      size_t cpusetsize = CPU_ALLOC_SIZE (512);
      CPU_ZERO_S (cpusetsize, cpuset);

      RETURN_IF_FAIL (pthread_attr_init, &attr);
      RETURN_IF_FAIL (pthread_attr_setaffinity_np, &attr, cpusetsize, cpuset);
      CPU_FREE (cpuset);

      cpuset = CPU_ALLOC (1);
      cpusetsize = CPU_ALLOC_SIZE (1);
      RETURN_IF_FAIL (pthread_attr_getaffinity_np, &attr, cpusetsize, cpuset);
      CPU_FREE (cpuset);
    }
  return 0;
}

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/15616] Characters outside the Pinyin collation are incorrectly sorted

[bluebat at member dot fsf.org]

https://sourceware.org/bugzilla/show_bug.cgi?id=15616

趙惟倫 <bluebat at member dot fsf.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |bluebat at member dot fsf.org

--- Comment #1 from 趙惟倫 <bluebat at member dot fsf.org> ---
as #13063 report confirmed.
#16905 is another approach but untested.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22267-listarch-glibc-bugs=sources.redhat.com@sourceware.org Wed May 07 08:19:18 2014
Return-Path: <glibc-bugs-return-22267-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 29290 invoked by alias); 7 May 2014 08:19:17 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 29218 invoked by uid 48); 7 May 2014 08:19:13 -0000
From: "bluebat at member dot fsf.org" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug localedata/13063] 'sort -u' will erase some Chinese characters
Date: Wed, 07 May 2014 08:19:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: localedata
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: critical
X-Bugzilla-Who: bluebat at member dot fsf.org
X-Bugzilla-Status: NEW
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: libc-locales at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: cc
Message-ID: <bug-13063-131-j3yRgLS8MK@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-13063-131@http.sourceware.org/bugzilla/>
References: <bug-13063-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00050.txt.bz2
Content-length: 580

https://sourceware.org/bugzilla/show_bug.cgi?id=13063

趙惟倫 <bluebat at member dot fsf.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |bluebat at member dot fsf.org

--- Comment #4 from 趙惟倫 <bluebat at member dot fsf.org> ---
as BZ#15616 report confirmed.
BZ#16905 is another approach but untested.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
>From glibc-bugs-return-22268-listarch-glibc-bugs=sources.redhat.com@sourceware.org Wed May 07 12:02:40 2014
Return-Path: <glibc-bugs-return-22268-listarch-glibc-bugs=sources.redhat.com@sourceware.org>
Delivered-To: listarch-glibc-bugs@sources.redhat.com
Received: (qmail 21180 invoked by alias); 7 May 2014 12:02:40 -0000
Mailing-List: contact glibc-bugs-help@sourceware.org; run by ezmlm
Precedence: bulk
List-Id: <glibc-bugs.sourceware.org>
List-Subscribe: <mailto:glibc-bugs-subscribe@sourceware.org>
List-Post: <mailto:glibc-bugs@sourceware.org>
List-Help: <mailto:glibc-bugs-help@sourceware.org>, <http://sourceware.org/lists.html#faqs>
Sender: glibc-bugs-owner@sourceware.org
Delivered-To: mailing list glibc-bugs@sourceware.org
Received: (qmail 21107 invoked by uid 48); 7 May 2014 12:02:31 -0000
From: "neleai at seznam dot cz" <sourceware-bugzilla@sourceware.org>
To: glibc-bugs@sourceware.org
Subject: [Bug nptl/16876] nptl/sockperf.c:105: possible bad if test ?
Date: Wed, 07 May 2014 12:02:00 -0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: glibc
X-Bugzilla-Component: nptl
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords:
X-Bugzilla-Severity: normal
X-Bugzilla-Who: neleai at seznam dot cz
X-Bugzilla-Status: RESOLVED
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: unassigned at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags:
X-Bugzilla-Changed-Fields: bug_status cc resolution
Message-ID: <bug-16876-131-2uXaIbDEFH@http.sourceware.org/bugzilla/>
In-Reply-To: <bug-16876-131@http.sourceware.org/bugzilla/>
References: <bug-16876-131@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-SW-Source: 2014-05/txt/msg00051.txt.bz2
Content-length: 624

https://sourceware.org/bugzilla/show_bug.cgi?id\x16876

Ondrej Bilka <neleai at seznam dot cz> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
                 CC|                            |neleai at seznam dot cz
         Resolution|---                         |FIXED

--- Comment #1 from Ondrej Bilka <neleai at seznam dot cz> ---
Fixed in ce0c5b8f365c73fc647f9a2a43fa988e6f0f46f4.
Thanks.

--
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/15616] Characters outside the Pinyin collation are incorrectly sorted

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=15616

Florian Weimer <fweimer at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
              Flags|                            |security-

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/15616] Characters outside the Pinyin collation are incorrectly sorted

[bluebat at member dot fsf.org]

https://sourceware.org/bugzilla/show_bug.cgi?id=15616

--- Comment #2 from Wei-Lun Chao <bluebat at member dot fsf.org> ---
Tested with patch from bug 17563 and get pass.

-- 
You are receiving this mail because:
You are on the CC list for the bug.