From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.17.13]) by sourceware.org (Postfix) with ESMTPS id 8115A3857C4C for ; Fri, 9 Oct 2020 03:15:49 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 8115A3857C4C Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=towo.net Authentication-Results: sourceware.org; spf=none smtp.mailfrom=towo@towo.net Received: from [192.168.178.45] ([95.90.245.244]) by mrelayeu.kundenserver.de (mreue108 [212.227.15.183]) with ESMTPSA (Nemesis) id 1Mg6i8-1krWST47J8-00hdGd for ; Fri, 09 Oct 2020 05:15:48 +0200 From: Thomas Wolff Subject: drop ambiguous-wide behaviour from Unicode CJK locales To: newlib@sourceware.org X-Tagtoolbar-Keys: D20201009051547868 Message-ID: Date: Fri, 9 Oct 2020 05:15:47 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.12.1 MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------84A14617DDE5C11AD3E81324" X-Provags-ID: V03:K1:DrzLn//4Pu6+H/CxsD1h+Fg4M9gIPBEgnWE46IviZ5BKXcwLYZN 1XibW+40aRYrj0Zw+84h041mjFn55iMDNx0zd8Wap2u7qd9jeiVyeWF2CvVd9jJsSIbI+hh U8Z1lDED9kcYbaSabbthUq9Mab7R2JYZSSCJUCIiAJ9UEZRLv43fRNAX5fJEIOz0R/qDjfL 1BlnSu+Xs17/3lFNaD4/A== X-UI-Out-Filterresults: notjunk:1;V03:K0:0w8mELLqcwM=:w28+vFcD+aeXg6kECgQxkg L32r2LurmmrLTPg1opfb2dzJjpB6vYsXG9MeQNrTOLCG3pyA7K4CJWfaT44EeNkXVZtqf5nbm JF2TRXk+4vMjhRTcNmTSBw3mbi4rravco+34lyi/rbGHQJzC4U8N8oCkp+RBg1nfyituCMD/U +WOF6apbGHwpyIkE5HURzgJ6REpidlvRQbO7tzxlYNmGH8B27bg42RlpMKlODETupwa5bOwwL SeZUtwm0WEEqNBIgjxvnzhCs9ACSkT1epA/jjylhQL3xI8hs1kYW/upxf1NOrnvfhGNq26KjZ PHBASN6k+NMy5jcDjKALfBrR4GNZiLE2ZZ3ZQdBlgGs7Z2B5yayoGp0/AVV+jklw1R6YUo4KE HtK8qrhPZ1LChtgvcgIQkaE40sYwp14bYlJmYU9zzyjhnJuVt5ul4ixCefUFQwwPFbCHjY0RP txPZh+rtH5sQEGXvhJkzT84q9Wxvx0HNc52vVFMkJA9kYkJMF349gafzfv2QLoft29IbT4zHP bzFuyExTex3sNDoaHqUQb2J793akz6HlVCG62L+hYpFxpeteGi5D2dTgRNjZiDyjnnLyrSUtM 0SDzwGOGo0yYw0OhTKt+U61O54UYcN/rOb6/x9/38WZuQy4YFESWmZVrdFxac3Oor7PXlcbuP PLNUgX4F5XqNxBNFR7TPVgGDmnA6YKXSjYpE0vOeozxNv+BUxI9k1wmO+0i+EwQsTU+JkZIJD QcMI+oh6A60k2VNE/Jm6oKoI3It23DcQw/WvUjPlWnn0V5/bdYjezACtMoKoQ4QObZqdUwUh5 A3fJpa5lLQplqI5BfrNhZT6tR9QmlG7H1Jrsoz5Xul1/t+XV31DetcjhekVd/Lgfzfl3xdO X-Spam-Status: No, score=-11.0 required=5.0 tests=BAYES_00, GIT_PATCH_0, KAM_DMARC_STATUS, KAM_LAZY_DOMAIN_SECURITY, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: newlib@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Newlib mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Oct 2020 03:15:51 -0000 This is a multi-part message in MIME format. --------------84A14617DDE5C11AD3E81324 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit It seems that ambiguous-wide behaviour (i.e. double-width property for characters in the East Asian Ambiguous width category) for CJK locales with UTF-8 encoding is inconsistent with Linux locale definitions. The attached patch changes that. Characters like ─ ü æ are no longer wide in the following locales: ja_JP.utf8 ko_KR.utf8 zh_*.utf8 but only in ja, ko, zh locales with legacy encoding. Explicit modifiers @cjkwide and @cjknarrow are not affected. Thomas --------------84A14617DDE5C11AD3E81324 Content-Type: text/plain; charset=UTF-8; name="0001-drop-ambiguous-wide-behaviour-from-Unicode-CJK-local.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename*0="0001-drop-ambiguous-wide-behaviour-from-Unicode-CJK-local.pa"; filename*1="tch" RnJvbSBhNWU2YzFkYWFmYmYwMDZkNDM5NGI0MDVhNjM5MmNhNjY5NmY4YzhjIE1vbiBTZXAg MTcgMDA6MDA6MDAgMjAwMQpGcm9tOiBUaG9tYXMgV29sZmYgPHRvd29AdG93by5uZXQ+CkRh dGU6IFdlZCwgNyBPY3QgMjAyMCAxODozNTo1NCArMDIwMApTdWJqZWN0OiBbUEFUQ0hdIGRy b3AgYW1iaWd1b3VzLXdpZGUgYmVoYXZpb3VyIGZyb20gVW5pY29kZSBDSksgbG9jYWxlcwoK LS0tCiBuZXdsaWIvbGliYy9sb2NhbGUvbG9jYWxlLmMgfCAxOCArKysrKy0tLS0tLS0tLS0t LS0KIDEgZmlsZSBjaGFuZ2VkLCA1IGluc2VydGlvbnMoKyksIDEzIGRlbGV0aW9ucygtKQoK ZGlmZiAtLWdpdCBhL25ld2xpYi9saWJjL2xvY2FsZS9sb2NhbGUuYyBiL25ld2xpYi9saWJj L2xvY2FsZS9sb2NhbGUuYwppbmRleCAyYzQ1MmJhOTguLjk2ODY0Mjc0NSAxMDA2NDQKLS0t IGEvbmV3bGliL2xpYmMvbG9jYWxlL2xvY2FsZS5jCisrKyBiL25ld2xpYi9saWJjL2xvY2Fs ZS9sb2NhbGUuYwpAQCAtNzgsMTIgKzc4LDkgQEAgVGhpcyBpbXBsZW1lbnRhdGlvbiBhbHNv IHN1cHBvcnRzIHRoZSBtb2RpZmllcnMgPDwiY2prbmFycm93Ij4+IGFuZAogPDwiY2prd2lk ZSI+Piwgd2hpY2ggYWZmZWN0IGhvdyB0aGUgZnVuY3Rpb25zIDw8d2N3aWR0aD4+IGFuZCA8 PHdjc3dpZHRoPj4KIGhhbmRsZSBjaGFyYWN0ZXJzIGZyb20gdGhlICJDSksgQW1iaWd1b3Vz IFdpZHRoIiBjYXRlZ29yeSBvZiBjaGFyYWN0ZXJzCiBkZXNjcmliZWQgYXQgaHR0cDovL3d3 dy51bmljb2RlLm9yZy9yZXBvcnRzL3RyMTEvI0FtYmlndW91cy4KLVRoZXNlIGNoYXJhY3Rl cnMgaGF2ZSBhIHdpZHRoIG9mIDEgZm9yIHNpbmdsZWJ5dGUgY2hhcnNldHMgYW5kIGEgd2lk dGggb2YgMgotZm9yIG11bHRpYnl0ZSBjaGFyc2V0cyBvdGhlciB0aGFuIFVURi04LgotRm9y IFVURi04LCB0aGVpciB3aWR0aCBkZXBlbmRzIG9uIHRoZSBsYW5ndWFnZSBzcGVjaWZpZXI6 Ci1pdCBpcyAyIGZvciA8PCJ6aCI+PiAoQ2hpbmVzZSksIDw8ImphIj4+IChKYXBhbmVzZSks IGFuZCA8PCJrbyI+PiAoS29yZWFuKSwKLWFuZCAxIGZvciBldmVyeXRoaW5nIGVsc2UuIFNw ZWNpZnlpbmcgPDwiY2prbmFycm93Ij4+IG9yIDw8ImNqa3dpZGUiPj4KLWZvcmNlcyBhIHdp ZHRoIG9mIDEgb3IgMiwgcmVzcGVjdGl2ZWx5LCBpbmRlcGVuZGVudCBvZiBjaGFyc2V0IGFu ZCBsYW5ndWFnZS4KK1RoZXNlIGNoYXJhY3RlcnMgaGF2ZSBhIHdpZHRoIG9mIDEgZm9yIHNp bmdsZWJ5dGUgY2hhcnNldHMgYW5kIFVURi04LAorYW5kIGEgd2lkdGggb2YgMiBmb3IgbXVs dGlieXRlIGNoYXJzZXRzIG90aGVyIHRoYW4gVVRGLTguIFNwZWNpZnlpbmcKKzw8ImNqa25h cnJvdyI+PiBvciA8PCJjamt3aWRlIj4+IGZvcmNlcyBhIHdpZHRoIG9mIDEgb3IgMiwgcmVz cGVjdGl2ZWx5LgogCiBUaGlzIGltcGxlbWVudGF0aW9uIGFsc28gc3VwcG9ydHMgdGhlIG1v ZGlmaWVyIDw8ImNqa3NpbmdsZSI+PgogdG8gZW5mb3JjZSBzaW5nbGUtd2lkdGggY2hhcmFj dGVyIHByb3BlcnRpZXMuCkBAIC05MDMsMTcgKzkwMCwxMiBAQCByZXN0YXJ0OgogICAgICAg LyogRGV0ZXJtaW5lIHRoZSB3aWR0aCBmb3IgdGhlICJDSksgQW1iaWd1b3VzIFdpZHRoIiBj YXRlZ29yeSBvZgogICAgICAgICAgY2hhcmFjdGVycy4gVGhpcyBpcyB1c2VkIGluIHdjd2lk dGgoKS4gQXNzdW1lIHNpbmdsZSB3aWR0aCBmb3IKICAgICAgICAgIHNpbmdsZS1ieXRlIGNo YXJzZXRzLCBhbmQgZG91YmxlIHdpZHRoIGZvciBtdWx0aS1ieXRlIGNoYXJzZXRzCi0gICAg ICAgICBvdGhlciB0aGFuIFVURi04LiBGb3IgVVRGLTgsIHVzZSBkb3VibGUgd2lkdGggZm9y IHRoZSBFYXN0IEFzaWFuCi0gICAgICAgICBsYW5ndWFnZXMgKCJqYSIsICJrbyIsICJ6aCIp LCBhbmQgc2luZ2xlIHdpZHRoIGZvciBldmVyeXRoaW5nIGVsc2UuCisgICAgICAgICBvdGhl ciB0aGFuIFVURi04LiBGb3IgVVRGLTgsIHVzZSBzaW5nbGUgd2lkdGguCiAgICAgICAgICBT aW5nbGUgd2lkdGggY2FuIGFsc28gYmUgZm9yY2VkIHdpdGggdGhlICJAY2prbmFycm93IiBt b2RpZmllci4KICAgICAgICAgIERvdWJsZSB3aWR0aCBjYW4gYWxzbyBiZSBmb3JjZWQgd2l0 aCB0aGUgIkBjamt3aWRlIiBtb2RpZmllci4KICAgICAgICAqLwogICAgICAgbG9jLT5jamtf bGFuZyA9IGNqa3dpZGUgfHwKLQkJICAgICAgKCFjamtuYXJyb3cgJiYgbWJjX21heCA+IDEK LQkJICAgICAgICYmIChjaGFyc2V0WzBdICE9ICdVJwotCQkJICAgfHwgc3RybmNtcCAobG9j YWxlLCAiamEiLCAyKSA9PSAwCi0JCQkgICB8fCBzdHJuY21wIChsb2NhbGUsICJrbyIsIDIp ID09IDAKLQkJCSAgIHx8IHN0cm5jbXAgKGxvY2FsZSwgInpoIiwgMikgPT0gMCkpOworCQkg ICAgICAoIWNqa25hcnJvdyAmJiBtYmNfbWF4ID4gMSAmJiBjaGFyc2V0WzBdICE9ICdVJyk7 CiAgICAgICBpZiAoY2prc2luZ2xlKQogCWxvYy0+Y2prX2xhbmcgPSAtMTsJLyogRGlzYWJs ZSBDSksgZHVhbC13aWR0aCAqLwogI2lmZGVmIF9fSEFWRV9MT0NBTEVfSU5GT19fCi0tIAoy LjI4LjAKCg== --------------84A14617DDE5C11AD3E81324--