From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 94380 invoked by alias); 28 Jul 2017 19:58:37 -0000 Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner@cygwin.com Mail-Followup-To: cygwin@cygwin.com Received: (qmail 94361 invoked by uid 89); 28 Jul 2017 19:58:34 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-101.9 required=5.0 tests=AWL,BAYES_00,GOOD_FROM_CORINNA_CYGWIN,KAM_LAZY_DOMAIN_SECURITY,RCVD_IN_DNSWL_LOW,SPF_HELO_PASS autolearn=ham version=3.3.2 spammy=highly, H*c:application X-HELO: drew.franken.de Received: from mail-n.franken.de (HELO drew.franken.de) (193.175.24.27) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Fri, 28 Jul 2017 19:58:32 +0000 Received: from aqua.hirmke.de (aquarius.franken.de [193.175.24.89]) (Authenticated sender: aquarius) by mail-n.franken.de (Postfix) with ESMTPSA id 233E4721E2825 for ; Fri, 28 Jul 2017 21:58:28 +0200 (CEST) Received: from calimero.vinschen.de (calimero.vinschen.de [192.168.129.6]) by aqua.hirmke.de (Postfix) with ESMTP id ED03A5E046E for ; Fri, 28 Jul 2017 21:58:26 +0200 (CEST) Received: by calimero.vinschen.de (Postfix, from userid 500) id D6092A80458; Fri, 28 Jul 2017 21:58:26 +0200 (CEST) Date: Sat, 29 Jul 2017 15:23:00 -0000 From: Corinna Vinschen To: cygwin@cygwin.com Subject: Re: Unicode width data inconsistent/outdated Message-ID: <20170728195826.GI24013@calimero.vinschen.de> Reply-To: cygwin@cygwin.com Mail-Followup-To: cygwin@cygwin.com References: <20170726080859.GA24312@calimero.vinschen.de> <5d3cb047-49f8-26a6-d816-387a71486e99@cygwin.com> <20170726095016.GA25666@calimero.vinschen.de> <289bd98b-e644-888d-07f8-8965b6538373@towo.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="uAgJxtfIS94j9H4T" Content-Disposition: inline In-Reply-To: <289bd98b-e644-888d-07f8-8965b6538373@towo.net> User-Agent: Mutt/1.8.3 (2017-05-23) X-SW-Source: 2017-07/txt/msg00418.txt.bz2 --uAgJxtfIS94j9H4T Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-length: 1952 On Jul 26 23:43, Thomas Wolff wrote: > Am 26.07.2017 um 11:50 schrieb Corinna Vinschen: > > On Jul 26 03:16, Yaakov Selkowitz wrote: > > > On 2017-07-26 03:08, Corinna Vinschen wrote: > > > > On Jul 26 08:49, Thomas Wolff wrote: > > > > > It would be good to keep wcwidth/wcswidth in sync with the instal= led > > > > > Unicode data version (package unicode-ucd). > > > > > Currently it seems to be hard-coded (in newlib/libc/string/wcwidt= h.c); > > > > > it refers to Unicode 5.0 while installed Unicode data suggest 9.0= would > > > > > be used. > > > > > I can provide some scripts to generate the respective tables if d= esired. > > > > > Thomas > > > > If you can update the newlib files this way and send matching patch= es > > > > to the newlib list, this would be highly appreciated. > > > Thomas, I just updated unicode-ucd to 10.0 for this purpose. > Thanks. > >=20 > > Oh, and, btw, the comment in wcwidth.c isn't quite correct. The > > cwstate in newlib is on Unicode 5.2, see newlib/libc/ctype/towupper.c. > Oh, a number of other embedded tables. To make the tow* and isw* functions > more easily adaptable to Unicode updates, there will be some revisions to= do > here. And the to* and is* ones (without 'w') even refer to locales in a w= ay > I do not understand. Maybe I'll restrict my effort to wcwidth first... The to* and is* ones (without 'w') don't matter at all and you don't have to touch them. The Unicode stuff only affects the tow and isw functions. As for how to fetch the data, you may want to have a look into newlib/libc/ctype/utf8alpha.h and newlib/libc/ctype/utf8print.h. The header comments contain the awk scripts used to collect the data. All other isw* files like iswblank.c contain comments explaining what Unicode character categories are covered. Corinna --=20 Corinna Vinschen Please, send mails regarding Cygwin to Cygwin Maintainer cygwin AT cygwin DOT com Red Hat --uAgJxtfIS94j9H4T Content-Type: application/pgp-signature; name="signature.asc" Content-length: 819 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJZe5diAAoJEPU2Bp2uRE+gBZEP/iOUteETH9mpUB2Z+X4nAf2W 2kFw7SJkKj2SiMEZvFc05jHQqMgolFq0aw/guyP9lON8/nwEc6XzTOZCohQRojr8 Tqxof2+Bu2+bokWllY67yqsj3gMilNRrYARba3cMJBi2R1y4rmYbZv7xpmIdrpLY qGtyRngq3cY4jBv8IDeU3EEs+g609pTGCvy7BeC06jqFvWlY5WsS/FAjhZoBDVrp U0noUR4sm8iVuCQfPlDtJ2HTGgjsqo5bGQ1zgOo4hm2OLW/F5mADZFuOL718kLum chjJT+RaG9nD0uLnrvLnjGXLLZ7J7p29aLYuPLp5Pect47ojNjHJyVoo/ag6THYq d6LO0burPZ46nxKqfsc5c0h4mSdc4bZey7IAatIal1ZX/M7AJdQGydV4LIpU4HVx lyF6KWrwHSNjRUAEM3u5juspbeYt50z+9r+hIkYx4bD5nyJtxg1hawr/Qml9pU7L lWzemVviGqoIv16z+Wpkktl2B87bBfheYHlYlNM2ZDizRjrbYKiahXRY/L+0fHeF kokDs0BC5do/8RG04o/Iyj8a4E2cUvr26cXhS4KpR98R7e0KJKdiaEz0WhPTlW9F fo3rWJl0X4OsD+4JdlNxGl0xtMjA1eWLbs5NDWqi6zJFu6roIze20HLpt2ECoZEO SZ2PJB85E+RE/0unKl2+ =ZTde -----END PGP SIGNATURE----- --uAgJxtfIS94j9H4T--