From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by sourceware.org (Postfix) with ESMTP id 7BF98385803C for ; Fri, 30 Apr 2021 18:20:13 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 7BF98385803C Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-44-2zw-sac3M_uELHPNrESaHw-1; Fri, 30 Apr 2021 14:20:10 -0400 X-MC-Unique: 2zw-sac3M_uELHPNrESaHw-1 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 7BC18107ACC7 for ; Fri, 30 Apr 2021 18:20:09 +0000 (UTC) Received: from oldenburg.str.redhat.com (ovpn-115-124.ams2.redhat.com [10.36.115.124]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 72E915C232; Fri, 30 Apr 2021 18:20:04 +0000 (UTC) From: Florian Weimer To: Carlos O'Donell Cc: libc-alpha@sourceware.org Subject: Re: [PATCH v4 4/4] Add generic C.UTF-8 locale (Bug 17318) References: <20210428130033.3196848-1-carlos@redhat.com> <20210428130033.3196848-5-carlos@redhat.com> <87eeetfaan.fsf@oldenburg.str.redhat.com> <93ab3888-25db-4582-ce6a-c7a91ac14417@redhat.com> Date: Fri, 30 Apr 2021 20:20:17 +0200 In-Reply-To: (Carlos O'Donell's message of "Fri, 30 Apr 2021 13:59:49 -0400") Message-ID: <87a6pf4ota.fsf@oldenburg.str.redhat.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain X-Spam-Status: No, score=-6.5 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H4, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: libc-alpha@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Libc-alpha mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Apr 2021 18:20:14 -0000 * Carlos O'Donell: > On 4/29/21 4:05 PM, Carlos O'Donell wrote: >> - LC_CTYPE, includes "translit_combining" which is wrong for a C locale IMO. >> - Upstream C.UTF-8 includes no transliteration, all characters pass >> through because UTF-8 supports all such characters. > > It turns out that this is related to bug 26984. > > I was wrong too, the C locale has a builtin set of ~1600 transliterations that > it uses internally (I even reviewed a patch for that you committed). > I had completely forgotten about this internal detail. > > This transliteration affects converters ability to use //TRANSLIT, and so I > think we should include all the netural transliterations e.g. > > translit_start > include "translit_neutral";"" > translit_end > > This makes things *better* with respect to harmonization with Debian/Ubuntu. > > Thoughts? > > In summary: > - POSIX says nothing about transliteration. > - C/POSIX already includes a partial set of ~1600 translit entries, and they > are largely incomplete. It would be nice to harmonize them with the proper > translit_neutral set. > - C.UTF-8 including translit_neutral would bring in ~25,000 translit rules > for conversions from UTF-8 to other charmaps. This would be a superset of > those offered by C/POSIX. > - Fixing C/POSIX is another issue. I'm in favor of including those transliterations. Thanks, Florian