From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk1-x732.google.com (mail-qk1-x732.google.com [IPv6:2607:f8b0:4864:20::732]) by sourceware.org (Postfix) with ESMTPS id 9957E3858020 for ; Sun, 4 Apr 2021 21:26:32 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 9957E3858020 Received: by mail-qk1-x732.google.com with SMTP id i9so9988062qka.2 for ; Sun, 04 Apr 2021 14:26:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=KBMF8CA0TFmIGa4dQHYi2YhbyZolcTDODH9xaxV9zpY=; b=uOEyWaOBrg5fTOsj0taPi3iD3OK+gBPHzDoousiAmJRaStV3u404LRZn1BUZlv8Qgw R9kizIDoeqfc6Wtz6YyP3I7fu9nf9aqRLSmdYnisfEciBoTxKOY/b+ATYKpVqSIQ/+Kn hHVhWOnIsg48Wpq5D3FMCl3mPvhyX7HVXpgA8jsUVhTS3mfsQytHTLnnFlGiDpTr82gT Ugdz7jm4NPoiBSO6zzD9YFuh8WhlXR7eeGpws8Kcw05sjyxo7qG3EJM6Zhvzgea92h/A xnFgcUSYey6wI25y1Wv6ISktaLeb3BUsPtnttP/cLzEe81WBEGPJ9nuigYBQ4DdYMDIW TsPQ== X-Gm-Message-State: AOAM531LW76AI268abvlLdL49UqDDE0OZICw+cGppG0gfgyvMHFX0ulP VDpBW2YomEzFPPdImFkiXuilqkcrUVCXyfBz20T1Z7Br X-Google-Smtp-Source: ABdhPJzKsgPM5h6NpBQ7mZGnlmlTNRee036LFh6b3pVhPd5Hkr1EFi7xt76QLUaaCo7csA82n0pyZqM6p+9qies31q0= X-Received: by 2002:a37:392:: with SMTP id 140mr21652962qkd.236.1617571592233; Sun, 04 Apr 2021 14:26:32 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Joel Rees Date: Mon, 5 Apr 2021 06:26:18 +0900 Message-ID: Subject: Re: Perl Unidecode modules - which to use (if not Text::Unidecode)? To: cygwin@cygwin.com X-Spam-Status: No, score=-0.4 required=5.0 tests=BAYES_00, BODY_8BITS, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, HTML_MESSAGE, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: cygwin@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: General Cygwin discussions and problem reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Apr 2021 21:26:34 -0000 Erk. Sorry for the feint, Mark. CPAN is the perl way to get perl modules and such, but see below. 2021=E5=B9=B44=E6=9C=882=E6=97=A5(=E9=87=91) 5:38 Mark Aitchison : > I am writing perl programs that I'd like to know will work under both > Linux and Cygwin, > and have to deal with Unicode now. > > I had used Text::Unidecode happily in Linux but find no cygwin version. > Possibly I am not > looking in the right places for it, but possibly there are different > Unicode-related > modules that are well-supported under both cygwin and linux that I should > be using > instead, and I guess Unicode might be one of those things where it depend= s > on the > underlying o/s so it probably pays to go with whatever is the standard se= t > of modules. > > 1. What perl Unicode modules should I consider, if not Text::Unidecode? > The present need > is to be able to convert those few "foreign" characters (like > =C3=87=C4=86=C4=88=C4=8A=C3=A7=C4=89=C4=8B=C4=9C=C4=9E=C4=A0=C4=A2=C4=9D= =C4=A3=C4=9F=C4=A1=C3=8B=C3=8C=C3=8D=C3=8E=C3=8F=C3=92=C3=93=C3=94=C3=95) > that are basically ASCII with accent marks to their closest ASCII > equivalents, but I'd > like to do more with Unicode in the future, without going down any > dead-ends as far as > being able to run under cygwin is concerned. > "Stripping those few foreign accent characters" is probably not really what you want to do. Those "accent characters" are misinterpreted foreign encoding (likely not to be Unicode) characters. Simply "stripping" the "accent characters" will basically convert them to truly meaningless junk. I suppose the meaningless junk can then be interpreted by the reader as "used to be a be a foreign word here", but why bother contributing further to information entropy? 2. I see some talk of Internationalization in Chapter 2 of "Setting up > Cygwin", but > cannot see anything relating to perl modules, and I don't see any easy wa= y > to search many > months of the mailing list for a keyword... is there any information I > should know about? Have you read the perldoc on internationalization?