From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 18872 invoked by alias); 19 May 2004 19:58:01 -0000 Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm Precedence: bulk List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner@cygwin.com Mail-Followup-To: cygwin@cygwin.com Received: (qmail 18856 invoked from network); 19 May 2004 19:58:00 -0000 Received: from unknown (HELO e2.ny.us.ibm.com) (32.97.182.102) by sourceware.org with SMTP; 19 May 2004 19:58:00 -0000 Received: from northrelay04.pok.ibm.com (northrelay04.pok.ibm.com [9.56.224.206]) by e2.ny.us.ibm.com (8.12.10/8.12.2) with ESMTP id i4JJvxTW303328 for ; Wed, 19 May 2004 15:58:00 -0400 Received: from d25ml03.torolab.ibm.com (d01av02.pok.ibm.com [9.56.224.216]) by northrelay04.pok.ibm.com (8.12.10/NCO/VER6.6) with ESMTP id i4JJwZUn118938 for ; Wed, 19 May 2004 15:58:36 -0400 In-Reply-To: To: cygwin@cygwin.com MIME-Version: 1.0 Subject: Re: Anyone using bash shell in Japanese, Chinese, or Korean? From: Joe Wigglesworth Message-ID: Date: Wed, 19 May 2004 20:54:00 -0000 Content-Type: multipart/signed; protocol="application/x-pkcs7-signature"; micalg=sha1; boundary=-------z197_boundary_sign X-IsSubscribed: yes X-SW-Source: 2004-05/txt/msg00689.txt.bz2 ---------z197_boundary_sign Content-Type: text/plain; charset="US-ASCII" Content-length: 2391 Your observation, Igor, is correct. The 0x5C character is the backslash and that is at the root of the problem, especially in a command like ls. We haven't run across the problem with 0x2F, but that may just be a matter of time. If Cygwin applications are handling the multibyte characters as a sequence of bytes that would certainly be the root of the problem. Moving to multibyte-friendly Windows API calls would be a big step forward. Given the large number of Cygwin users in Japan, I'm surprised that hasn't already happened. It must be possible because I've been told that the bash shell that comes with the MKS Toolkit can handle Japanese characters correctly. -Joe FWIW, I think it might be more than a coincidence that 0x5c is the ASCII code for '\'. I suspect the same problem will occur for characters with 0x2f ('/') in the second byte (if there are any). The crux is that a lot of Cygwin applications don't have any handling of multibyte characters -- they simply process each string as a sequence of bytes. The problem appears when the multi-byte representation contains (accidentally) a character that's being treated specially (e.g., '/' or '\'). How much of this is due to the program looking at the string itself, and how much is due to using the wrong type of Windows API calls (that aren't multibyte-friendly), remains to be seen. It would be interesting to strace the "ls ." invocation to see whether it breaks somewhere inside "ls" or inside a Windows API call. Igor P.S. We all saw the (identical?) post from two days ago (), so there was no need to re-post this. -- http://cs.nyu.edu/~pechtcha/ |\ _,,,---,,_ pechtcha@cs.nyu.edu ZZZzz /,`.-'`' -. ;-;;,_ igor@watson.ibm.com |,4- ) )-,_. ,\ ( `'-' Igor Pechtchanski, Ph.D. '---''(_/--' `-'\_) fL a.k.a JaguaR-R-R-r-r-r-.-.-. Meow! "I have since come to realize that being between your mentor and his route to the bathroom is a major career booster." -- Patrick Naughton -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ---------z197_boundary_sign Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature Content-length: 7056 MIAGCSqGSIb3DQEHAqCAMIIUPAIBATELMAkGBSsOAwIaBQAwCwYJKoZIhvcN AQcBoIISXDCCAtowggJDoAMCAQICAwMUtjANBgkqhkiG9w0BAQQFADBOMQsw CQYDVQQGEwJVUzEQMA4GA1UEChMHRXF1aWZheDEtMCsGA1UECxMkRXF1aWZh eCBTZWN1cmUgQ2VydGlmaWNhdGUgQXV0aG9yaXR5MB4XDTAyMDExNDIyMDcx MVoXDTExMTIzMTIyMDcxMVowaTELMAkGA1UEBhMCVVMxNDAyBgNVBAoTK0lu dGVybmF0aW9uYWwgQnVzaW5lc3MgTWFjaGluZXMgQ29ycG9yYXRpb24xJDAi BgNVBAMTG0lCTSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTCBnzANBgkqhkiG 9w0BAQEFAAOBjQAwgYkCgYEA629xc49NpAPzcAsuShTImLRYMkyepDEkC1Ur PbsFRyAFZKsv3pw0MGfW/+7glzJKgPkPzlTZZfznznGbmAWVnNBQlyPasOtC jif603euRXReHcKfHMPLItKozibWIPHJuOnwNclOnnP2sKufuPzbTImQTTi5 c8JZNZcMJ0YFzTcCAwEAAaOBqjCBpzARBglghkgBhvhCAQEEBAMCAIcwDgYD VR0PAQH/BAQDAgHGMB0GA1UdDgQWBBSuVA6S6qgzqSskLcfIbzDc3vNKQDAf BgNVHSMEGDAWgBRI5mj5K9KylddH2CMgEE8zmJCf1DAPBgNVHRMBAf8EBTAD AQH/MDEGA1UdJQQqMCgGCCsGAQUFBwMBBggrBgEFBQcDAgYIKwYBBQUHAwMG CCsGAQUFBwMEMA0GCSqGSIb3DQEBBAUAA4GBADJye3NmC8q2PzypRZfu7JvD RDX1rRcanZvujQupk2oCScMd3FIHLE7hOfu8YffvxtLU3y8wNamQEORjTD17 5qAffryXypwtiVjBUKSDlBCQ14keMcF9ViNdewEoBGiAycUq8R3Lrlf4TCDv W4GeguNTFFZnS0ygYATiJk7iDyvEMIIC2jCCAkOgAwIBAgIDAxS2MA0GCSqG SIb3DQEBBAUAME4xCzAJBgNVBAYTAlVTMRAwDgYDVQQKEwdFcXVpZmF4MS0w KwYDVQQLEyRFcXVpZmF4IFNlY3VyZSBDZXJ0aWZpY2F0ZSBBdXRob3JpdHkw HhcNMDIwMTE0MjIwNzExWhcNMTExMjMxMjIwNzExWjBpMQswCQYDVQQGEwJV UzE0MDIGA1UEChMrSW50ZXJuYXRpb25hbCBCdXNpbmVzcyBNYWNoaW5lcyBD b3Jwb3JhdGlvbjEkMCIGA1UEAxMbSUJNIENlcnRpZmljYXRpb24gQXV0aG9y aXR5MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDrb3Fzj02kA/NwCy5K FMiYtFgyTJ6kMSQLVSs9uwVHIAVkqy/enDQwZ9b/7uCXMkqA+Q/OVNll/OfO cZuYBZWc0FCXI9qw60KOJ/rTd65FdF4dwp8cw8si0qjOJtYg8cm46fA1yU6e c/awq5+4/NtMiZBNOLlzwlk1lwwnRgXNNwIDAQABo4GqMIGnMBEGCWCGSAGG +EIBAQQEAwIAhzAOBgNVHQ8BAf8EBAMCAcYwHQYDVR0OBBYEFK5UDpLqqDOp KyQtx8hvMNze80pAMB8GA1UdIwQYMBaAFEjmaPkr0rKV10fYIyAQTzOYkJ/U MA8GA1UdEwEB/wQFMAMBAf8wMQYDVR0lBCowKAYIKwYBBQUHAwEGCCsGAQUF BwMCBggrBgEFBQcDAwYIKwYBBQUHAwQwDQYJKoZIhvcNAQEEBQADgYEAMnJ7 c2YLyrY/PKlFl+7sm8NENfWtFxqdm+6NC6mTagJJwx3cUgcsTuE5+7xh9+/G 0tTfLzA1qZAQ5GNMPXvmoB9+vJfKnC2JWMFQpIOUEJDXiR4xwX1WI117ASgE aIDJxSrxHcuuV/hMIO9bgZ6C41MUVmdLTKBgBOImTuIPK8QwggMgMIICiaAD AgECAgQ13vTPMA0GCSqGSIb3DQEBBQUAME4xCzAJBgNVBAYTAlVTMRAwDgYD VQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4IFNlY3VyZSBDZXJ0aWZp Y2F0ZSBBdXRob3JpdHkwHhcNOTgwODIyMTY0MTUxWhcNMTgwODIyMTY0MTUx WjBOMQswCQYDVQQGEwJVUzEQMA4GA1UEChMHRXF1aWZheDEtMCsGA1UECxMk RXF1aWZheCBTZWN1cmUgQ2VydGlmaWNhdGUgQXV0aG9yaXR5MIGfMA0GCSqG SIb3DQEBAQUAA4GNADCBiQKBgQDBXbFYZwhi7qCaLR8IbZEUaJgKHv7aBG8T hGIhw9F8zp8F4LgB8E407OKKlQRkrPFrU18Fs8tngL9CAo7+3QEJ7OEAFE/8 +/AM3UO6WyvhH4BwmRVXkxbxD5dqt8JoIxzMTVkwrFEeO68r1u5jRXvF2V9Q 0uNQDzqI578U/eDHuQIDAQABo4IBCTCCAQUwcAYDVR0fBGkwZzBloGOgYaRf MF0xCzAJBgNVBAYTAlVTMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRF cXVpZmF4IFNlY3VyZSBDZXJ0aWZpY2F0ZSBBdXRob3JpdHkxDTALBgNVBAMT BENSTDEwGgYDVR0QBBMwEYEPMjAxODA4MjIxNjQxNTFaMAsGA1UdDwQEAwIB BjAfBgNVHSMEGDAWgBRI5mj5K9KylddH2CMgEE8zmJCf1DAdBgNVHQ4EFgQU SOZo+SvSspXXR9gjIBBPM5iQn9QwDAYDVR0TBAUwAwEB/zAaBgkqhkiG9n0H QQAEDTALGwVWMy4wYwMCBsAwDQYJKoZIhvcNAQEFBQADgYEAWM4p6vz33rXO ArkXtYXRuePglcwlMQ0AppJuf7aSY55QldGab+QR3mOFbpjuqP9ayNNVsmZx V97AIes9KqcjSQEEhkJ7/O5/ohZStWdn00DbOyZYsih3Pa4Ud2HW+ipmJ6AN +qdzXOpw8ZQhZURf+vzvKWipood573nvT6wHdzgwggMgMIICiaADAgECAgQ1 3vTPMA0GCSqGSIb3DQEBBQUAME4xCzAJBgNVBAYTAlVTMRAwDgYDVQQKEwdF cXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4IFNlY3VyZSBDZXJ0aWZpY2F0ZSBB dXRob3JpdHkwHhcNOTgwODIyMTY0MTUxWhcNMTgwODIyMTY0MTUxWjBOMQsw CQYDVQQGEwJVUzEQMA4GA1UEChMHRXF1aWZheDEtMCsGA1UECxMkRXF1aWZh eCBTZWN1cmUgQ2VydGlmaWNhdGUgQXV0aG9yaXR5MIGfMA0GCSqGSIb3DQEB AQUAA4GNADCBiQKBgQDBXbFYZwhi7qCaLR8IbZEUaJgKHv7aBG8ThGIhw9F8 zp8F4LgB8E407OKKlQRkrPFrU18Fs8tngL9CAo7+3QEJ7OEAFE/8+/AM3UO6 WyvhH4BwmRVXkxbxD5dqt8JoIxzMTVkwrFEeO68r1u5jRXvF2V9Q0uNQDzqI 578U/eDHuQIDAQABo4IBCTCCAQUwcAYDVR0fBGkwZzBloGOgYaRfMF0xCzAJ BgNVBAYTAlVTMRAwDgYDVQQKEwdFcXVpZmF4MS0wKwYDVQQLEyRFcXVpZmF4 IFNlY3VyZSBDZXJ0aWZpY2F0ZSBBdXRob3JpdHkxDTALBgNVBAMTBENSTDEw GgYDVR0QBBMwEYEPMjAxODA4MjIxNjQxNTFaMAsGA1UdDwQEAwIBBjAfBgNV HSMEGDAWgBRI5mj5K9KylddH2CMgEE8zmJCf1DAdBgNVHQ4EFgQUSOZo+SvS spXXR9gjIBBPM5iQn9QwDAYDVR0TBAUwAwEB/zAaBgkqhkiG9n0HQQAEDTAL GwVWMy4wYwMCBsAwDQYJKoZIhvcNAQEFBQADgYEAWM4p6vz33rXOArkXtYXR uePglcwlMQ0AppJuf7aSY55QldGab+QR3mOFbpjuqP9ayNNVsmZxV97AIes9 KqcjSQEEhkJ7/O5/ohZStWdn00DbOyZYsih3Pa4Ud2HW+ipmJ6AN+qdzXOpw 8ZQhZURf+vzvKWipood573nvT6wHdzgwggMoMIICkaADAgECAgMBTekwDQYJ KoZIhvcNAQEEBQAwaTELMAkGA1UEBhMCVVMxNDAyBgNVBAoTK0ludGVybmF0 aW9uYWwgQnVzaW5lc3MgTWFjaGluZXMgQ29ycG9yYXRpb24xJDAiBgNVBAMT G0lCTSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAeFw0wNDAyMjAxNjE5NTZa Fw0wNTAzMDUxNjE5NTZaMIGHMQswCQYDVQQGEwJVUzEMMAoGA1UEChMDSUJN MREwDwYDVQQLEwhFTVBMT1lFRTEZMBcGA1UEAxMQSm9lIFdpZ2dsZXN3b3J0 aDEZMBcGCgmSJomT8ixkAQETCTAyNjY3MDY0OTEhMB8GCSqGSIb3DQEJARYS d2lnZ2xlc0BjYS5pYm0uY29tMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKB gQCR5oEQLCwrAc08GjSDEoLOA2pcfXLmDW/QcmJm6Bo+XCSM3mr8af8flod2 Cx0ZxJyBmUsKCO72VX2Vih7AkUZcfBJhgDPIHIYT8hip8X068Y8Bmyi3HL4P CG/zKhTKcn6NJ9E7FHmTWJtoJlJxjEyJW0By0NQ37NH6Y40iTbq3FwIDAQAB o4G+MIG7MBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYD VR0OBBYEFCiILHkSer0xO0QkakYebcLDV/MuMC0GA1UdEQQmMCSgIgYKKwYB BAGCNxQCA6AUDBJ3aWdnbGVzQGNhLmlibS5jb20wHwYDVR0jBBgwFoAUrlQO kuqoM6krJC3HyG8w3N7zSkAwJwYDVR0lBCAwHgYIKwYBBQUHAwIGCCsGAQUF BwMDBggrBgEFBQcDBDANBgkqhkiG9w0BAQQFAAOBgQAMtdGXkpZFPKwpcYP5 zFr2Q1p6/WHIsu8yiFrmzQFjBMmplhZ3RZq1ykwCgCzlKh/v9gZheLZxTQRW F1zJz4bBRFV3sBB0iClqp7Qy3HmJbw2YmD/0mja7EOd5YI4Wm0hk9vl+6aAU YTzn3+OOKvNSqIdCkJNWPHtA0QLtfE46jDCCAygwggKRoAMCAQICAwFN6TAN BgkqhkiG9w0BAQQFADBpMQswCQYDVQQGEwJVUzE0MDIGA1UEChMrSW50ZXJu YXRpb25hbCBCdXNpbmVzcyBNYWNoaW5lcyBDb3Jwb3JhdGlvbjEkMCIGA1UE AxMbSUJNIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MB4XDTA0MDIyMDE2MTk1 NloXDTA1MDMwNTE2MTk1NlowgYcxCzAJBgNVBAYTAlVTMQwwCgYDVQQKEwNJ Qk0xETAPBgNVBAsTCEVNUExPWUVFMRkwFwYDVQQDExBKb2UgV2lnZ2xlc3dv cnRoMRkwFwYKCZImiZPyLGQBARMJMDI2NjcwNjQ5MSEwHwYJKoZIhvcNAQkB FhJ3aWdnbGVzQGNhLmlibS5jb20wgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJ AoGBAJHmgRAsLCsBzTwaNIMSgs4Dalx9cuYNb9ByYmboGj5cJIzeavxp/x+W h3YLHRnEnIGZSwoI7vZVfZWKHsCRRlx8EmGAM8gchhPyGKnxfTrxjwGbKLcc vg8Ib/MqFMpyfo0n0TsUeZNYm2gmUnGMTIlbQHLQ1Dfs0fpjjSJNurcXAgMB AAGjgb4wgbswEQYJYIZIAYb4QgEBBAQDAgWgMA4GA1UdDwEB/wQEAwIF4DAd BgNVHQ4EFgQUKIgseRJ6vTE7RCRqRh5twsNX8y4wLQYDVR0RBCYwJKAiBgor BgEEAYI3FAIDoBQMEndpZ2dsZXNAY2EuaWJtLmNvbTAfBgNVHSMEGDAWgBSu VA6S6qgzqSskLcfIbzDc3vNKQDAnBgNVHSUEIDAeBggrBgEFBQcDAgYIKwYB BQUHAwMGCCsGAQUFBwMEMA0GCSqGSIb3DQEBBAUAA4GBAAy10ZeSlkU8rClx g/nMWvZDWnr9Yciy7zKIWubNAWMEyamWFndFmrXKTAKALOUqH+/2BmF4tnFN BFYXXMnPhsFEVXewEHSIKWqntDLceYlvDZiYP/SaNrsQ53lgjhabSGT2+X7p oBRhPOff444q81Koh0KQk1Y8e0DRAu18TjqMMYIBuzCCAbcCAQEwcDBpMQsw CQYDVQQGEwJVUzE0MDIGA1UEChMrSW50ZXJuYXRpb25hbCBCdXNpbmVzcyBN YWNoaW5lcyBDb3Jwb3JhdGlvbjEkMCIGA1UEAxMbSUJNIENlcnRpZmljYXRp b24gQXV0aG9yaXR5AgMBTekwCQYFKw4DAhoFAKCBojAYBgkqhkiG9w0BCQMx CwYJKoZIhvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0wNDA1MTkxOTU4NDFaMCMG CSqGSIb3DQEJBDEWBBRrxkS3Qa7PI7+blb7IeuTJAXUjJDBDBgkqhkiG9w0B CQ8xNjA0MAcGBSsOAwIdMA4GCCqGSIb3DQMCAgIAgDAKBggqhkiG9w0DBzAN BggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASBgEj+peQB5U3ItMe6lbfO qnrxOsfmmFdPcG9Y3luM4sRvupqQGkO8iTPAV/k+CzYwUW7f9niu7H/LowZZ NBI+7/nbM/0nETA4SQu8Y3BZJWLetbBnCh6P5gkzqeVg1m0/i+Zxlz+NFzqm ZvtwwofeRBehush2e4vcrRjeVuwVPG3cAAAAAA== ---------z197_boundary_sign--