[Bug libc/10392] New: iconv's CP932 doesn't recognize apparently valid input

[Bug libc/10392] New: iconv's CP932 doesn't recognize apparently valid input

[akihana at gmail dot com]

I'm running sys-libs/glibc-2.9_p20081201-r2 on Gento Linux.  I'm attempting to
use iconv to convert sjis/cp932 input into utf8 output.  However, some
apparently valid input is causing iconv to return EILSEQ.  It is worthwhile to
note that this content can be displayed by Firefox both on Linux and a Windows
Vista test box as well as in IE8.  It appears that there is some problem within
iconv, but there is no other charset that matches the input (as seen here):

http://www.gnu.org/software/libiconv/documentation/libiconv/iconv_open.3.html

-- 
           Summary: iconv's CP932 doesn't recognize apparently valid input
           Product: glibc
           Version: 2.9
            Status: NEW
          Severity: normal
          Priority: P2
         Component: libc
        AssignedTo: drepper at redhat dot com
        ReportedBy: akihana at gmail dot com
                CC: glibc-bugs at sources dot redhat dot com
 GCC build triplet: x86_64-pc-linux-gnu
  GCC host triplet: x86_64-pc-linux-gnu
GCC target triplet: x86_64-pc-linux-gnu


http://sourceware.org/bugzilla/show_bug.cgi?id=10392

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug libc/10392] iconv's CP932 doesn't recognize apparently valid input

[akihana at gmail dot com]

------- Additional Comments From akihana at gmail dot com  2009-07-15 08:08 -------
Created an attachment (id=4054)
 --> (http://sourceware.org/bugzilla/attachment.cgi?id=4054&action=view)
test case for failed input

Open this file in Firefox and manually set encoding to ShiftJIS.  Then run it
through iconv and notice that it fails.

-- 


http://sourceware.org/bugzilla/show_bug.cgi?id=10392

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug libc/10392] iconv's CP932 doesn't recognize apparently valid input

[akihana at gmail dot com]

------- Additional Comments From akihana at gmail dot com  2009-07-16 07:34 -------
It appears that the first 64 indices of row 81 are invalid:

http://web.mit.edu/shutkin/MacData_1124b/afs/sipb/project/dia/src/libunicode-0.4/msft/cp932.h

but then why does this character still render -- apparently correctly -- elsewhere?

-- 


http://sourceware.org/bugzilla/show_bug.cgi?id=10392

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug libc/10392] iconv's CP932 doesn't recognize apparently valid input

[drepper at redhat dot com]

------- Additional Comments From drepper at redhat dot com  2009-07-17 05:55 -------
What code positions do you mean?  When I read

   It appears that the first 64 indices of row 81 are invalid:

I hope you don't mean 0x81,0x00 to 0x81,0x3f.  These are of course invalid. 
Just look at

http://www.unicode.org/Public/MAPPINGS/VENDORS/MICSFT/WINDOWS/CP932.TXT

The tables is used to generate the tables.

-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |WAITING


http://sourceware.org/bugzilla/show_bug.cgi?id=10392

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug libc/10392] iconv's CP932 doesn't recognize apparently valid input

[drepper at redhat dot com]

------- Additional Comments From drepper at redhat dot com  2009-10-30 05:53 -------
No reply in more than 3 months.  Closing.

-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|WAITING                     |RESOLVED
         Resolution|                            |INVALID


http://sourceware.org/bugzilla/show_bug.cgi?id=10392

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug libc/10392] iconv's CP932 doesn't recognize apparently valid input

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=10392

Florian Weimer <fweimer at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
              Flags|                            |security-

-- 
You are receiving this mail because:
You are on the CC list for the bug.