[Bug regex/9697] New: character does not match neither [a-z] nor [^a-z]

[Bug regex/9697] New: character does not match neither [a-z] nor [^a-z]

[bonzini at gnu dot org]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain, Size: 916 bytes --]

(This is Debian bug 510219).

For instance, take U+02E2 MODIFIER LETTER SMALL S:

$ echo ˢ | sed -r 's/[a-z]|[^a-z]//'
ˢ

Expected output: nothing.

Sed does not handle “ˢ” (U02E2) as a letter (in [a-z]) nor as a
“non-letter” (in [^a-z]).

I will analyze this soonish.

-- 
           Summary: character does not match neither [a-z] nor [^a-z]
           Product: glibc
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: regex
        AssignedTo: drepper at redhat dot com
        ReportedBy: bonzini at gnu dot org
                CC: glibc-bugs-regex at sources dot redhat dot com,glibc-
                    bugs at sources dot redhat dot com


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[bonzini at gnu dot org]

------- Additional Comments From bonzini at gnu dot org  2008-12-31 13:06 -------
Probably related to fastmap: 

~$ sed 's/a[^a-z]/ax/g' <<< a&#730;b    # correct
axb
~$ sed 's/[^a-z]/x/g' <<< a&#730;b    # wrong
a&#730;b

-- 


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[bonzini at gnu dot org]

------- Additional Comments From bonzini at gnu dot org  2008-12-31 15:34 -------
Created an attachment (id=3629)
 --> (http://sourceware.org/bugzilla/attachment.cgi?id=3629&action=view)
tentative untested patch

The problem is basically that __btowc cannot distinguish the beginning of a
valid multibyte character from an invalid sequence.

But it is possible to make the fastmap even better, and that's what the
attached patch tries to do.

-- 


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[bonzini at gnu dot org]

------- Additional Comments From bonzini at gnu dot org  2009-01-03 15:08 -------
Created an attachment (id=3634)
 --> (http://sourceware.org/bugzilla/attachment.cgi?id=3634&action=view)
working patch


Here is the logic I used:

- for [^...], [[:class:]], [[=elem=] try at every position that starts
a multibyte character.	The correct singlebyte character positions are
chosen by the corresponding SIMPLE_BRACKET.

- for [[.elem.]] and ranges, try at every position that might start a
multibyte collation element.  Again, singlebyte collation elements are
taken care of by SIMPLE_BRACKETs.

- unless the second bullet is used, of course, multibyte characters
must be added separately to the fastmap.

Tested on i686-pc-linux-gnu together with the other patch I sent on
2008-12-31, and on which this depends.	Ok?


-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
Attachment #3629 is|0                           |1
           obsolete|                            |
         AssignedTo|drepper at redhat dot com   |bonzini at gnu dot org
             Status|NEW                         |ASSIGNED


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[bonzini at gnu dot org]

-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
   Attachment #3634|2009-01-03-Paolo-Bonzini-   |fix-9697.patch
           filename|bonzini-gnu.org.patch       |


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[drepper at redhat dot com]

------- Additional Comments From drepper at redhat dot com  2009-01-08 00:43 -------
Patch is in cvs.

-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|ASSIGNED                    |RESOLVED
         Resolution|                            |FIXED


http://sourceware.org/bugzilla/show_bug.cgi?id=9697

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug regex/9697] character does not match neither [a-z] nor [^a-z]

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=9697

Florian Weimer <fweimer at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
              Flags|                            |security-

-- 
You are receiving this mail because:
You are on the CC list for the bug.