[Bug localedata/16052] New: Provide European ordering rules (EOR / EN 13710) for locales

[Bug localedata/16052] New: Provide European ordering rules (EOR / EN 13710) for locales

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

            Bug ID: 16052
           Summary: Provide European ordering rules (EOR / EN 13710) for
                    locales
           Product: glibc
           Version: 2.18
            Status: NEW
          Severity: normal
          Priority: P2
         Component: localedata
          Assignee: unassigned at sourceware dot org
          Reporter: myllynen at redhat dot com
                CC: libc-locales at sourceware dot org

From http://en.wikipedia.org/wiki/European_ordering_rules:

The European ordering rules (EOR / EN 13710) define an ordering for strings
written in languages that use the Latin, Greek and Cyrillic alphabets. The
standard covers languages used in Europe (i.e., the European Union, the
European Free Trade Association, and parts of the former Soviet Union). It is a
tailoring of the Common Tailorable Template of ISO/IEC 14651. EOR can [and in
most cases should] in turn be tailored for different (European) languages as
the primary language. But in inter-European multilingual contexts, EOR can be
used without further tailoring.

In some countries/languages, like Finland/Finnish, the new national
recommendation is based on EN 13710. If EN 13710 would be available, the new
Finnish sorting standard could be easily implemented by providing the national
delta defined in SFS-EN 13710.

Please consider providing EN 13710 ordering rules to allow implementation of
new national standards based on it.

Thanks.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[myllynen at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

--- Comment #3 from Marko Myllynen <myllynen at redhat dot com> ---
(In reply to joseph@codesourcery.com from comment #1)
> Note that the ISO 14651 data in glibc is extremely out of date; see bug 
> 14095.  I don't know whether that would affect this issue - whether it 
> would be necessary to update the ISO 14651 data first, understanding 
> exactly how it relates to (an old version of) ISO 14651 in the process.  

Thanks for pointing this out. I have a copy of the SFS-EN 13710 standard (which
I am, unfortunately, not allowed to distribute publicly) which contains also
the EN 13710 text and it states the following:

"
4 Conformance

In order to be conformant to this European Standard an application shall meet
the requirements prescribed in ISO/IEC 14651:2007, Clause 6 and its Common
Template Table ISO14651_2006_TABLE1 after the application of the EOR delta
table specified in Clause 6 of this European Standard. An equivalent
description of the resulting tailored table shall equally conform to this
European Standard.
"

and then goes on to define the EOR delta:

"
6 EOR Delta Table

NOTE For the syntax of the table please consult ISO/IEC 14651.

%% EOR's EORDeltaTable
%
%% European Ordering Rules.
%
% EOR delta for MES-3 from ISO/IEC 14651:2007's CTT
(ISO14651_2006_TABLE1_en.txt).
...
"

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[joseph at codesourcery dot com]

http://sourceware.org/bugzilla/show_bug.cgi?id=16052

--- Comment #1 from joseph at codesourcery dot com <joseph at codesourcery dot com> ---
Note that the ISO 14651 data in glibc is extremely out of date; see bug 
14095.  I don't know whether that would affect this issue - whether it 
would be necessary to update the ISO 14651 data first, understanding 
exactly how it relates to (an old version of) ISO 14651 in the process.  
We certainly need someone willing to spend a substantial amount of time 
understanding collation issues and how we got to the current state.  (To a 
lesser extent, there are such issues for character map / LC_CTYPE 
information - see bug 14094 - both need substantial work to produce 
appropriate automation for easier future updates of this data while 
demonstrating that previous unautomated local changes aren't being 
inappropriately lost in the process.)

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[carlos at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Carlos O'Donell <carlos at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |carlos at redhat dot com

--- Comment #2 from Carlos O'Donell <carlos at redhat dot com> ---
(In reply to joseph@codesourcery.com from comment #1)
> Note that the ISO 14651 data in glibc is extremely out of date; see bug 
> 14095.  I don't know whether that would affect this issue - whether it 
> would be necessary to update the ISO 14651 data first, understanding 
> exactly how it relates to (an old version of) ISO 14651 in the process.  
> We certainly need someone willing to spend a substantial amount of time 
> understanding collation issues and how we got to the current state.  (To a 
> lesser extent, there are such issues for character map / LC_CTYPE 
> information - see bug 14094 - both need substantial work to produce 
> appropriate automation for easier future updates of this data while 
> demonstrating that previous unautomated local changes aren't being 
> inappropriately lost in the process.)

Agreed. I think this work should fall on the shoulders of the distribution
maintainers. At some point I will be doing some work here, but my first goal is
to fix the state of getaddrinfo against the various RFCs.

-- 
You are receiving this mail because:
You are on the CC list for the bug.

Re: [Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[Keld Simonsen]

On Tue, Oct 15, 2013 at 03:23:48PM +0000, carlos at redhat dot com wrote:
> https://sourceware.org/bugzilla/show_bug.cgi?id=16052
> 
> Carlos O'Donell <carlos at redhat dot com> changed:
> 
>            What    |Removed                     |Added
> ----------------------------------------------------------------------------
>                  CC|                            |carlos at redhat dot com
> 
> --- Comment #2 from Carlos O'Donell <carlos at redhat dot com> ---
> (In reply to joseph@codesourcery.com from comment #1)
> > Note that the ISO 14651 data in glibc is extremely out of date; see bug 
> > 14095.  I don't know whether that would affect this issue - whether it 
> > would be necessary to update the ISO 14651 data first, understanding 
> > exactly how it relates to (an old version of) ISO 14651 in the process.  
> > We certainly need someone willing to spend a substantial amount of time 
> > understanding collation issues and how we got to the current state.  (To a 
> > lesser extent, there are such issues for character map / LC_CTYPE 
> > information - see bug 14094 - both need substantial work to produce 
> > appropriate automation for easier future updates of this data while 
> > demonstrating that previous unautomated local changes aren't being 
> > inappropriately lost in the process.)
> 
> Agreed. I think this work should fall on the shoulders of the distribution
> maintainers. At some point I will be doing some work here, but my first goal is
> to fix the state of getaddrinfo against the various RFCs.

It is on my list that the 14651 list should be made compatible with glibc
(or the other way around). The editor of 14651 is aware of the problem.
But some things need to be accomplished before the 14651 editor and I 
undertake this work.

Best regards
Keld

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[fweimer at redhat dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Florian Weimer <fweimer at redhat dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
              Flags|                            |security-

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[maiku.fabian at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Mike FABIAN <maiku.fabian at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |maiku.fabian at gmail dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[pravin.d.s at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Pravin S <pravin.d.s at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |pravin.d.s at gmail dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[maiku.fabian at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Mike FABIAN <maiku.fabian at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Assignee|unassigned at sourceware dot org   |maiku.fabian at gmail dot com

-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[maiku.fabian at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052

Mike FABIAN <maiku.fabian at gmail dot com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Depends on|                            |14095


Referenced Bugs:

https://sourceware.org/bugzilla/show_bug.cgi?id=14095
[Bug 14095] Review / update collation data from Unicode / ISO 14651
-- 
You are receiving this mail because:
You are on the CC list for the bug.

[Bug localedata/16052] Provide European ordering rules (EOR / EN 13710) for locales

[maiku.fabian at gmail dot com]

https://sourceware.org/bugzilla/show_bug.cgi?id=16052
Bug 16052 depends on bug 14095, which changed state.

Bug 14095 Summary: Review / update collation data from Unicode / ISO 14651
https://sourceware.org/bugzilla/show_bug.cgi?id=14095

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |FIXED

-- 
You are receiving this mail because:
You are on the CC list for the bug.