[Bug nscd/1204] New: nscd cannot extend memory heap sizes

[Bug nscd/1204] New: nscd cannot extend memory heap sizes

[nick at sqrt dot co dot uk]

The change in nscd to use mmap for memory allocation of caches presents a
problem in that once the cache is full, mempool_alloc cannot extend the size of
the cache because 'mremap' will always fail.

   4279: no more memory for database 'group'

$ nscd -g shows:
         216064  total data pool size
         214664  used data pool size
              7  memory allocations failed

The problem is that for a system with large group memberships (i.e. several
thousand users), which are held in LDAP databases, as pool sizes cannot
increase, the result is poor performance, with commands such as a simple 'ls'
taking 10-20 seconds to complete.  The group lookup cannot be cached because
there is no further space to hold the data.

Certainly it is possible to work around this problem by increasing
'suggested-size' from say 211 to 10007, but clearly the 'mremap' is going to
fail in any case.

Can we not use malloc and realloc instead ?

-- 
           Summary: nscd cannot extend memory heap sizes
           Product: glibc
           Version: 2.3.5
            Status: NEW
          Severity: normal
          Priority: P2
         Component: nscd
        AssignedTo: drepper at redhat dot com
        ReportedBy: nick at sqrt dot co dot uk
                CC: glibc-bugs at sources dot redhat dot com
 GCC build triplet: i686-pc-linux-gnu
  GCC host triplet: i686-pc-linux-gnu
GCC target triplet: i686-pc-linux-gnu


http://sources.redhat.com/bugzilla/show_bug.cgi?id=1204

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug nscd/1204] nscd cannot extend memory heap sizes

[drepper at redhat dot com]

------- Additional Comments From drepper at redhat dot com  2005-08-24 01:16 -------
> Can we not use malloc and realloc instead ?

You don't understand the code *at all*.  Using malloc et al is of course
completely out of question since it would neither allow persistence nor sharing.

There was a problem with the mremap handling.  This is fixed in the current code.

-- 
           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|                            |FIXED


http://sources.redhat.com/bugzilla/show_bug.cgi?id=1204

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.

[Bug nscd/1204] nscd cannot extend memory heap sizes

[twb0 at lymenet dot org]

------- Additional Comments From twb0 at lymenet dot org  2006-05-03 05:57 -------
Note that this bug still appears to exist 8 months later in RHEL 4.2 with 'nscd'
2.3.4.

-- 


http://sourceware.org/bugzilla/show_bug.cgi?id=1204

------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.