[1.7] makeinfo: too many open files

[1.7] makeinfo: too many open files

[Charles Wilson]

I ran into the following problem building libtool under cygwin-1.7
(makeinfo from texinfo-4.8a-1):

makeinfo -I doc -I
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc -o
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi

/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:5485:
 @include `PLATFORMS': Too many open files.
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
 @include `fdl.texi': Too many open files.
makeinfo: Removing output file
`/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info'
due to errors; use --force to preserve.

When using the same version of makeinfo under cygwin-1.5, there are no
problems.  I see that Eric asked about (the same?) problem over on
bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
problem, not a texinfo problem, to me...

http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
Eric, did anything ever come of this?

--
Chuck

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo: too many open files

[Corinna Vinschen]

On Feb 20 22:18, Charles Wilson wrote:
> I ran into the following problem building libtool under cygwin-1.7
> (makeinfo from texinfo-4.8a-1):
> 
> makeinfo -I doc -I
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc -o
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi
> 
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:5485:
>  @include `PLATFORMS': Too many open files.
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
>  @include `fdl.texi': Too many open files.
> makeinfo: Removing output file
> `/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info'
> due to errors; use --force to preserve.
> 
> When using the same version of makeinfo under cygwin-1.5, there are no
> problems.  I see that Eric asked about (the same?) problem over on
> bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
> problem, not a texinfo problem, to me...
> 
> http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
> Eric, did anything ever come of this?

Any debugging efforts, maybe?


Corinna

-- 
Corinna Vinschen                  Please, send mails regarding Cygwin to
Cygwin Project Co-Leader          cygwin AT cygwin DOT com
Red Hat

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo: too many open files

[Eric Blake]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

According to Corinna Vinschen on 2/24/2009 2:20 AM:
> On Feb 20 22:18, Charles Wilson wrote:
>> I ran into the following problem building libtool under cygwin-1.7
>> (makeinfo from texinfo-4.8a-1):
>>
>> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
>>  @include `fdl.texi': Too many open files.
>>
>> When using the same version of makeinfo under cygwin-1.5, there are no
>> problems.  I see that Eric asked about (the same?) problem over on
>> bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
>> problem, not a texinfo problem, to me...
>>
>> http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
>> Eric, did anything ever come of this?

Upstream could not reproduce it on Linux, and I haven't revisited the
issue since.  The upstream analysis was that there was no fd leak, but
that says nothing about how many files are open at once.

> 
> Any debugging efforts, maybe?

I guess an strace would be worthwhile, but haven't run one yet.

- --
Don't work too hard, make some time for fun as well!

Eric Blake             ebb9@byu.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Public key at home.comcast.net/~ericblake/eblake.gpg
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkmj7OAACgkQ84KuGfSFAYCIdQCgtAaAW8rAE/YeRwIeM3QXlfuu
9YcAniiKep77geG9P0ZFrcglH5mP2zXF
=zJVB
-----END PGP SIGNATURE-----

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo : too many open files

[Corinna Vinschen]

Hi Marco,

On Mar 26 22:09, Marco Atzeri wrote:
> Hi Corinna,
> rebase had no effect. 
> 
> I packed the test case in
> http://matzeri.altervista.org/strace/
> as makeinfo_test.tar.xz
> 
> 
> $ cd doc/interpreter
> $ makeinfo -I.. octave.texi

Thanks for your testcase.

I got the same problem in cygheap.cc as you saw.  makeinfo was unable to
raise the internal Cygwin heap size.  And it was no wonder, really,
because the cygheap had already been raised so much that it hit the
memory location of the next DLL in memory at some 0x67xxxxxx address.
This is *very* unlikely for the cygheap, unless...

What happens is that makeinfo calls pathconf(3) on all input files.  At
one point I had to rewrite pathconf for 1.7 and while doing that I missed
to free memory I allocated for a temporary file handler structure.  This
happens in every single call to pathconf(3).  Ouch!

I fixed this bug in CVS.  A new Cygwin 1.7 test release is due soon.


Thanks again for your report and the testcase,
Corinna

-- 
Corinna Vinschen                  Please, send mails regarding Cygwin to
Cygwin Project Co-Leader          cygwin AT cygwin DOT com
Red Hat

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo : too many open files

[Marco Atzeri]

--- Gio 26/3/09, Corinna Vinschen  ha scritto:

> Da: Corinna Vinschen 
> Oggetto: Re: [1.7] makeinfo : too many open files
> A: cygwin
> Data: Giovedì 26 marzo 2009, 16:23
> 
> -----Segue allegato-----
> 
> On Mar 26 12:36, Marco Atzeri
> wrote:
> > 
> > Dear All,
> > building the documentation for octave with makeinfo
> > I hit on cygwin-1.7 a similar issue than
> > http://cygwin.com/ml/cygwin/2009-02/msg00564.html
> > 
> > On cygwin-1.5 the same exact command on the same
> files
> > completes successfully.
> > 
> > Full strace is uploaded on
> > http://matzeri.altervista.org/strace/
> > 
> > 1.6M   makeinfo15_strace
> > 3.1M   makeinfo17_strace
> > 270K   makeinfo_strace.tar.xz (both
> compressed)
> > 
> > 
> > $makeinfo -I.. octave-a4.texi
> > 
> > octave-a4.texi:621: @include `package.texi': No such
> file or directory.
> > octave-a4.texi:632: @include `dynamic.texi': No such
> file or directory.
> > 
> > 
> > $ makeinfo -P.. octave-a4.texi
> > octave-a4.texi:621: @include `package.texi': Too many
> open files.
> > octave-a4.texi:632: @include `dynamic.texi': Too many
> open files
> 
> The 1.7 strace shows a weird error message:
> 
>   seterrno_from_win_error:
> /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140
> windows error 487
> 
> error 487 == "Attempt to access invalid address."
> 
> It happens when trying to raise the size of the cygheap
> (used for
> internal datastructures like file descriptor data) which
> apparently
> occurs as a result of using so many files.  The only
> reason I can think
> of why this might occur is a collision with a DLL loaded at
> an address
> not far from the end of Cygwin's cygheap, so that trying to
> VirtualAlloc
> more memory, to make the cygheap bigger, fails.  The
> default size of the
> cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
> 
> Maybe rebasing the DLLs makeinfo is linked against
> (cygiconv-2.dll,
> cygintl-8.dll) helps?
> 
> If not, it might be helpful if you could send a link to a
> tar archive
> with all necessary input texi files to run makeinfo as
> above.
> 
> 
> Corinna

Hi Corinna,
rebase had no effect. 

I packed the test case in
http://matzeri.altervista.org/strace/
as makeinfo_test.tar.xz


$ cd doc/interpreter
$ makeinfo -I.. octave.texi

Regards
Marco





--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo : too many open files

[Marco Atzeri]

--- Gio 26/3/09, Christopher Faylor  ha scritto:

> Da: Christopher Faylor 
> Oggetto: Re: [1.7] makeinfo : too many open files
> A: cygwin@cygwin.com
> Data: Giovedì 26 marzo 2009, 18:09
> 
> -----Segue allegato-----
> 
> On Thu, Mar 26, 2009 at 04:23:40PM
> +0100, Corinna Vinschen wrote:
> >On Mar 26 12:36, Marco Atzeri wrote:
> >> 
> >> Dear All,
> >> building the documentation for octave with
> makeinfo
> >> I hit on cygwin-1.7 a similar issue than
> >> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
> >> 
> >> On cygwin-1.5 the same exact command on the same
> files
> >> completes successfully.
> >> 
> >> Full strace is uploaded on
> >> http://matzeri.altervista.org/strace/
> >> 
> >> 1.6M   makeinfo15_strace
> >> 3.1M   makeinfo17_strace
> >> 270K   makeinfo_strace.tar.xz (both
> compressed)
> >> 
> >> 
> >> $makeinfo -I.. octave-a4.texi
> >> 
> >> octave-a4.texi:621: @include `package.texi': No
> such file or directory.
> >> octave-a4.texi:632: @include `dynamic.texi': No
> such file or directory.
> >> 
> >> 
> >> $ makeinfo -P.. octave-a4.texi
> >> octave-a4.texi:621: @include `package.texi': Too
> many open files.
> >> octave-a4.texi:632: @include `dynamic.texi': Too
> many open files
> >
> >The 1.7 strace shows a weird error message:
> >
> >  seterrno_from_win_error:
> /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140
> windows error 487
> >
> >error 487 == "Attempt to access invalid address."
> >
> >It happens when trying to raise the size of the cygheap
> (used for
> >internal datastructures like file descriptor data)
> which apparently
> >occurs as a result of using so many files.  The
> only reason I can think
> >of why this might occur is a collision with a DLL
> loaded at an address
> >not far from the end of Cygwin's cygheap, so that
> trying to VirtualAlloc
> >more memory, to make the cygheap bigger, fails. 
> The default size of the
> >cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
> >
> >Maybe rebasing the DLLs makeinfo is linked against
> (cygiconv-2.dll,
> >cygintl-8.dll) helps?
> >
> >If not, it might be helpful if you could send a link to
> a tar archive
> >with all necessary input texi files to run makeinfo as
> above.
> 
> ldd /bin/makeinfo.exe
> 
> might also be useful.
> 
> cgf
> 

$ ldd /usr/bin/makeinfo.exe 
ntdll.dll => /cygdrive/c/WINDOWS/system32/ntdll.dll (0x7c900000)
kernel32.dll => /cygdrive/c/WINDOWS/system32/kernel32.dll (0x7c800000)
cygwin1.dll => /usr/bin/cygwin1.dll (0x61000000)
ADVAPI32.DLL => /cygdrive/c/WINDOWS/system32/ADVAPI32.DLL (0x77dd0000)
RPCRT4.dll => /cygdrive/c/WINDOWS/system32/RPCRT4.dll (0x77e70000)
cygintl-8.dll => /usr/bin/cygintl-8.dll (0x6f5c0000)
cygiconv-2.dll => /usr/bin/cygiconv-2.dll (0x674c0000)

and exactly the same for cygwin-1.5

Regards
Marco





--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo : too many open files

[Christopher Faylor]

On Thu, Mar 26, 2009 at 04:23:40PM +0100, Corinna Vinschen wrote:
>On Mar 26 12:36, Marco Atzeri wrote:
>> 
>> Dear All,
>> building the documentation for octave with makeinfo
>> I hit on cygwin-1.7 a similar issue than
>> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
>> 
>> On cygwin-1.5 the same exact command on the same files
>> completes successfully.
>> 
>> Full strace is uploaded on
>> http://matzeri.altervista.org/strace/
>> 
>> 1.6M   makeinfo15_strace
>> 3.1M   makeinfo17_strace
>> 270K   makeinfo_strace.tar.xz (both compressed)
>> 
>> 
>> $makeinfo -I.. octave-a4.texi
>> 
>> octave-a4.texi:621: @include `package.texi': No such file or directory.
>> octave-a4.texi:632: @include `dynamic.texi': No such file or directory.
>> 
>> 
>> $ makeinfo -P.. octave-a4.texi
>> octave-a4.texi:621: @include `package.texi': Too many open files.
>> octave-a4.texi:632: @include `dynamic.texi': Too many open files
>
>The 1.7 strace shows a weird error message:
>
>  seterrno_from_win_error: /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140 windows error 487
>
>error 487 == "Attempt to access invalid address."
>
>It happens when trying to raise the size of the cygheap (used for
>internal datastructures like file descriptor data) which apparently
>occurs as a result of using so many files.  The only reason I can think
>of why this might occur is a collision with a DLL loaded at an address
>not far from the end of Cygwin's cygheap, so that trying to VirtualAlloc
>more memory, to make the cygheap bigger, fails.  The default size of the
>cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
>
>Maybe rebasing the DLLs makeinfo is linked against (cygiconv-2.dll,
>cygintl-8.dll) helps?
>
>If not, it might be helpful if you could send a link to a tar archive
>with all necessary input texi files to run makeinfo as above.

ldd /bin/makeinfo.exe

might also be useful.

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] makeinfo : too many open files

[Corinna Vinschen]

On Mar 26 12:36, Marco Atzeri wrote:
> 
> Dear All,
> building the documentation for octave with makeinfo
> I hit on cygwin-1.7 a similar issue than
> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
> 
> On cygwin-1.5 the same exact command on the same files
> completes successfully.
> 
> Full strace is uploaded on
> http://matzeri.altervista.org/strace/
> 
> 1.6M   makeinfo15_strace
> 3.1M   makeinfo17_strace
> 270K   makeinfo_strace.tar.xz (both compressed)
> 
> 
> $makeinfo -I.. octave-a4.texi
> 
> octave-a4.texi:621: @include `package.texi': No such file or directory.
> octave-a4.texi:632: @include `dynamic.texi': No such file or directory.
> 
> 
> $ makeinfo -P.. octave-a4.texi
> octave-a4.texi:621: @include `package.texi': Too many open files.
> octave-a4.texi:632: @include `dynamic.texi': Too many open files

The 1.7 strace shows a weird error message:

  seterrno_from_win_error: /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140 windows error 487

error 487 == "Attempt to access invalid address."

It happens when trying to raise the size of the cygheap (used for
internal datastructures like file descriptor data) which apparently
occurs as a result of using so many files.  The only reason I can think
of why this might occur is a collision with a DLL loaded at an address
not far from the end of Cygwin's cygheap, so that trying to VirtualAlloc
more memory, to make the cygheap bigger, fails.  The default size of the
cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.

Maybe rebasing the DLLs makeinfo is linked against (cygiconv-2.dll,
cygintl-8.dll) helps?

If not, it might be helpful if you could send a link to a tar archive
with all necessary input texi files to run makeinfo as above.


Corinna

-- 
Corinna Vinschen                  Please, send mails regarding Cygwin to
Cygwin Project Co-Leader          cygwin AT cygwin DOT com
Red Hat

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

[1.7] makeinfo : too many open files

[Marco Atzeri]

Dear All,
building the documentation for octave with makeinfo
I hit on cygwin-1.7 a similar issue than
http://cygwin.com/ml/cygwin/2009-02/msg00564.html

On cygwin-1.5 the same exact command on the same files
completes successfully.

Full strace is uploaded on
http://matzeri.altervista.org/strace/

1.6M   makeinfo15_strace
3.1M   makeinfo17_strace
270K   makeinfo_strace.tar.xz (both compressed)


$makeinfo -I.. octave-a4.texi

octave-a4.texi:621: @include `package.texi': No such file or directory.
octave-a4.texi:632: @include `dynamic.texi': No such file or directory.


$ makeinfo -P.. octave-a4.texi
octave-a4.texi:621: @include `package.texi': Too many open files.
octave-a4.texi:632: @include `dynamic.texi': Too many open files


Regards
Marco


    

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/