* Re: [1.7] makeinfo : too many open files
@ 2009-03-27 1:31 Marco Atzeri
2009-03-27 13:15 ` Corinna Vinschen
0 siblings, 1 reply; 9+ messages in thread
From: Marco Atzeri @ 2009-03-27 1:31 UTC (permalink / raw)
To: cygwin
--- Gio 26/3/09, Corinna Vinschen ha scritto:
> Da: Corinna Vinschen
> Oggetto: Re: [1.7] makeinfo : too many open files
> A: cygwin
> Data: Giovedì 26 marzo 2009, 16:23
>
> -----Segue allegato-----
>
> On Mar 26 12:36, Marco Atzeri
> wrote:
> >
> > Dear All,
> > building the documentation for octave with makeinfo
> > I hit on cygwin-1.7 a similar issue than
> > http://cygwin.com/ml/cygwin/2009-02/msg00564.html
> >
> > On cygwin-1.5 the same exact command on the same
> files
> > completes successfully.
> >
> > Full strace is uploaded on
> > http://matzeri.altervista.org/strace/
> >
> > 1.6M makeinfo15_strace
> > 3.1M makeinfo17_strace
> > 270K makeinfo_strace.tar.xz (both
> compressed)
> >
> >
> > $makeinfo -I.. octave-a4.texi
> >
> > octave-a4.texi:621: @include `package.texi': No such
> file or directory.
> > octave-a4.texi:632: @include `dynamic.texi': No such
> file or directory.
> >
> >
> > $ makeinfo -P.. octave-a4.texi
> > octave-a4.texi:621: @include `package.texi': Too many
> open files.
> > octave-a4.texi:632: @include `dynamic.texi': Too many
> open files
>
> The 1.7 strace shows a weird error message:
>
> seterrno_from_win_error:
> /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140
> windows error 487
>
> error 487 == "Attempt to access invalid address."
>
> It happens when trying to raise the size of the cygheap
> (used for
> internal datastructures like file descriptor data) which
> apparently
> occurs as a result of using so many files. The only
> reason I can think
> of why this might occur is a collision with a DLL loaded at
> an address
> not far from the end of Cygwin's cygheap, so that trying to
> VirtualAlloc
> more memory, to make the cygheap bigger, fails. The
> default size of the
> cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
>
> Maybe rebasing the DLLs makeinfo is linked against
> (cygiconv-2.dll,
> cygintl-8.dll) helps?
>
> If not, it might be helpful if you could send a link to a
> tar archive
> with all necessary input texi files to run makeinfo as
> above.
>
>
> Corinna
Hi Corinna,
rebase had no effect.
I packed the test case in
http://matzeri.altervista.org/strace/
as makeinfo_test.tar.xz
$ cd doc/interpreter
$ makeinfo -I.. octave.texi
Regards
Marco
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo : too many open files
2009-03-27 1:31 [1.7] makeinfo : too many open files Marco Atzeri
@ 2009-03-27 13:15 ` Corinna Vinschen
0 siblings, 0 replies; 9+ messages in thread
From: Corinna Vinschen @ 2009-03-27 13:15 UTC (permalink / raw)
To: cygwin
Hi Marco,
On Mar 26 22:09, Marco Atzeri wrote:
> Hi Corinna,
> rebase had no effect.
>
> I packed the test case in
> http://matzeri.altervista.org/strace/
> as makeinfo_test.tar.xz
>
>
> $ cd doc/interpreter
> $ makeinfo -I.. octave.texi
Thanks for your testcase.
I got the same problem in cygheap.cc as you saw. makeinfo was unable to
raise the internal Cygwin heap size. And it was no wonder, really,
because the cygheap had already been raised so much that it hit the
memory location of the next DLL in memory at some 0x67xxxxxx address.
This is *very* unlikely for the cygheap, unless...
What happens is that makeinfo calls pathconf(3) on all input files. At
one point I had to rewrite pathconf for 1.7 and while doing that I missed
to free memory I allocated for a temporary file handler structure. This
happens in every single call to pathconf(3). Ouch!
I fixed this bug in CVS. A new Cygwin 1.7 test release is due soon.
Thanks again for your report and the testcase,
Corinna
--
Corinna Vinschen Please, send mails regarding Cygwin to
Cygwin Project Co-Leader cygwin AT cygwin DOT com
Red Hat
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo : too many open files
@ 2009-03-26 21:40 Marco Atzeri
0 siblings, 0 replies; 9+ messages in thread
From: Marco Atzeri @ 2009-03-26 21:40 UTC (permalink / raw)
To: cygwin
--- Gio 26/3/09, Christopher Faylor ha scritto:
> Da: Christopher Faylor
> Oggetto: Re: [1.7] makeinfo : too many open files
> A: cygwin@cygwin.com
> Data: Giovedì 26 marzo 2009, 18:09
>
> -----Segue allegato-----
>
> On Thu, Mar 26, 2009 at 04:23:40PM
> +0100, Corinna Vinschen wrote:
> >On Mar 26 12:36, Marco Atzeri wrote:
> >>
> >> Dear All,
> >> building the documentation for octave with
> makeinfo
> >> I hit on cygwin-1.7 a similar issue than
> >> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
> >>
> >> On cygwin-1.5 the same exact command on the same
> files
> >> completes successfully.
> >>
> >> Full strace is uploaded on
> >> http://matzeri.altervista.org/strace/
> >>
> >> 1.6M makeinfo15_strace
> >> 3.1M makeinfo17_strace
> >> 270K makeinfo_strace.tar.xz (both
> compressed)
> >>
> >>
> >> $makeinfo -I.. octave-a4.texi
> >>
> >> octave-a4.texi:621: @include `package.texi': No
> such file or directory.
> >> octave-a4.texi:632: @include `dynamic.texi': No
> such file or directory.
> >>
> >>
> >> $ makeinfo -P.. octave-a4.texi
> >> octave-a4.texi:621: @include `package.texi': Too
> many open files.
> >> octave-a4.texi:632: @include `dynamic.texi': Too
> many open files
> >
> >The 1.7 strace shows a weird error message:
> >
> > seterrno_from_win_error:
> /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140
> windows error 487
> >
> >error 487 == "Attempt to access invalid address."
> >
> >It happens when trying to raise the size of the cygheap
> (used for
> >internal datastructures like file descriptor data)
> which apparently
> >occurs as a result of using so many files. The
> only reason I can think
> >of why this might occur is a collision with a DLL
> loaded at an address
> >not far from the end of Cygwin's cygheap, so that
> trying to VirtualAlloc
> >more memory, to make the cygheap bigger, fails.
> The default size of the
> >cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
> >
> >Maybe rebasing the DLLs makeinfo is linked against
> (cygiconv-2.dll,
> >cygintl-8.dll) helps?
> >
> >If not, it might be helpful if you could send a link to
> a tar archive
> >with all necessary input texi files to run makeinfo as
> above.
>
> ldd /bin/makeinfo.exe
>
> might also be useful.
>
> cgf
>
$ ldd /usr/bin/makeinfo.exe
ntdll.dll => /cygdrive/c/WINDOWS/system32/ntdll.dll (0x7c900000)
kernel32.dll => /cygdrive/c/WINDOWS/system32/kernel32.dll (0x7c800000)
cygwin1.dll => /usr/bin/cygwin1.dll (0x61000000)
ADVAPI32.DLL => /cygdrive/c/WINDOWS/system32/ADVAPI32.DLL (0x77dd0000)
RPCRT4.dll => /cygdrive/c/WINDOWS/system32/RPCRT4.dll (0x77e70000)
cygintl-8.dll => /usr/bin/cygintl-8.dll (0x6f5c0000)
cygiconv-2.dll => /usr/bin/cygiconv-2.dll (0x674c0000)
and exactly the same for cygwin-1.5
Regards
Marco
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo : too many open files
2009-03-26 16:01 ` Corinna Vinschen
@ 2009-03-26 17:56 ` Christopher Faylor
0 siblings, 0 replies; 9+ messages in thread
From: Christopher Faylor @ 2009-03-26 17:56 UTC (permalink / raw)
To: cygwin
On Thu, Mar 26, 2009 at 04:23:40PM +0100, Corinna Vinschen wrote:
>On Mar 26 12:36, Marco Atzeri wrote:
>>
>> Dear All,
>> building the documentation for octave with makeinfo
>> I hit on cygwin-1.7 a similar issue than
>> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
>>
>> On cygwin-1.5 the same exact command on the same files
>> completes successfully.
>>
>> Full strace is uploaded on
>> http://matzeri.altervista.org/strace/
>>
>> 1.6M makeinfo15_strace
>> 3.1M makeinfo17_strace
>> 270K makeinfo_strace.tar.xz (both compressed)
>>
>>
>> $makeinfo -I.. octave-a4.texi
>>
>> octave-a4.texi:621: @include `package.texi': No such file or directory.
>> octave-a4.texi:632: @include `dynamic.texi': No such file or directory.
>>
>>
>> $ makeinfo -P.. octave-a4.texi
>> octave-a4.texi:621: @include `package.texi': Too many open files.
>> octave-a4.texi:632: @include `dynamic.texi': Too many open files
>
>The 1.7 strace shows a weird error message:
>
> seterrno_from_win_error: /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140 windows error 487
>
>error 487 == "Attempt to access invalid address."
>
>It happens when trying to raise the size of the cygheap (used for
>internal datastructures like file descriptor data) which apparently
>occurs as a result of using so many files. The only reason I can think
>of why this might occur is a collision with a DLL loaded at an address
>not far from the end of Cygwin's cygheap, so that trying to VirtualAlloc
>more memory, to make the cygheap bigger, fails. The default size of the
>cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
>
>Maybe rebasing the DLLs makeinfo is linked against (cygiconv-2.dll,
>cygintl-8.dll) helps?
>
>If not, it might be helpful if you could send a link to a tar archive
>with all necessary input texi files to run makeinfo as above.
ldd /bin/makeinfo.exe
might also be useful.
cgf
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo : too many open files
2009-03-26 15:23 Marco Atzeri
@ 2009-03-26 16:01 ` Corinna Vinschen
2009-03-26 17:56 ` Christopher Faylor
0 siblings, 1 reply; 9+ messages in thread
From: Corinna Vinschen @ 2009-03-26 16:01 UTC (permalink / raw)
To: cygwin
On Mar 26 12:36, Marco Atzeri wrote:
>
> Dear All,
> building the documentation for octave with makeinfo
> I hit on cygwin-1.7 a similar issue than
> http://cygwin.com/ml/cygwin/2009-02/msg00564.html
>
> On cygwin-1.5 the same exact command on the same files
> completes successfully.
>
> Full strace is uploaded on
> http://matzeri.altervista.org/strace/
>
> 1.6M makeinfo15_strace
> 3.1M makeinfo17_strace
> 270K makeinfo_strace.tar.xz (both compressed)
>
>
> $makeinfo -I.. octave-a4.texi
>
> octave-a4.texi:621: @include `package.texi': No such file or directory.
> octave-a4.texi:632: @include `dynamic.texi': No such file or directory.
>
>
> $ makeinfo -P.. octave-a4.texi
> octave-a4.texi:621: @include `package.texi': Too many open files.
> octave-a4.texi:632: @include `dynamic.texi': Too many open files
The 1.7 strace shows a weird error message:
seterrno_from_win_error: /ext/build/netrel/src/cygwin-1.7.0-44/winsup/cygwin/cygheap.cc:140 windows error 487
error 487 == "Attempt to access invalid address."
It happens when trying to raise the size of the cygheap (used for
internal datastructures like file descriptor data) which apparently
occurs as a result of using so many files. The only reason I can think
of why this might occur is a collision with a DLL loaded at an address
not far from the end of Cygwin's cygheap, so that trying to VirtualAlloc
more memory, to make the cygheap bigger, fails. The default size of the
cygheap in 1.7.0-44 is ~900K and ends at 0x61300000.
Maybe rebasing the DLLs makeinfo is linked against (cygiconv-2.dll,
cygintl-8.dll) helps?
If not, it might be helpful if you could send a link to a tar archive
with all necessary input texi files to run makeinfo as above.
Corinna
--
Corinna Vinschen Please, send mails regarding Cygwin to
Cygwin Project Co-Leader cygwin AT cygwin DOT com
Red Hat
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* [1.7] makeinfo : too many open files
@ 2009-03-26 15:23 Marco Atzeri
2009-03-26 16:01 ` Corinna Vinschen
0 siblings, 1 reply; 9+ messages in thread
From: Marco Atzeri @ 2009-03-26 15:23 UTC (permalink / raw)
To: cygwin
Dear All,
building the documentation for octave with makeinfo
I hit on cygwin-1.7 a similar issue than
http://cygwin.com/ml/cygwin/2009-02/msg00564.html
On cygwin-1.5 the same exact command on the same files
completes successfully.
Full strace is uploaded on
http://matzeri.altervista.org/strace/
1.6M makeinfo15_strace
3.1M makeinfo17_strace
270K makeinfo_strace.tar.xz (both compressed)
$makeinfo -I.. octave-a4.texi
octave-a4.texi:621: @include `package.texi': No such file or directory.
octave-a4.texi:632: @include `dynamic.texi': No such file or directory.
$ makeinfo -P.. octave-a4.texi
octave-a4.texi:621: @include `package.texi': Too many open files.
octave-a4.texi:632: @include `dynamic.texi': Too many open files
Regards
Marco
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo: too many open files
2009-02-24 9:21 ` Corinna Vinschen
@ 2009-02-24 12:49 ` Eric Blake
0 siblings, 0 replies; 9+ messages in thread
From: Eric Blake @ 2009-02-24 12:49 UTC (permalink / raw)
To: cygwin
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
According to Corinna Vinschen on 2/24/2009 2:20 AM:
> On Feb 20 22:18, Charles Wilson wrote:
>> I ran into the following problem building libtool under cygwin-1.7
>> (makeinfo from texinfo-4.8a-1):
>>
>> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
>> @include `fdl.texi': Too many open files.
>>
>> When using the same version of makeinfo under cygwin-1.5, there are no
>> problems. I see that Eric asked about (the same?) problem over on
>> bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
>> problem, not a texinfo problem, to me...
>>
>> http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
>> Eric, did anything ever come of this?
Upstream could not reproduce it on Linux, and I haven't revisited the
issue since. The upstream analysis was that there was no fd leak, but
that says nothing about how many files are open at once.
>
> Any debugging efforts, maybe?
I guess an strace would be worthwhile, but haven't run one yet.
- --
Don't work too hard, make some time for fun as well!
Eric Blake ebb9@byu.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Public key at home.comcast.net/~ericblake/eblake.gpg
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAkmj7OAACgkQ84KuGfSFAYCIdQCgtAaAW8rAE/YeRwIeM3QXlfuu
9YcAniiKep77geG9P0ZFrcglH5mP2zXF
=zJVB
-----END PGP SIGNATURE-----
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* Re: [1.7] makeinfo: too many open files
2009-02-21 3:18 [1.7] makeinfo: " Charles Wilson
@ 2009-02-24 9:21 ` Corinna Vinschen
2009-02-24 12:49 ` Eric Blake
0 siblings, 1 reply; 9+ messages in thread
From: Corinna Vinschen @ 2009-02-24 9:21 UTC (permalink / raw)
To: cygwin
On Feb 20 22:18, Charles Wilson wrote:
> I ran into the following problem building libtool under cygwin-1.7
> (makeinfo from texinfo-4.8a-1):
>
> makeinfo -I doc -I
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc -o
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi
>
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:5485:
> @include `PLATFORMS': Too many open files.
> /usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
> @include `fdl.texi': Too many open files.
> makeinfo: Removing output file
> `/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info'
> due to errors; use --force to preserve.
>
> When using the same version of makeinfo under cygwin-1.5, there are no
> problems. I see that Eric asked about (the same?) problem over on
> bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
> problem, not a texinfo problem, to me...
>
> http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
> Eric, did anything ever come of this?
Any debugging efforts, maybe?
Corinna
--
Corinna Vinschen Please, send mails regarding Cygwin to
Cygwin Project Co-Leader cygwin AT cygwin DOT com
Red Hat
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
* [1.7] makeinfo: too many open files
@ 2009-02-21 3:18 Charles Wilson
2009-02-24 9:21 ` Corinna Vinschen
0 siblings, 1 reply; 9+ messages in thread
From: Charles Wilson @ 2009-02-21 3:18 UTC (permalink / raw)
To: cygwin
I ran into the following problem building libtool under cygwin-1.7
(makeinfo from texinfo-4.8a-1):
makeinfo -I doc -I
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc -o
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:5485:
@include `PLATFORMS': Too many open files.
/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.texi:6191:
@include `fdl.texi': Too many open files.
makeinfo: Removing output file
`/usr/src/packages/libtool/22/libtool-2.2.7a-10/src/libtool/doc/libtool.info'
due to errors; use --force to preserve.
When using the same version of makeinfo under cygwin-1.5, there are no
problems. I see that Eric asked about (the same?) problem over on
bug-texinfo, but I don't see any resolution. It looks like a cygwin-1.7
problem, not a texinfo problem, to me...
http://lists.gnu.org/archive/html/bug-texinfo/2009-01/msg00013.html
Eric, did anything ever come of this?
--
Chuck
--
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Problem reports: http://cygwin.com/problems.html
Documentation: http://cygwin.com/docs.html
FAQ: http://cygwin.com/faq/
^ permalink raw reply [flat|nested] 9+ messages in thread
end of thread, other threads:[~2009-03-27 12:00 UTC | newest]
Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-03-27 1:31 [1.7] makeinfo : too many open files Marco Atzeri
2009-03-27 13:15 ` Corinna Vinschen
-- strict thread matches above, loose matches on Subject: below --
2009-03-26 21:40 Marco Atzeri
2009-03-26 15:23 Marco Atzeri
2009-03-26 16:01 ` Corinna Vinschen
2009-03-26 17:56 ` Christopher Faylor
2009-02-21 3:18 [1.7] makeinfo: " Charles Wilson
2009-02-24 9:21 ` Corinna Vinschen
2009-02-24 12:49 ` Eric Blake
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).