Cygwin 1.7.17 breaks unattended setup

Cygwin 1.7.17 breaks unattended setup

[Stefan Rusek]

I have a script automates installing and setting up sshd using cygwin.
It first downloads the latest setup.exe then runs the following:

> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin
> c:\cygwin\bin\bash --login -c "/bin/mkpasswd | sed 's/Administrator:unused:500:513/root:unused:0:544/g' | sed 's/:513:/:545:/' > /etc/passwd"
> c:\cygwin\bin\bash --login -c "/bin/mkgroup -l > /etc/group"
> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin -P cygrunsrv
> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin -P openssh
> c:\cygwin\bin\bash.exe --login -c "/bin/ssh-host-config -y --pwd ***"
> sc.exe failure sshd reset=0 actions=restart/0/restart/0/restart/0
> net start sshd

This was working great last week, but on the 20th it stopped working.

It fails on the line installing cygrunsrv, if I run setup.exe in
interactive mode, I can install cygrunsrv just fine. Then the script
fails to install openssh in the same way. Again a manual install works
fine. I've tried different mirrors to no avail.

The contents of /var/log/setup.log.full https://gist.github.com/3945977

--Stefan Rusek
stefan@cheezburger.com

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Larry Hall (Cygwin)]

On 10/24/2012 9:16 AM, Stefan Rusek wrote:
> I have a script automates installing and setting up sshd using cygwin.
> It first downloads the latest setup.exe then runs the following:
>
>> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin
>> c:\cygwin\bin\bash --login -c "/bin/mkpasswd | sed 's/Administrator:unused:500:513/root:unused:0:544/g' | sed 's/:513:/:545:/' > /etc/passwd"
>> c:\cygwin\bin\bash --login -c "/bin/mkgroup -l > /etc/group"
>> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin -P cygrunsrv
>> setup.exe  -q -s ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/ --no-verify -R c:\cygwin -P openssh
>> c:\cygwin\bin\bash.exe --login -c "/bin/ssh-host-config -y --pwd ***"
>> sc.exe failure sshd reset=0 actions=restart/0/restart/0/restart/0
>> net start sshd
>
> This was working great last week, but on the 20th it stopped working.
>
> It fails on the line installing cygrunsrv, if I run setup.exe in
> interactive mode, I can install cygrunsrv just fine. Then the script
> fails to install openssh in the same way. Again a manual install works
> fine. I've tried different mirrors to no avail.
>
> The contents of /var/log/setup.log.full https://gist.github.com/3945977

Your problem is not with Cygwin 1.7.17.  That package wouldn't come into
play until the postinstall scripts.  Your log shows you don't get that
far.  And if it works interactively, then the problem is with 'setup.exe'
itself.  I can reproduce the problem but don't know why it's happening.
There hasn't been a new version of 'setup.exe' in quite a while so I can't
explain why you would just start seeing the problem within the last week.


--
Larry

_____________________________________________________________________

A: Yes.
 > Q: Are you sure?
 >> A: Because it reverses the logical flow of conversation.
 >>> Q: Why is top posting annoying in email?

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Larry Hall (Cygwin)]

On 10/25/2012 3:07 AM, Achim Gratz wrote:
> Larry Hall (Cygwin <reply-to-list-only-lh <at> cygwin.com> writes:
>>> As soon as I disable unattended mode (remove the --quiet-mode switch),
>>> if I just take all the default settings in the installer GUI and click
>>> the Next button a lot, the installation completes just fine.
>>
>> Which is why I said the problem is within 'setup.exe' itself.  Regardless
>> of whether some external input may be twiddling an internal bug, it's
>> still an internal bug.  And given the number of new packages within the
>> last week, the chance for one of those to be a contributing factor is
>> certainly much higher than for the cygwin package itself.  But we won't
>> know for sure what's at the heart of it until someone has a chance to
>> debug it.
>
> Setup.exe hasn't changed for a long time.  While that doesn't preclude a bug
> within setup.exe itself, I'd suggest looking at setup.ini first.  I'm absolutely
> relying on unattended setup and I haven't noticed any problems, much less
> recently.  However, I'm rewriting setup.ini since I merge several package
> sources into a new install tree.  This also means that the general structure of
> setup.ini for Cygwin must still be OK (my script would barf otherwise and I
> think upset would be, well, upset as well) and I'm probably not using any of the
> packages that trigger the bahaviour.  The only ones that come to mind are some
> recent additions that have dots and plus characters in their version part.

I'm not saying that setup.ini isn't triggering the bug in 'setup.exe' but I 
still contend if 'setup.exe' can't function properly in unattended mode due
to an external change then this is a bug within 'setup.exe', no
matter how long it has been since its last release.  Of course, a motivated
individual looking for a workaround could certainly remove the newest
packages from their local 'setup.ini' file to see if that helps.  If so,
one could then narrow in on the package that's causing unattended mode to
fail.

-- 
Larry

_____________________________________________________________________

A: Yes.
 > Q: Are you sure?
 >> A: Because it reverses the logical flow of conversation.
 >>> Q: Why is top posting annoying in email?

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Christopher Faylor]

On Thu, Oct 25, 2012 at 12:24:09PM +0100, Fergus wrote:
>It's the @gt5 paragraph in setup.ini (I think).
>It certainly breaks the build process for me.
>sdesc: and ldesc: are properly enclosed with "".
>Dunno: maybe it's the ~ in the filename.
>It is indeed the only occurrence of that punctuation under release/.
>Fergus
>
>@ gt5
>sdesc: "Shell program to display visual disk usage with navigation"
>ldesc: "Tool for exploring disk usage more conveniently than the du(1).
>program displays what has appened since last run and displays dir size
>and the total ercentage. It is possible to navigate and descend to
>directories by sing cursor keys with text based browsers."
>category: Utils
>requires: lynx cygwin
>version: 1.5.0~20111220+bzr29-1
>install: release/gt5/gt5-1.5.0~20111220+bzr29-1.tar.bz2 17876 
>5665c1607f2b958b7edfa271b4d20aae
>source: release/gt5/gt5-1.5.0~20111220+bzr29-1-src.tar.bz2 105709 
>1f1ae1e59bf68448216800a4e2938ca0

Assuming that's true, why is there still a "Cygwin 1.7.17" in the subject?

cgf

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Cygwin 1.7.17 breaks unattended setup

[Fergus]

It's the @gt5 paragraph in setup.ini (I think).
It certainly breaks the build process for me.
sdesc: and ldesc: are properly enclosed with "".
Dunno: maybe it's the ~ in the filename.
It is indeed the only occurrence of that punctuation under release/.
Fergus

@ gt5
sdesc: "Shell program to display visual disk usage with navigation"
ldesc: "Tool for exploring disk usage more conveniently than the du(1).
program displays what has appened since last run and displays dir size
and the total ercentage. It is possible to navigate and descend to
directories by sing cursor keys with text based browsers."
category: Utils
requires: lynx cygwin
version: 1.5.0~20111220+bzr29-1
install: release/gt5/gt5-1.5.0~20111220+bzr29-1.tar.bz2 17876 
5665c1607f2b958b7edfa271b4d20aae
source: release/gt5/gt5-1.5.0~20111220+bzr29-1-src.tar.bz2 105709 
1f1ae1e59bf68448216800a4e2938ca0

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Achim Gratz]

Larry Hall (Cygwin <reply-to-list-only-lh <at> cygwin.com> writes:
> > As soon as I disable unattended mode (remove the --quiet-mode switch),
> > if I just take all the default settings in the installer GUI and click
> > the Next button a lot, the installation completes just fine.
> 
> Which is why I said the problem is within 'setup.exe' itself.  Regardless
> of whether some external input may be twiddling an internal bug, it's
> still an internal bug.  And given the number of new packages within the
> last week, the chance for one of those to be a contributing factor is
> certainly much higher than for the cygwin package itself.  But we won't
> know for sure what's at the heart of it until someone has a chance to
> debug it.

Setup.exe hasn't changed for a long time.  While that doesn't preclude a bug
within setup.exe itself, I'd suggest looking at setup.ini first.  I'm absolutely
relying on unattended setup and I haven't noticed any problems, much less
recently.  However, I'm rewriting setup.ini since I merge several package
sources into a new install tree.  This also means that the general structure of
setup.ini for Cygwin must still be OK (my script would barf otherwise and I
think upset would be, well, upset as well) and I'm probably not using any of the
packages that trigger the bahaviour.  The only ones that come to mind are some
recent additions that have dots and plus characters in their version part.


Regards,
Achim.


--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Larry Hall (Cygwin)]

On 10/24/2012 8:15 PM, Jason Brittain wrote:
> Hi Larry and Stefan.
>
> I'm also seeing unattended installation broken right now, when it was
> working fine just a short number of days ago.  I do believe it is a
> change in Cygwin 1.7.17 because the logic in setup.exe (whether it
> changed or not) has to match up well enough with either the contents
> of the package index files that it downloads and uses or the package
> files themselves.. and I think something changed between the two and
> the unattended installer (--quiet-mode) doesn't work.

<snip>

> As soon as I disable unattended mode (remove the --quiet-mode switch),
> if I just take all the default settings in the installer GUI and click
> the Next button a lot, the installation completes just fine.

Which is why I said the problem is within 'setup.exe' itself.  Regardless
of whether some external input may be twiddling an internal bug, it's
still an internal bug.  And given the number of new packages within the
last week, the chance for one of those to be a contributing factor is
certainly much higher than for the cygwin package itself.  But we won't
know for sure what's at the heart of it until someone has a chance to
debug it.

-- 
Larry

_____________________________________________________________________

A: Yes.
 > Q: Are you sure?
 >> A: Because it reverses the logical flow of conversation.
 >>> Q: Why is top posting annoying in email?

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple

Re: Cygwin 1.7.17 breaks unattended setup

[Jason Brittain]

Hi Larry and Stefan.

I'm also seeing unattended installation broken right now, when it was
working fine just a short number of days ago.  I do believe it is a
change in Cygwin 1.7.17 because the logic in setup.exe (whether it
changed or not) has to match up well enough with either the contents
of the package index files that it downloads and uses or the package
files themselves.. and I think something changed between the two and
the unattended installer (--quiet-mode) doesn't work.  In my case,
like Stefan's, my script downloads setup.exe, then invokes it like:

%TEMP%\setup.exe --quiet-mode --packages base-passwd,bash,bzip2,
libcurl3,curl,expat,gawk,openssh,perl,tar,wget -s
http://mirrors.xmission.com/cygwin

This is the output:

Starting cygwin install, version 2.774
User has backup/restore rights
io_stream_cygfile: fopen(/etc/setup/setup.rc) failed 2 No such file or directory
io_stream_cygfile: fopen(/etc/setup/last-cache) failed 2 No such file
or directory
io_stream_cygfile: fopen(/etc/setup/last-action) failed 2 No such file
or directory
io_stream_cygfile: fopen(/etc/setup/net-method) failed 2 No such file
or directory
io_stream_cygfile: fopen(/etc/setup/net-proxy-host) failed 2 No such
file or directory
io_stream_cygfile: fopen(/etc/setup/net-proxy-port) failed 2 No such
file or directory
io_stream_cygfile: fopen(/etc/setup/extrakeys) failed 2 No such file
or directory
io_stream_cygfile: fopen(/etc/setup/chooser_window_settings) failed 2
No such file or directory
Current Directory: C:\Users\jasonb
Could not open service McShield for query, start and stop. McAfee may
not be installed, or we don't have access.
root: C:\cygwin binary system
Selected local directory: C:\Users\jasonb
net: Direct
io_stream_cygfile: fopen(/etc/setup/mirrors-lst) failed 2 No such file
or directory
Cached mirror list unavailable
get_url_to_membuf http://cygwin.com/mirrors.lst
getUrlToStream http://cygwin.com/mirrors.lst
site: http://mirrors.xmission.com/cygwin/
get_url_to_membuf http://mirrors.xmission.com/cygwin//setup.bz2
getUrlToStream http://mirrors.xmission.com/cygwin//setup.bz2
get_url_to_membuf http://mirrors.xmission.com/cygwin//setup.bz2.sig
getUrlToStream http://mirrors.xmission.com/cygwin//setup.bz2.sig
io_stream_cygfile: fopen(/etc/setup/installed.db) failed 2 No such
file or directory
Added manual package bzip2
Added manual package curl
Added manual package expat
Added manual package gawk
Added manual package libcurl3
Added manual package tar
Added manual package wget
download error in unattended_mode: 3 retries remaining.
site: http://mirrors.xmission.com/cygwin/
get_url_to_membuf http://mirrors.xmission.com/cygwin//setup.bz2
getUrlToStream http://mirrors.xmission.com/cygwin//setup.bz2
get_url_to_membuf http://mirrors.xmission.com/cygwin//setup.bz2.sig
getUrlToStream http://mirrors.xmission.com/cygwin//setup.bz2.sig
package a2ps comparing versions 4.14-1 and 4.14-1, result was 0
package a2ps comparing versions 4.13-1 and 4.13-1, result was 0
package aalib comparing versions 1.4rc5-10 and 1.4rc5-10, result was 0
package aalib comparing versions 1.4rc5-3 and 1.4rc5-3, result was 0
package aalib-devel comparing versions 1.4rc5-10 and 1.4rc5-10, result was 0

.. and it continues printing package names that I didn't specifically
mention, with "result was 0" on the end of the line, and it doesn't
install my packages.  :(  Sometimes it is able to install some
packages, then a short number of packages later it fails on one,
saying the same thing: "download error in unattended_mode: 3 retries
remaining.", only it doesn't appear to retry after that.  No way to
configure the number of retries?  I'm not sure why it fails to
download, either, since I can download the file that it (sometimes)
says it's trying to download if I copy and paste the exact same URL
into my web browser.

As soon as I disable unattended mode (remove the --quiet-mode switch),
if I just take all the default settings in the installer GUI and click
the Next button a lot, the installation completes just fine.

I'd be happy to provide any other details you'd like..

Thanks.
--
Jason Brittain

--
Problem reports:       http://cygwin.com/problems.html
FAQ:                   http://cygwin.com/faq/
Documentation:         http://cygwin.com/docs.html
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple