* Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
@ 2015-06-01 15:03 Theodor.Kazhan
2015-06-01 18:54 ` Corinna Vinschen
0 siblings, 1 reply; 5+ messages in thread
From: Theodor.Kazhan @ 2015-06-01 15:03 UTC (permalink / raw)
To: Theodor.Kazhan, cygwin
Hi folks,
unfortunately, my issue seems to be not interesting enough to trigger someones attention... ;)
Was my issue well described or do you have further questions? I'd appreciate any help leading me forward, e.g. maybe some hints in howto instrument cygwin sources to be able to further trace the data through and debug into the cygwins write / read functions...
Thanks,
Theo
-----Ursprüngliche Nachricht-----
Gesendet: Freitag, 22 Mai 2015 um 09:52:20 Uhr
Von: Theodor.Kazhan@gmx.de
An: cygwin@cygwin.com
Betreff: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
Hi ML-followers,
I occasionally observe stalled scp connections while copying logfile archives from a debian server to cygwin on Windows 7. Besides https://sourceware.org/ml/cygwin/2015-02/msg00575.html I did not find similar issues, but there is no blocking/non-blocking switch involved in the middle of the data transmission (at random places in subsequent tests) through the pipe, where some data is lost (pls see below).
Pls find the redacted output of my "cygcheck -svr" attached. I also noticed that issue also before upgrading my cygwin to that latest version.
As I'm not into the details of read/write functions, I was only able to track down the issue as follows - I hope it is reproducible or otherwise helpful - so now I need your help:
1) I added some instrumentation in scp/ssh (both binaries copied to /usr/local/bin/ and used below):
user@host /usr/src/openssh-6.8p1-1.src/openssh-6.8p1-debug
$ grep -n -C4 TK: *.c
channels.c-1724-
channels.c-1725- if (c->datagram) {
channels.c-1726- /* ignore truncated writes, datagrams might get lost */
channels.c-1727- len = write(c->wfd, buf, dlen);
channels.c:1728:logit("TK: channels.c: channel_handle_wfd(1): write: len=%d, buf=%.16s", len, buf);
channels.c-1729- free(data);
channels.c-1730- if (len < 0 && (errno == EINTR || errno == EAGAIN ||
channels.c-1731- errno == EWOULDBLOCK))
channels.c-1732- return 1;
--
channels.c-1745- dlen = MIN(dlen, 8*1024);
channels.c-1746-#endif
channels.c-1747-
channels.c-1748- len = write(c->wfd, buf, dlen);
channels.c:1749:logit("TK: channels.c: channel_handle_wfd(2): write: len=%d, buf=%.16s", len, buf);
channels.c-1750- if (len < 0 &&
channels.c-1751- (errno == EINTR || errno == EAGAIN || errno == EWOULDBLOCK))
channels.c-1752- return 1;
channels.c-1753- if (len <= 0) {
--
channels.c-2368- return 0;
channels.c-2369-
channels.c-2370- /* Get the data. */
channels.c-2371- data = packet_get_string_ptr(&data_len);
channels.c:2372:logit("TK: channels.c: channel_input_data: data_len=%d, buf=%.16s", data_len, data);
channels.c-2373- win_len = data_len;
channels.c-2374- if (c->datagram)
channels.c-2375- win_len += 4; /* string length header */
channels.c-2376-
--
dispatch.c-107- return r;
dispatch.c-108- if (type == SSH_MSG_NONE)
dispatch.c-109- return 0;
dispatch.c-110- }
dispatch.c:111:logit("TK: dispatch.c: ssh_dispatch_run: type=%d", type);
dispatch.c-112- if (type > 0 && type < DISPATCH_MAX &&
dispatch.c-113- ssh->dispatch[type] != NULL) {
dispatch.c-114- if (ssh->dispatch_skip_packets) {
dispatch.c-115- debug2("skipped packet (type %u)", type);
--
scp.c-1110- count += amt;
scp.c-1111- do {
scp.c-1112- j = atomicio6(read, remin, cp, amt,
scp.c-1113- scpio, &statbytes);
scp.c:1114:logit("TK: scp.c: sink: amt=%d, j=%d, i=%d, size=%d, count=%d, buf=%.16s", amt, j, i, size, count, cp);
scp.c-1115- if (j == 0) {
scp.c-1116- run_err("%s", j != EPIPE ?
scp.c-1117- strerror(errno) :
scp.c-1118- "dropped connection");
2) Generated easily debuggable (numbered 16k ascii blocks) HUGEFILE on a debian server (file size taken from an original log archive):
$ for BLOCK in `seq -w 1 1 94795`; do for ELEM in `seq -w 1 1 1024`; do echo -n "B0$BLOCK-N00$ELEM-"; done; done > TEST.txt
3) Pulled that file in a loop from the debian server to the local cygwin on Windows 7:
$ while true; do /usr/local/bin/scp -v -C -o BatchMode=yes user@10.IP2.IP3.IP4:logDownload_m/TEST.txt 93_KO_TEST.txt 2>&1 | tee 93_KO_scp_trace.txt; echo; date; echo; sleep 15; done
4) In case of stalled scp (in my env, it does not take that much time to get it, maybe 10-to-30 tries), collect and compare the "KO" output to a previously recorded and prepared "OK" output:
$ split -b 163840 -a 5 93_KO_TEST.txt 93_KO_TEST.txt.split_
$ for FILE in 93_OK_TEST.txt.split_*; do echo "$FILE"; diff -q $FILE `echo $FILE | sed -re "s/93_OK_/93_KO_/g"` || break; done
. . .
93_OK_TEST.txt.split_aanqv
93_OK_TEST.txt.split_aanqw
Files 93_OK_TEST.txt.split_aanqw and 93_KO_TEST.txt.split_aanqw differ
$ sdiff <(cat 93_OK_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g") <(cat 93_KO_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g")
B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000 B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000
B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000 B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000
B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000 B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000
B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000 B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000
B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000 B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000
B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000 B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000
B092267-N000001-B092267-N000002-B092267-N000003-B092267-N0000 <
B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000 B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000
B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000 B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000
B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000 B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000
> B092271-N000001-B092271-N000002-B092271-N000003-B092271-N0000
... So, the 16k block "B092267" is missing in the "KO" case, lets check the scp/ssh logs, where we do have 3 steps where the HUGEFILE data is handled:
a) Writing it to the channel buffer in the ssh process after reading it from the socket and after decryption and decompression: "TK: channels.c: channel_input_data:"
b) Reading it from the channel buffer and writing it to the pipe towards the scp parent process in ssh process: "TK: channels.c: channel_handle_wfd(2):"
c) Reading it from the pipe in the scp process to write it to the target file: "TK: scp.c: sink:"
The logs show that the buffer is handled in a) and b), but does not show up in c), it is simply lost...
$ for TRACKER in TK:.channels.c:.channel_input_data: TK:.channels.c:.channel_handle_wfd.2.: TK:.scp.c:.sink:; do echo; cat 93_KO_scp_trace.txt | grep "$TRACKER" | grep "B0922[67]"; done
TK: channels.c: channel_input_data: data_len=16384, buf=B092260-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092261-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092262-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092263-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092264-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092265-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092266-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092267-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092268-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092269-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092270-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092271-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092272-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092273-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092274-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092275-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092276-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092277-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092278-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092279-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092260-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092261-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092262-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092263-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092264-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092265-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092266-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092268-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092269-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092270-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092271-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092272-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092273-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092274-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092275-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B092276-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092278-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092279-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511587840, size=1553121293, count=65536, buf=B092261-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511653376, size=1553121293, count=65536, buf=B092265-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511718912, size=1553121293, count=65536, buf=B092270-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511784448, size=1553121293, count=65536, buf=B092274-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511849984, size=1553121293, count=65536, buf=B092278-N000001-
The 3rd line of c) "TK: scp.c: sink:" should be "buf=B092269-N000001-" if all of the 64k data of the 2nd line "count=65536, buf=B092265-N000001-" would have been read correctly from the pipe, but it is: "buf=B092270-N000001-", i.e. one 16k block is written to the pipe by ssh ("TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-"), but does not show up on teh other end of the pipe in scp.
In case bigger blocks are written to the pipe by ssh (e.g. "len=32768"), the bigger blocks get lost and does not show up in scp, e.g.:
93_KOOK_TEST.txt/93_OK_TEST.txt.split_aacmz VS 92_KO_TEST.txt/92_KO_TEST.txt.split_aacmz
B016891-N000001-B016891-N000002-B016891-N000003-B016891-N0000 <
B016892-N000001-B016892-N000002-B016892-N000003-B016892-N0000 <
B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000 B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000
. . .
B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000 B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000
> B016901-N000001-B016901-N000002-B016901-N000003-B016901-N0000
> B016902-N000001-B016902-N000002-B016902-N000003-B016902-N0000
92_KO_TEST.txt/92_KO_scp_trace.txt
TK: channels.c: channel_input_data: data_len=16384, buf=B016890-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016891-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016892-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016893-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B016890-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016891-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016893-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276627456, size=1553121293, count=65536, buf=B016885-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276692992, size=1553121293, count=65536, buf=B016889-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276758528, size=1553121293, count=65536, buf=B016895-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276824064, size=1553121293, count=65536, buf=B016899-N000001-
Any help is much appreciated, thanks in advance!
T.
--
Problem reports: http://cygwin.com/problems.html
FAQ: http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
2015-06-01 15:03 cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data Theodor.Kazhan
@ 2015-06-01 18:54 ` Corinna Vinschen
2015-06-01 18:59 ` Corinna Vinschen
0 siblings, 1 reply; 5+ messages in thread
From: Corinna Vinschen @ 2015-06-01 18:54 UTC (permalink / raw)
To: cygwin
[-- Attachment #1: Type: text/plain, Size: 1080 bytes --]
On Jun 1 17:03, Theodor.Kazhan@gmx.de wrote:
> Hi folks,
>
> unfortunately, my issue seems to be not interesting enough to trigger someones attention... ;)
>
> Was my issue well described or do you have further questions? I'd
> appreciate any help leading me forward, e.g. maybe some hints in howto
> instrument cygwin sources to be able to further trace the data through
> and debug into the cygwins write / read functions...
I have no good idea how to debug this further, other than running under
strace (which takes a lot of patience), but I tried to do the same with
the stock scp 6.8 on Cygwin 2.0.2 x86_, basically a loop:
while true
do
scp -C my_linux_box:TEST.txt . && diff TEST.orig TEST.txt || break
done
The TEST.orig/TEST.txt file was generated as described in your OP. The
loop is running now for a couple of hours without fail.
Any chance this is BLODA-induced?
Corinna
--
Corinna Vinschen Please, send mails regarding Cygwin to
Cygwin Maintainer cygwin AT cygwin DOT com
Red Hat
[-- Attachment #2: Type: application/pgp-signature, Size: 819 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
2015-06-01 18:54 ` Corinna Vinschen
@ 2015-06-01 18:59 ` Corinna Vinschen
0 siblings, 0 replies; 5+ messages in thread
From: Corinna Vinschen @ 2015-06-01 18:59 UTC (permalink / raw)
To: cygwin
[-- Attachment #1: Type: text/plain, Size: 1256 bytes --]
On Jun 1 20:53, Corinna Vinschen wrote:
> On Jun 1 17:03, Theodor.Kazhan@gmx.de wrote:
> > Hi folks,
> >
> > unfortunately, my issue seems to be not interesting enough to trigger someones attention... ;)
> >
> > Was my issue well described or do you have further questions? I'd
> > appreciate any help leading me forward, e.g. maybe some hints in howto
> > instrument cygwin sources to be able to further trace the data through
> > and debug into the cygwins write / read functions...
>
> I have no good idea how to debug this further, other than running under
> strace (which takes a lot of patience), but I tried to do the same with
> the stock scp 6.8 on Cygwin 2.0.2 x86_, basically a loop:
^^^
64
> while true
> do
> scp -C my_linux_box:TEST.txt . && diff TEST.orig TEST.txt || break
> done
>
> The TEST.orig/TEST.txt file was generated as described in your OP. The
> loop is running now for a couple of hours without fail.
>
> Any chance this is BLODA-induced?
Corinna
--
Corinna Vinschen Please, send mails regarding Cygwin to
Cygwin Maintainer cygwin AT cygwin DOT com
Red Hat
[-- Attachment #2: Type: application/pgp-signature, Size: 819 bytes --]
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Re: Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
@ 2015-06-12 12:59 Theodor.Kazhan
2015-06-12 13:14 ` Marco Atzeri
0 siblings, 1 reply; 5+ messages in thread
From: Theodor.Kazhan @ 2015-06-12 12:59 UTC (permalink / raw)
To: Theodor.Kazhan, cygwin
Hi Corinna, all,
in case someone is still as curious about it as I am, it took nearly one week and 3433 attempts:
$ while true; do DATE=`date +%Y%m%d_%H%M%S`; echo -n "started: $DATE"; scp -v -C -o BatchMode=yes tester@10.IP2.IP3.IP4:"logDownload_m/TEST.txt" . > scp_$DATE.txt 2>&1; echo " - finished: `date +%Y%m%d_%H%M%S`"; rm -v `ls -1 scp_2015* | head -n -3`; sleep 5; done
started: 20150605_170918 - finished: 20150605_171220
„scp_20150603_182927.txt“ entfernt
started: 20150605_171225 - finished: 20150605_171531
„scp_20150603_183041.txt“ entfernt
started: 20150605_171536 - finished: 20150605_171842
„scp_20150603_183156.txt“ entfernt
. . .
started: 20150612_113735 - finished: 20150612_113845
„scp_20150612_113347.txt“ entfernt
started: 20150612_113850 - finished: 20150612_114003
„scp_20150612_113502.txt“ entfernt
started: 20150612_114009 <== this ssh-download is stalled
... to reproduce this issue one more time on my 2nd env (cygcheck attached to my previous email dated 05. June 2016, 17:00). This time, a 32k buffer (the 16k-blocks B003363 and B003364) is lost:
$ sdiff -stw40 <(cat TEST.txt | sed -re "s/(B0.....-N001024-)/\1\n/g" | cut -d- -f-2) <(seq -w 1 1 94796 | sed -re "s/.*/B0&-N000001/g")
. > B003363-N000001
. > B003364-N000001
.B094793-N000001 <
.B094794-N000001 <
Any advice is still highly appreciated, e.g. on howto debug into Cygwin/Win I/O-APIs, read/write functions, pipe implementation... For much more details, please refer to my previous emails.
Thanks and BR,
T.
PS: I'm wearing a >Ghostbusters< t-shirt! :D
-----Ursprüngliche Nachricht-----
Gesendet: Freitag, 05 Juni 2015 um 17:00:17 Uhr
Von: Theodor dot Kazhan at gmx dot de
An: Theodor dot Kazhan at gmx dot de,cygwin at cygwin dot com
Betreff: Re: Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
Hi Corinna,
sorry for the delayed answer and for most likely breaking the thread by replying to my old email, I just subscribed to the ML... your email was:
> On Jun 1 20:53, Corinna Vinschen wrote:
> > On Jun 1 17:03, Theodor dot Kazhan at gmx dot de wrote:
> > > Hi folks,
> > >
> > > unfortunately, my issue seems to be not interesting enough to trigger someones attention... ;)
> > >
> > > Was my issue well described or do you have further questions? I'd
> > > appreciate any help leading me forward, e.g. maybe some hints in howto
> > > instrument cygwin sources to be able to further trace the data through
> > > and debug into the cygwins write / read functions...
> >
> > I have no good idea how to debug this further, other than running under
> > strace (which takes a lot of patience), but I tried to do the same with
> > the stock scp 6.8 on Cygwin 2.0.2 x86_, basically a loop:
> ^^^
> 64
>
> > while true
> > do
> > scp -C my_linux_box:TEST.txt . && diff TEST.orig TEST.txt || break
> > done
> >
> > The TEST.orig/TEST.txt file was generated as described in your OP. The
> > loop is running now for a couple of hours without fail.
> >
> > Any chance this is BLODA-induced?
>
> Corinna
I was able to reproduce the issue using the same server but another client system (also Win7 + cygwin according to the attached cygcheck.REDACTED.txt w/o changing scp/ssh) which has for sure much less BLODAs (e.g. no McApe;)...
It took significantly longer to appear: ~8 h for the first hanging scp connection:
$ while true; do DATE=`date +%Y%m%d_%H%M%S`; echo -n "started: $DATE"; scp -v -C -o BatchMode=yes tester@10.IP2.IP3.IP4:"logDownload_m/TEST.txt" . > scp_$DATE.txt 2>&1; echo " - finished: `date +%Y%m%d_%H%M%S`"; rm -v `ls -1 scp_2015* | head -n -3`; sleep 5; done
started: 20150603_103328 - finished: 20150603_103542
„scp_20150603_102652.txt“ entfernt
„scp_20150603_102912.txt“ entfernt
„scp_20150603_103251.txt“ entfernt
„scp_20150603_103256.txt“ entfernt
started: 20150603_103547 - finished: 20150603_103759
„scp_20150603_103303.txt“ entfernt
. . .
started: 20150603_182649 - finished: 20150603_182802
„scp_20150603_182240.txt“ entfernt
started: 20150603_182807 - finished: 20150603_182922
„scp_20150603_182355.txt“ entfernt
started: 20150603_182927 - finished: 20150603_183036
„scp_20150603_182509.txt“ entfernt
started: 20150603_183041 - finished: 20150603_183151
„scp_20150603_182649.txt“ entfernt
started: 20150603_183156
I just found this last connection (started: 20150603_183156) being still active today waiting inside the scp process for data to read... Looking at the received TEST.txt shows the same symptoms... 1x 16k block of data is missing:
$ sdiff -stw40 <(cat TEST.txt | sed -re "s/(B0.....-N001024-)/\1\n/g" | cut -d- -f-2) <(seq -w 1 1 94796 | sed -re "s/.*/B0&-N000001/g")
> B026375-N000001
B094793-N000001 <
The "B026375" 16k block is missing (and - as TEST.txt is simply overwritten every time - the "B094793" 16k block seems to be duplicated while the first one is from the current transmission which has an offset of -16k and the 2nd is at the correct position from the last transmission of the file).
Before I started to debug into scp/ssh I tried to use strace in two ways: attaching to the scp/ssh processes and starting the scp/ssh processes using strace. I was only able to reproduce the issue using the attach approach (most likely after the buffer was already lost) ... Starting the transmission using strace from the beginning or attaching early enough before <HUGEFILE> is pulled did not reproduce it.
All of that to me looks like a little race condition... (I read some ML posts related to starting threads in cygwin to ensure that data is written using M$Win IO-Functions - but this if far beyond my current know-how (not threads in general, I do have some experience in debugging really nasty race conditions))
How to proceed with that? Would "we" suspect Cygwin/M$Win to be the one to blame...? who could we ask for help?
Thanks and BR,
T.
-----Ursprüngliche Nachricht-----
Gesendet: Montag, 01 Juni 2015 um 17:03:40 Uhr
Von: Theodor dot Kazhan at gmx dot de
An: Theodor dot Kazhan at gmx dot de,cygwin at cygwin dot com
Betreff: Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
Hi folks,
unfortunately, my issue seems to be not interesting enough to trigger someones attention... ;)
Was my issue well described or do you have further questions? I'd appreciate any help leading me forward, e.g. maybe some hints in howto instrument cygwin sources to be able to further trace the data through and debug into the cygwins write / read functions...
Thanks,
Theo
-----Ursprüngliche Nachricht-----
Gesendet: Freitag, 22 Mai 2015 um 09:52:20 Uhr
Von: Theodor dot Kazhan at gmx dot de
An: cygwin at cygwin dot com
Betreff: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
Hi ML-followers,
I occasionally observe stalled scp connections while copying logfile archives from a debian server to cygwin on Windows 7. Besides https://sourceware.org/ml/cygwin/2015-02/msg00575.html I did not find similar issues, but there is no blocking/non-blocking switch involved in the middle of the data transmission (at random places in subsequent tests) through the pipe, where some data is lost (pls see below).
Pls find the redacted output of my "cygcheck -svr" attached. I also noticed that issue also before upgrading my cygwin to that latest version.
As I'm not into the details of read/write functions, I was only able to track down the issue as follows - I hope it is reproducible or otherwise helpful - so now I need your help:
1) I added some instrumentation in scp/ssh (both binaries copied to /usr/local/bin/ and used below):
user@host /usr/src/openssh-6.8p1-1.src/openssh-6.8p1-debug
$ grep -n -C4 TK: *.c
channels.c-1724-
channels.c-1725- if (c->datagram) {
channels.c-1726- /* ignore truncated writes, datagrams might get lost */
channels.c-1727- len = write(c->wfd, buf, dlen);
channels.c:1728:logit("TK: channels.c: channel_handle_wfd(1): write: len=%d, buf=%.16s", len, buf);
channels.c-1729- free(data);
channels.c-1730- if (len < 0 && (errno == EINTR || errno == EAGAIN ||
channels.c-1731- errno == EWOULDBLOCK))
channels.c-1732- return 1;
--
channels.c-1745- dlen = MIN(dlen, 8*1024);
channels.c-1746-#endif
channels.c-1747-
channels.c-1748- len = write(c->wfd, buf, dlen);
channels.c:1749:logit("TK: channels.c: channel_handle_wfd(2): write: len=%d, buf=%.16s", len, buf);
channels.c-1750- if (len < 0 &&
channels.c-1751- (errno == EINTR || errno == EAGAIN || errno == EWOULDBLOCK))
channels.c-1752- return 1;
channels.c-1753- if (len <= 0) {
--
channels.c-2368- return 0;
channels.c-2369-
channels.c-2370- /* Get the data. */
channels.c-2371- data = packet_get_string_ptr(&data_len);
channels.c:2372:logit("TK: channels.c: channel_input_data: data_len=%d, buf=%.16s", data_len, data);
channels.c-2373- win_len = data_len;
channels.c-2374- if (c->datagram)
channels.c-2375- win_len += 4; /* string length header */
channels.c-2376-
--
dispatch.c-107- return r;
dispatch.c-108- if (type == SSH_MSG_NONE)
dispatch.c-109- return 0;
dispatch.c-110- }
dispatch.c:111:logit("TK: dispatch.c: ssh_dispatch_run: type=%d", type);
dispatch.c-112- if (type > 0 && type < DISPATCH_MAX &&
dispatch.c-113- ssh->dispatch[type] != NULL) {
dispatch.c-114- if (ssh->dispatch_skip_packets) {
dispatch.c-115- debug2("skipped packet (type %u)", type);
--
scp.c-1110- count += amt;
scp.c-1111- do {
scp.c-1112- j = atomicio6(read, remin, cp, amt,
scp.c-1113- scpio, &statbytes);
scp.c:1114:logit("TK: scp.c: sink: amt=%d, j=%d, i=%d, size=%d, count=%d, buf=%.16s", amt, j, i, size, count, cp);
scp.c-1115- if (j == 0) {
scp.c-1116- run_err("%s", j != EPIPE ?
scp.c-1117- strerror(errno) :
scp.c-1118- "dropped connection");
2) Generated easily debuggable (numbered 16k ascii blocks) HUGEFILE on a debian server (file size taken from an original log archive):
$ for BLOCK in `seq -w 1 1 94795`; do for ELEM in `seq -w 1 1 1024`; do echo -n "B0$BLOCK-N00$ELEM-"; done; done > TEST.txt
3) Pulled that file in a loop from the debian server to the local cygwin on Windows 7:
$ while true; do /usr/local/bin/scp -v -C -o BatchMode=yes user@10.IP2.IP3.IP4:logDownload_m/TEST.txt 93_KO_TEST.txt 2>&1 | tee 93_KO_scp_trace.txt; echo; date; echo; sleep 15; done
4) In case of stalled scp (in my env, it does not take that much time to get it, maybe 10-to-30 tries), collect and compare the "KO" output to a previously recorded and prepared "OK" output:
$ split -b 163840 -a 5 93_KO_TEST.txt 93_KO_TEST.txt.split_
$ for FILE in 93_OK_TEST.txt.split_*; do echo "$FILE"; diff -q $FILE `echo $FILE | sed -re "s/93_OK_/93_KO_/g"` || break; done
. . .
93_OK_TEST.txt.split_aanqv
93_OK_TEST.txt.split_aanqw
Files 93_OK_TEST.txt.split_aanqw and 93_KO_TEST.txt.split_aanqw differ
$ sdiff <(cat 93_OK_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g") <(cat 93_KO_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g")
B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000 B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000
B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000 B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000
B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000 B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000
B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000 B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000
B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000 B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000
B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000 B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000
B092267-N000001-B092267-N000002-B092267-N000003-B092267-N0000 <
B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000 B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000
B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000 B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000
B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000 B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000
> B092271-N000001-B092271-N000002-B092271-N000003-B092271-N0000
... So, the 16k block "B092267" is missing in the "KO" case, lets check the scp/ssh logs, where we do have 3 steps where the HUGEFILE data is handled:
a) Writing it to the channel buffer in the ssh process after reading it from the socket and after decryption and decompression: "TK: channels.c: channel_input_data:"
b) Reading it from the channel buffer and writing it to the pipe towards the scp parent process in ssh process: "TK: channels.c: channel_handle_wfd(2):"
c) Reading it from the pipe in the scp process to write it to the target file: "TK: scp.c: sink:"
The logs show that the buffer is handled in a) and b), but does not show up in c), it is simply lost...
$ for TRACKER in TK:.channels.c:.channel_input_data: TK:.channels.c:.channel_handle_wfd.2.: TK:.scp.c:.sink:; do echo; cat 93_KO_scp_trace.txt | grep "$TRACKER" | grep "B0922[67]"; done
TK: channels.c: channel_input_data: data_len=16384, buf=B092260-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092261-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092262-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092263-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092264-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092265-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092266-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092267-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092268-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092269-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092270-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092271-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092272-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092273-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092274-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092275-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092276-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092277-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092278-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092279-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092260-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092261-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092262-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092263-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092264-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092265-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092266-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092268-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092269-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092270-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092271-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092272-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092273-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092274-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092275-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B092276-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092278-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092279-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511587840, size=1553121293, count=65536, buf=B092261-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511653376, size=1553121293, count=65536, buf=B092265-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511718912, size=1553121293, count=65536, buf=B092270-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511784448, size=1553121293, count=65536, buf=B092274-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511849984, size=1553121293, count=65536, buf=B092278-N000001-
The 3rd line of c) "TK: scp.c: sink:" should be "buf=B092269-N000001-" if all of the 64k data of the 2nd line "count=65536, buf=B092265-N000001-" would have been read correctly from the pipe, but it is: "buf=B092270-N000001-", i.e. one 16k block is written to the pipe by ssh ("TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-"), but does not show up on teh other end of the pipe in scp.
In case bigger blocks are written to the pipe by ssh (e.g. "len=32768"), the bigger blocks get lost and does not show up in scp, e.g.:
93_KOOK_TEST.txt/93_OK_TEST.txt.split_aacmz VS 92_KO_TEST.txt/92_KO_TEST.txt.split_aacmz
B016891-N000001-B016891-N000002-B016891-N000003-B016891-N0000 <
B016892-N000001-B016892-N000002-B016892-N000003-B016892-N0000 <
B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000 B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000
. . .
B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000 B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000
> B016901-N000001-B016901-N000002-B016901-N000003-B016901-N0000
> B016902-N000001-B016902-N000002-B016902-N000003-B016902-N0000
92_KO_TEST.txt/92_KO_scp_trace.txt
TK: channels.c: channel_input_data: data_len=16384, buf=B016890-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016891-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016892-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016893-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B016890-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016891-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016893-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276627456, size=1553121293, count=65536, buf=B016885-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276692992, size=1553121293, count=65536, buf=B016889-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276758528, size=1553121293, count=65536, buf=B016895-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276824064, size=1553121293, count=65536, buf=B016899-N000001-
Any help is much appreciated, thanks in advance!
T.
--
Problem reports: http://cygwin.com/problems.html
FAQ: http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
^ permalink raw reply [flat|nested] 5+ messages in thread* Re: cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
2015-06-12 12:59 Re: " Theodor.Kazhan
@ 2015-06-12 13:14 ` Marco Atzeri
0 siblings, 0 replies; 5+ messages in thread
From: Marco Atzeri @ 2015-06-12 13:14 UTC (permalink / raw)
To: cygwin
On 6/12/2015 2:59 PM, Theodor.Kazhan@gmx.de wrote:
> Hi Corinna, all,
>
> in case someone is still as curious about it as I am, it took nearly one week and 3433 attempts:
>
> $ while true; do DATE=`date +%Y%m%d_%H%M%S`; echo -n "started: $DATE"; scp -v -C -o BatchMode=yes tester@10.IP2.IP3.IP4:"logDownload_m/TEST.txt" . > scp_$DATE.txt 2>&1; echo " - finished: `date +%Y%m%d_%H%M%S`"; rm -v `ls -1 scp_2015* | head -n -3`; sleep 5; done
> started: 20150605_170918 - finished: 20150605_171220
> „scp_20150603_182927.txt“ entfernt
> started: 20150605_171225 - finished: 20150605_171531
> „scp_20150603_183041.txt“ entfernt
> started: 20150605_171536 - finished: 20150605_171842
> „scp_20150603_183156.txt“ entfernt
> . . .
> started: 20150612_113735 - finished: 20150612_113845
> „scp_20150612_113347.txt“ entfernt
> started: 20150612_113850 - finished: 20150612_114003
> „scp_20150612_113502.txt“ entfernt
> started: 20150612_114009 <== this ssh-download is stalled
>
> ... to reproduce this issue one more time on my 2nd env (cygcheck attached to my previous email dated 05. June 2016, 17:00). This time, a 32k buffer (the 16k-blocks B003363 and B003364) is lost:
>
> $ sdiff -stw40 <(cat TEST.txt | sed -re "s/(B0.....-N001024-)/\1\n/g" | cut -d- -f-2) <(seq -w 1 1 94796 | sed -re "s/.*/B0&-N000001/g")
> . > B003363-N000001
> . > B003364-N000001
> .B094793-N000001 <
> .B094794-N000001 <
>
>
> Any advice is still highly appreciated, e.g. on howto debug into Cygwin/Win I/O-APIs, read/write functions, pipe implementation... For much more details, please refer to my previous emails.
>
>
> Thanks and BR,
> T.
>
Hi Theodor,
Question: last cygwin 2.0.4 or previous version ?
Maybe is no relevant for your case but there were some fixes
In theory during tests a 64K buffer should be faster
Regards
Marco
--
Problem reports: http://cygwin.com/problems.html
FAQ: http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
^ permalink raw reply [flat|nested] 5+ messages in thread
* cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data
@ 2015-05-22 9:13 Theodor.Kazhan
0 siblings, 0 replies; 5+ messages in thread
From: Theodor.Kazhan @ 2015-05-22 9:13 UTC (permalink / raw)
To: cygwin
[-- Attachment #1: Type: text/plain, Size: 12803 bytes --]
Hi ML-followers,
I occasionally observe stalled scp connections while copying logfile archives from a debian server to cygwin on Windows 7. Besides https://sourceware.org/ml/cygwin/2015-02/msg00575.html I did not find similar issues, but there is no blocking/non-blocking switch involved in the middle of the data transmission (at random places in subsequent tests) through the pipe, where some data is lost (pls see below).
Pls find the redacted output of my "cygcheck -svr" attached. I also noticed that issue also before upgrading my cygwin to that latest version.
As I'm not into the details of read/write functions, I was only able to track down the issue as follows - I hope it is reproducible or otherwise helpful - so now I need your help:
1) I added some instrumentation in scp/ssh (both binaries copied to /usr/local/bin/ and used below):
user@host /usr/src/openssh-6.8p1-1.src/openssh-6.8p1-debug
$ grep -n -C4 TK: *.c
channels.c-1724-
channels.c-1725- if (c->datagram) {
channels.c-1726- /* ignore truncated writes, datagrams might get lost */
channels.c-1727- len = write(c->wfd, buf, dlen);
channels.c:1728:logit("TK: channels.c: channel_handle_wfd(1): write: len=%d, buf=%.16s", len, buf);
channels.c-1729- free(data);
channels.c-1730- if (len < 0 && (errno == EINTR || errno == EAGAIN ||
channels.c-1731- errno == EWOULDBLOCK))
channels.c-1732- return 1;
--
channels.c-1745- dlen = MIN(dlen, 8*1024);
channels.c-1746-#endif
channels.c-1747-
channels.c-1748- len = write(c->wfd, buf, dlen);
channels.c:1749:logit("TK: channels.c: channel_handle_wfd(2): write: len=%d, buf=%.16s", len, buf);
channels.c-1750- if (len < 0 &&
channels.c-1751- (errno == EINTR || errno == EAGAIN || errno == EWOULDBLOCK))
channels.c-1752- return 1;
channels.c-1753- if (len <= 0) {
--
channels.c-2368- return 0;
channels.c-2369-
channels.c-2370- /* Get the data. */
channels.c-2371- data = packet_get_string_ptr(&data_len);
channels.c:2372:logit("TK: channels.c: channel_input_data: data_len=%d, buf=%.16s", data_len, data);
channels.c-2373- win_len = data_len;
channels.c-2374- if (c->datagram)
channels.c-2375- win_len += 4; /* string length header */
channels.c-2376-
--
dispatch.c-107- return r;
dispatch.c-108- if (type == SSH_MSG_NONE)
dispatch.c-109- return 0;
dispatch.c-110- }
dispatch.c:111:logit("TK: dispatch.c: ssh_dispatch_run: type=%d", type);
dispatch.c-112- if (type > 0 && type < DISPATCH_MAX &&
dispatch.c-113- ssh->dispatch[type] != NULL) {
dispatch.c-114- if (ssh->dispatch_skip_packets) {
dispatch.c-115- debug2("skipped packet (type %u)", type);
--
scp.c-1110- count += amt;
scp.c-1111- do {
scp.c-1112- j = atomicio6(read, remin, cp, amt,
scp.c-1113- scpio, &statbytes);
scp.c:1114:logit("TK: scp.c: sink: amt=%d, j=%d, i=%d, size=%d, count=%d, buf=%.16s", amt, j, i, size, count, cp);
scp.c-1115- if (j == 0) {
scp.c-1116- run_err("%s", j != EPIPE ?
scp.c-1117- strerror(errno) :
scp.c-1118- "dropped connection");
2) Generated easily debuggable (numbered 16k ascii blocks) HUGEFILE on a debian server (file size taken from an original log archive):
$ for BLOCK in `seq -w 1 1 94795`; do for ELEM in `seq -w 1 1 1024`; do echo -n "B0$BLOCK-N00$ELEM-"; done; done > TEST.txt
3) Pulled that file in a loop from the debian server to the local cygwin on Windows 7:
$ while true; do /usr/local/bin/scp -v -C -o BatchMode=yes user@10.IP2.IP3.IP4:logDownload_m/TEST.txt 93_KO_TEST.txt 2>&1 | tee 93_KO_scp_trace.txt; echo; date; echo; sleep 15; done
4) In case of stalled scp (in my env, it does not take that much time to get it, maybe 10-to-30 tries), collect and compare the "KO" output to a previously recorded and prepared "OK" output:
$ split -b 163840 -a 5 93_KO_TEST.txt 93_KO_TEST.txt.split_
$ for FILE in 93_OK_TEST.txt.split_*; do echo "$FILE"; diff -q $FILE `echo $FILE | sed -re "s/93_OK_/93_KO_/g"` || break; done
. . .
93_OK_TEST.txt.split_aanqv
93_OK_TEST.txt.split_aanqw
Files 93_OK_TEST.txt.split_aanqw and 93_KO_TEST.txt.split_aanqw differ
$ sdiff <(cat 93_OK_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g") <(cat 93_KO_TEST.txt.split_aanqw | sed -re "s/(B......-N001024-)/\1\n/g")
B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000 B092261-N000001-B092261-N000002-B092261-N000003-B092261-N0000
B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000 B092262-N000001-B092262-N000002-B092262-N000003-B092262-N0000
B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000 B092263-N000001-B092263-N000002-B092263-N000003-B092263-N0000
B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000 B092264-N000001-B092264-N000002-B092264-N000003-B092264-N0000
B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000 B092265-N000001-B092265-N000002-B092265-N000003-B092265-N0000
B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000 B092266-N000001-B092266-N000002-B092266-N000003-B092266-N0000
B092267-N000001-B092267-N000002-B092267-N000003-B092267-N0000 <
B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000 B092268-N000001-B092268-N000002-B092268-N000003-B092268-N0000
B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000 B092269-N000001-B092269-N000002-B092269-N000003-B092269-N0000
B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000 B092270-N000001-B092270-N000002-B092270-N000003-B092270-N0000
> B092271-N000001-B092271-N000002-B092271-N000003-B092271-N0000
... So, the 16k block "B092267" is missing in the "KO" case, lets check the scp/ssh logs, where we do have 3 steps where the HUGEFILE data is handled:
a) Writing it to the channel buffer in the ssh process after reading it from the socket and after decryption and decompression: "TK: channels.c: channel_input_data:"
b) Reading it from the channel buffer and writing it to the pipe towards the scp parent process in ssh process: "TK: channels.c: channel_handle_wfd(2):"
c) Reading it from the pipe in the scp process to write it to the target file: "TK: scp.c: sink:"
The logs show that the buffer is handled in a) and b), but does not show up in c), it is simply lost...
$ for TRACKER in TK:.channels.c:.channel_input_data: TK:.channels.c:.channel_handle_wfd.2.: TK:.scp.c:.sink:; do echo; cat 93_KO_scp_trace.txt | grep "$TRACKER" | grep "B0922[67]"; done
TK: channels.c: channel_input_data: data_len=16384, buf=B092260-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092261-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092262-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092263-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092264-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092265-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092266-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092267-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092268-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092269-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092270-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092271-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092272-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092273-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092274-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092275-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092276-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092277-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092278-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B092279-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092260-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092261-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092262-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092263-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092264-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092265-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092266-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092268-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092269-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092270-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092271-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092272-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092273-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092274-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092275-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B092276-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092278-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092279-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511587840, size=1553121293, count=65536, buf=B092261-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511653376, size=1553121293, count=65536, buf=B092265-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511718912, size=1553121293, count=65536, buf=B092270-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511784448, size=1553121293, count=65536, buf=B092274-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=1511849984, size=1553121293, count=65536, buf=B092278-N000001-
The 3rd line of c) "TK: scp.c: sink:" should be "buf=B092269-N000001-" if all of the 64k data of the 2nd line "count=65536, buf=B092265-N000001-" would have been read correctly from the pipe, but it is: "buf=B092270-N000001-", i.e. one 16k block is written to the pipe by ssh ("TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B092267-N000001-"), but does not show up on teh other end of the pipe in scp.
In case bigger blocks are written to the pipe by ssh (e.g. "len=32768"), the bigger blocks get lost and does not show up in scp, e.g.:
93_KOOK_TEST.txt/93_OK_TEST.txt.split_aacmz VS 92_KO_TEST.txt/92_KO_TEST.txt.split_aacmz
B016891-N000001-B016891-N000002-B016891-N000003-B016891-N0000 <
B016892-N000001-B016892-N000002-B016892-N000003-B016892-N0000 <
B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000 B016893-N000001-B016893-N000002-B016893-N000003-B016893-N0000
. . .
B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000 B016900-N000001-B016900-N000002-B016900-N000003-B016900-N0000
> B016901-N000001-B016901-N000002-B016901-N000003-B016901-N0000
> B016902-N000001-B016902-N000002-B016902-N000003-B016902-N0000
92_KO_TEST.txt/92_KO_scp_trace.txt
TK: channels.c: channel_input_data: data_len=16384, buf=B016890-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016891-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016892-N000001-
TK: channels.c: channel_input_data: data_len=16384, buf=B016893-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=16384, buf=B016890-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016891-N000001-
TK: channels.c: channel_handle_wfd(2): write: len=32768, buf=B016893-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276627456, size=1553121293, count=65536, buf=B016885-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276692992, size=1553121293, count=65536, buf=B016889-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276758528, size=1553121293, count=65536, buf=B016895-N000001-
TK: scp.c: sink: amt=65536, j=65536, i=276824064, size=1553121293, count=65536, buf=B016899-N000001-
Any help is much appreciated, thanks in advance!
T.
[-- Attachment #2: cygcheck.REDACTED --]
[-- Type: application/octet-stream, Size: 33280 bytes --]
Cygwin Configuration Diagnostics
Current System Time: Thu May 21 11:38:57 2015
Windows 7 Enterprise Ver 6.1 Build 7601 Service Pack 1
Path: D:\Programs\cygwin64\usr\local\bin
D:\Programs\cygwin64\bin
C:\Program Files (x86)\Lotus\Notes
C:\Program Files (x86)\Lotus\Notes\DATA
D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\bin
D:\Program Files\IBM\RationalSDLC\common
C:\Windows\system32
C:\Windows
C:\Windows\System32\Wbem
C:\Windows\System32\WindowsPowerShell\v1.0
C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x86
C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x64
C:\Program Files\Intel\WiFi\bin
C:\Program Files\Common Files\Intel\WirelessCommon
D:\Program Files\IBM\RationalSDLC\ClearCase\bin
Output from D:\Programs\cygwin64\bin\id.exe
UID: [REDACTED]
GID: [REDACTED]
SysDir: C:\Windows\system32
WinDir: C:\Windows
USER = '[REDACTED]'
PWD = '/cygdrive/d/[REDACTED]/_zZz_/OpenIssues/logDownload_m'
HOME = '/home/[REDACTED]'
HOMEPATH = '\'
APPDATA = 'C:\Users\[REDACTED]\AppData\Roaming'
ProgramW6432 = 'C:\Program Files'
HOSTNAME = '[REDACTED]'
SHELL = '/bin/bash'
TERM = 'xterm'
PROCESSOR_IDENTIFIER = 'Intel64 Family 6 Model 60 Stepping 3, GenuineIntel'
PROFILEREAD = 'true'
WINDIR = 'C:\Windows'
TISDIR = 'D:\Program Files\IBM\RationalSDLC\common'
PUBLIC = 'C:\Users\Public'
CLEARQUEST_HOME = 'D:\Program Files\IBM\RationalSDLC\ClearQuest'
OLDPWD = '/cygdrive/d/[REDACTED]/_zZz_/OpenIssues/logDownload_m/K.O.O.K.'
ORIGINAL_PATH = '/cygdrive/c/Program Files (x86)/Lotus/Notes:/cygdrive/c/Program Files (x86)/Lotus/Notes/DATA:/cygdrive/d/Program Files/IBM/RationalSDLC/Clearquest/cqcli/bin:/cygdrive/d/Program Files/IBM/RationalSDLC/common:/cygdrive/c/Windows/system32:/cygdrive/c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System32/WindowsPowerShell/v1.0:/cygdrive/c/Program Files (x86)/Intel/OpenCL SDK/3.0/bin/x86:/cygdrive/c/Program Files (x86)/Intel/OpenCL SDK/3.0/bin/x64:/cygdrive/c/Program Files/Intel/WiFi/bin:/cygdrive/c/Program Files/Common Files/Intel/WirelessCommon:/cygdrive/d/Program Files/IBM/RationalSDLC/ClearCase/bin'
USERDOMAIN = '[REDACTED]'
CommonProgramFiles(x86) = 'C:\Program Files (x86)\Common Files'
OS = 'Windows_NT'
ALLUSERSPROFILE = 'C:\ProgramData'
windows_tracing_flags = '3'
windows_tracing_logfile = 'C:\BVTBin\Tests\installpackage\csilogfile.log'
SecSpecialMode = '710916'
JRE_HOME = 'D:\Program Files\IBM\RationalSDLC\Common\Java5.0\jre'
!:: = '::\'
TEMP = '/tmp'
DEFLOGDIR = 'C:\ProgramData\McAfee\DesktopProtection'
COMMONPROGRAMFILES = 'C:\Program Files\Common Files'
IBMLDAP_ALTHOME = 'D:\Program Files\IBM\RationalSDLC\common\codeset'
SOEDesktopAdminModel = 'User'
USERNAME = '[REDACTED]'
PROCESSOR_LEVEL = '6'
RATIONAL_HOME = 'D:\Program Files\IBM\RationalSDLC'
ProgramFiles(x86) = 'C:\Program Files (x86)'
CQCLI_HOME = 'D:\Program Files\IBM\RationalSDLC\ClearQuest\cqcli'
PSModulePath = 'C:\Windows\system32\WindowsPowerShell\v1.0\Modules\'
FP_NO_HOST_CHECK = 'NO'
SYSTEMDRIVE = 'C:'
CQCLI_DOC_DIR = 'D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\doc'
RATIONAL_COMMON = 'D:\Program Files\IBM\RationalSDLC\Common'
SOEDataPartition = 'C:'
LANG = 'de_DE.UTF-8'
USERPROFILE = 'C:\Users\[REDACTED]'
TZ = 'Europe/Berlin'
PS1 = '\[\e]0;\w\a\]\n\[\e[32m\]\u@\h \[\e[33m\]\w\[\e[0m\]\n\$ '
LOGONSERVER = '\\[REDACTED]'
CQCLI_PATH = 'D:\Program Files\IBM\RationalSDLC\ClearQuest;D:\Program Files\IBM\RationalSDLC\Common;D:\Program Files\IBM\RationalSDLC\Common\Java5.0\jre\bin;D:\Program Files\IBM\RationalSDLC\Common\Java5.0\jre\bin\classic;D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\bin;D:\Program Files\IBM\RationalSDLC\common;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x86;C:\Program Files (x86)\Intel\OpenCL SDK\3.0\bin\x64;C:\Program Files\Intel\WiFi\bin\;C:\Program Files\Common Files\Intel\WirelessCommon\;D:\Program Files\IBM\RationalSDLC\ClearCase\bin'
CQCLI_BIN_DIR = 'D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\bin'
CLEARCASE_PRIMARY_GROUP = '[REDACTED]'
CommonProgramW6432 = 'C:\Program Files\Common Files'
PROCESSOR_ARCHITECTURE = 'AMD64'
LOCALAPPDATA = 'C:\Users\[REDACTED]\AppData\Local'
RATIONAL_ICU4J_DIR = 'D:\Program Files\IBM\RationalSDLC\common\java\icu'
ProgramData = 'C:\ProgramData'
EXECIGNORE = '*.dll'
SHLVL = '1'
USERDNSDOMAIN = '[REDACTED]'
PATHEXT = '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC'
HOMEDRIVE = 'H:'
SOESystemPartitionLabel = '[REDACTED]'
PERL_INLINE_JAVA_JNI = '1'
COMSPEC = 'C:\Windows\system32\cmd.exe'
TMP = '/tmp'
SYSTEMROOT = 'C:\Windows'
PRINTER = '\\[REDACTED]\[REDACTED]'
PROCESSOR_REVISION = '3c03'
CLASSPATH = 'D:\Program Files\IBM\RationalSDLC\ClearQuest\cqjni.jar'
RATIONAL_COMMON_LIB = 'D:\Program Files\IBM\RationalSDLC\Common\lib'
CLEARCASE_GROUPS = '[REDACTED]'
INFOPATH = '/usr/local/info:/usr/share/info:/usr/info'
PROGRAMFILES = 'C:\Program Files'
HOMESHARE = '\\[REDACTED]\home$\[REDACTED]'
NUMBER_OF_PROCESSORS = '4'
CQCLI_MAN_DIR = 'D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\doc\man'
VSEDEFLOGDIR = 'C:\ProgramData\McAfee\DesktopProtection'
SESSIONNAME = 'Console'
RATIONAL_ICU4J_VERSION = '3_8_1'
CQCLI_ERR_LEVEL = '1'
CQCLI_LIB_DIR = 'D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\lib'
CQCLI_CLASSPATH = 'D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\config;D:\Program Files\IBM\RationalSDLC\Clearquest\cqcli\lib\cqcli.jar;D:\Program Files\IBM\RationalSDLC\Clearquest\cqjni.jar;D:\Program Files\IBM\RationalSDLC\common\stpcmmn.jar;D:\Program Files\IBM\RationalSDLC\common\stpwvcm.jar;D:\Program Files\IBM\RationalSDLC\Clearquest\stpcq.jar;D:\Program Files\IBM\RationalSDLC\common\java\icu\icu4j-3_8_1.jar'
COMPUTERNAME = '[REDACTED]'
PLMVIS_82_LIBPATH = 'C:\Program Files (x86)\SAP\FrontEnd\SAPgui\Program'
CQCLI_CONFIG_DIR = 'D:\Program Files\IBM\RationalSDLC\clearquest\cqcli\config'
_ = '/usr/bin/cygcheck'
HKEY_CURRENT_USER\Software\Cygwin
HKEY_CURRENT_USER\Software\Cygwin\Installations
(default) = '\??\D:\Programs\cygwin'
441630d6fd41a15b = '\??\D:\Programs\cygwin64'
HKEY_CURRENT_USER\Software\Cygwin\Program Options
HKEY_LOCAL_MACHINE\SOFTWARE\Cygwin
HKEY_LOCAL_MACHINE\SOFTWARE\Cygwin\Installations
(default) = '\??\D:\Programs\cygwin64'
HKEY_LOCAL_MACHINE\SOFTWARE\Cygwin\setup
(default) = 'D:\Programs\cygwin64'
HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Cygwin
HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Cygwin\Installations
(default) = '\??\D:\Programs\cygwin'
HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Cygwin\Program Options
HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Cygwin\setup
(default) = 'D:\Programs\cygwin'
obcaseinsensitive set to 1
Cygwin installations found in the registry:
System: Key: 441630d6fd41a15b Path: D:\Programs\cygwin64
User: Key: 017ee39b5e7e24dd Path: D:\Programs\cygwin (ORPHANED)
User: Key: 441630d6fd41a15b Path: D:\Programs\cygwin64
c: hd NTFS 122095Mb 41% CP CS UN PA FC OSDisk
d: hd NTFS 183146Mb 91% CP CS UN PA FC Data
e: cd N/A N/A
g: net NTFS 14332Mb 1% CP CS UN PA FC SPOOL
h: net NTFS 20069376Mb 100% CP CS UN PA HOME$
v: net MVFS 80000Mb 38% CP CS CCase
y: net MVFS 80000Mb 38% CP CS CCase
z: net MVFS 80000Mb 38% CP CS CCase
D:\Programs\cygwin64 / system binary,auto
D:\Programs\cygwin64\bin /usr/bin system binary,auto
D:\Programs\cygwin64\lib /usr/lib system binary,auto
cygdrive prefix /cygdrive user binary,posix=0,auto
Found: D:\Programs\cygwin64\bin\awk
-> D:\Programs\cygwin64\bin\gawk.exe
Found: D:\Programs\cygwin64\bin\bash.exe
Found: D:\Programs\cygwin64\bin\cat.exe
Found: D:\Programs\cygwin64\bin\cp.exe
Found: D:\Programs\cygwin64\bin\cpp.exe
Not Found: crontab
Found: D:\Programs\cygwin64\bin\find.exe
Found: C:\Windows\system32\find.exe
Warning: D:\Programs\cygwin64\bin\find.exe hides C:\Windows\system32\find.exe
Found: D:\Programs\cygwin64\bin\gcc.exe
Found: D:\Programs\cygwin64\bin\gdb.exe
Found: D:\Programs\cygwin64\bin\grep.exe
Found: D:\Programs\cygwin64\bin\kill.exe
Found: D:\Programs\cygwin64\bin\ld.exe
Found: D:\Programs\cygwin64\bin\ls.exe
Found: D:\Programs\cygwin64\bin\make.exe
Found: D:\Programs\cygwin64\bin\mv.exe
Found: D:\Programs\cygwin64\bin\patch.exe
Found: D:\Programs\cygwin64\bin\perl.exe
Found: D:\Programs\cygwin64\bin\rm.exe
Found: D:\Programs\cygwin64\bin\sed.exe
Found: D:\Programs\cygwin64\usr\local\bin\ssh.exe
Found: D:\Programs\cygwin64\bin\ssh.exe
Warning: D:\Programs\cygwin64\usr\local\bin\ssh.exe hides D:\Programs\cygwin64\bin\ssh.exe
Found: D:\Programs\cygwin64\bin\sh.exe
Found: D:\Programs\cygwin64\bin\tar.exe
Found: D:\Programs\cygwin64\bin\test.exe
Found: D:\Programs\cygwin64\bin\vi.exe
Found: D:\Programs\cygwin64\bin\vim.exe
575k 2013/05/30 D:\Programs\cygwin64\bin\cygarchive-13.dll - os=4.0 img=0.0 sys=5.2
"cygarchive-13.dll" v0.0 ts=2013-05-30 03:06
38k 2013/07/19 D:\Programs\cygwin64\bin\cygargp-0.dll - os=4.0 img=0.0 sys=5.2
"cygargp-0.dll" v0.0 ts=2013-07-19 15:07
88k 2015/03/02 D:\Programs\cygwin64\bin\cygatomic-1.dll - os=4.0 img=0.0 sys=5.2
"cygatomic-1.dll" v0.0 ts=2015-03-02 22:05
16k 2013/03/26 D:\Programs\cygwin64\bin\cygattr-1.dll - os=4.0 img=0.0 sys=5.2
"cygattr-1.dll" v0.0 ts=2013-03-26 18:26
180k 2015/03/23 D:\Programs\cygwin64\bin\cygblkid-1.dll - os=4.0 img=0.0 sys=5.2
"cygblkid-1.dll" v0.0 ts=2015-03-23 09:46
64k 2013/03/07 D:\Programs\cygwin64\bin\cygbz2-1.dll - os=4.0 img=0.0 sys=5.2
"cygbz2-1.dll" v0.0 ts=2013-03-07 02:54
13k 2013/03/06 D:\Programs\cygwin64\bin\cygcatgets1.dll - os=4.0 img=0.0 sys=5.2
"cygcatgets1.dll" v0.0 ts=2013-03-06 14:34
117k 2013/05/05 D:\Programs\cygwin64\bin\cygcloog-isl-4.dll - os=4.0 img=0.0 sys=5.2
"cygcloog-isl-4.dll" v0.0 ts=2013-05-05 16:41
13k 2015/03/19 D:\Programs\cygwin64\bin\cygcom_err-2.dll - os=4.0 img=0.0 sys=5.2
"cygcom_err-2.dll" v0.0 ts=2015-03-19 02:44
9k 2013/03/07 D:\Programs\cygwin64\bin\cygcrypt-0.dll - os=4.0 img=0.0 sys=5.2
"cygcrypt-0.dll" v0.0 ts=2013-03-07 09:29
2213k 2015/03/19 D:\Programs\cygwin64\bin\cygcrypto-1.0.0.dll - os=4.0 img=0.0 sys=5.2
"cygcrypto-1.0.0.dll" v0.0 ts=2015-03-19 16:49
428k 2015/04/29 D:\Programs\cygwin64\bin\cygcurl-4.dll - os=4.0 img=0.0 sys=5.2
"cygcurl-4.dll" v0.0 ts=2015-04-29 20:40
1526k 2013/03/08 D:\Programs\cygwin64\bin\cygdb-5.3.dll - os=4.0 img=0.0 sys=5.2
"cygdb-5.3.dll" v0.0 ts=2013-03-08 07:55
111k 2013/03/08 D:\Programs\cygwin64\bin\cygdb_cxx-5.3.dll - os=4.0 img=0.0 sys=5.2
"cygdb_cxx-5.3.dll" v0.0 ts=2013-03-08 07:56
472k 2013/03/08 D:\Programs\cygwin64\bin\cygdb_sql-5.3.dll - os=4.0 img=0.0 sys=5.2
"cygdb_sql-5.3.dll" v0.0 ts=2013-03-08 07:58
154k 2013/10/20 D:\Programs\cygwin64\bin\cygedit-0.dll - os=4.0 img=0.0 sys=5.2
"cygedit-0.dll" v0.0 ts=2013-10-20 21:56
147k 2013/07/31 D:\Programs\cygwin64\bin\cygexpat-1.dll - os=4.0 img=0.0 sys=5.2
"cygexpat-1.dll" v0.0 ts=2013-07-31 22:53
214k 2015/03/19 D:\Programs\cygwin64\bin\cygext2fs-2.dll - os=4.0 img=0.0 sys=5.2
"cygext2fs-2.dll" v0.0 ts=2015-03-19 02:45
30k 2014/10/14 D:\Programs\cygwin64\bin\cygfam-0.dll - os=4.0 img=0.0 sys=5.2
"cygfam-0.dll" v0.0 ts=2014-10-14 21:33
26k 2015/01/11 D:\Programs\cygwin64\bin\cygffi-6.dll - os=4.0 img=0.0 sys=5.2
"cygffi-6.dll" v0.0 ts=2015-01-11 09:25
57k 2015/04/13 D:\Programs\cygwin64\bin\cygformw-10.dll - os=4.0 img=0.0 sys=5.2
"cygformw-10.dll" v0.0 ts=2015-04-13 07:51
69k 2015/03/02 D:\Programs\cygwin64\bin\cyggcc_s-seh-1.dll - os=4.0 img=0.0 sys=5.2
"cyggcc_s-seh-1.dll" v0.0 ts=2015-03-02 20:43
40k 2014/05/27 D:\Programs\cygwin64\bin\cyggdbm-4.dll - os=4.0 img=0.0 sys=5.2
"cyggdbm-4.dll" v0.0 ts=1970-01-01 00:00
13k 2014/05/27 D:\Programs\cygwin64\bin\cyggdbm_compat-4.dll - os=4.0 img=0.0 sys=5.2
"cyggdbm_compat-4.dll" v0.0 ts=1970-01-01 00:00
1244k 2015/03/12 D:\Programs\cygwin64\bin\cyggio-2.0-0.dll - os=4.0 img=0.0 sys=5.2
"cyggio-2.0-0.dll" v0.0 ts=2015-03-12 06:25
956k 2015/03/12 D:\Programs\cygwin64\bin\cygglib-2.0-0.dll - os=4.0 img=0.0 sys=5.2
"cygglib-2.0-0.dll" v0.0 ts=2015-03-12 06:21
14k 2015/03/12 D:\Programs\cygwin64\bin\cyggmodule-2.0-0.dll - os=4.0 img=0.0 sys=5.2
"cyggmodule-2.0-0.dll" v0.0 ts=2015-03-12 06:21
520k 2015/01/26 D:\Programs\cygwin64\bin\cyggmp-10.dll - os=4.0 img=0.0 sys=5.2
"cyggmp-10.dll" v0.0 ts=2015-01-26 16:08
867k 2015/02/13 D:\Programs\cygwin64\bin\cyggnutls-28.dll - os=4.0 img=0.0 sys=5.2
"cyggnutls-28.dll" v0.0 ts=2015-02-13 13:46
24k 2015/02/13 D:\Programs\cygwin64\bin\cyggnutls-openssl-27.dll - os=4.0 img=0.0 sys=5.2
"cyggnutls-openssl-27.dll" v0.0 ts=2015-02-13 13:46
22k 2015/02/13 D:\Programs\cygwin64\bin\cyggnutls-xssl-0.dll - os=4.0 img=0.0 sys=5.2
"cyggnutls-xssl-0.dll" v0.0 ts=2015-02-13 13:46
42k 2015/02/13 D:\Programs\cygwin64\bin\cyggnutlsxx-28.dll - os=4.0 img=0.0 sys=5.2
"cyggnutlsxx-28.dll" v0.0 ts=2015-02-13 13:46
281k 2015/03/12 D:\Programs\cygwin64\bin\cyggobject-2.0-0.dll - os=4.0 img=0.0 sys=5.2
"cyggobject-2.0-0.dll" v0.0 ts=2015-03-12 06:22
73k 2015/03/02 D:\Programs\cygwin64\bin\cyggomp-1.dll - os=4.0 img=0.0 sys=5.2
"cyggomp-1.dll" v0.0 ts=2015-03-02 20:58
255k 2015/02/22 D:\Programs\cygwin64\bin\cyggssapi_krb5-2.dll - os=4.0 img=0.0 sys=5.2
"cyggssapi_krb5-2.dll" v0.0 ts=2015-02-22 10:05
9k 2015/03/12 D:\Programs\cygwin64\bin\cyggthread-2.0-0.dll - os=4.0 img=0.0 sys=5.2
"cyggthread-2.0-0.dll" v0.0 ts=2015-03-12 06:21
691k 2013/04/22 D:\Programs\cygwin64\bin\cygguile-17.dll - os=4.0 img=0.0 sys=5.2
"cygguile-17.dll" v0.0 ts=2013-04-22 03:15
30k 2015/01/27 D:\Programs\cygwin64\bin\cyghistory7.dll - os=4.0 img=0.0 sys=5.2
"cyghistory7.dll" v0.0 ts=2015-01-27 03:51
168k 2015/02/12 D:\Programs\cygwin64\bin\cyghogweed-2.dll - os=4.0 img=0.0 sys=5.2
"cyghogweed-2.dll" v0.0 ts=2015-02-12 17:27
77k 2014/08/10 D:\Programs\cygwin64\bin\cygICE-6.dll - os=4.0 img=0.0 sys=5.2
"cygICE-6.dll" v0.0 ts=1970-01-01 00:00
1009k 2015/02/20 D:\Programs\cygwin64\bin\cygiconv-2.dll - os=4.0 img=0.0 sys=5.2
"cygiconv-2.dll" v0.0 ts=2015-02-20 17:07
196k 2014/12/06 D:\Programs\cygwin64\bin\cygidn-11.dll - os=4.0 img=0.0 sys=5.2
"cygidn-11.dll" v0.0 ts=2014-12-06 13:17
40k 2015/02/20 D:\Programs\cygwin64\bin\cygintl-8.dll - os=4.0 img=0.0 sys=5.2
"cygintl-8.dll" v0.0 ts=2015-02-20 18:01
888k 2013/05/05 D:\Programs\cygwin64\bin\cygisl-10.dll - os=4.0 img=0.0 sys=5.2
"cygisl-10.dll" v0.0 ts=2013-05-05 16:36
180k 2015/02/22 D:\Programs\cygwin64\bin\cygk5crypto-3.dll - os=4.0 img=0.0 sys=5.2
"cygk5crypto-3.dll" v0.0 ts=2015-02-22 10:05
720k 2015/02/22 D:\Programs\cygwin64\bin\cygkrb5-3.dll - os=4.0 img=0.0 sys=5.2
"cygkrb5-3.dll" v0.0 ts=2015-02-22 10:05
35k 2015/02/22 D:\Programs\cygwin64\bin\cygkrb5support-0.dll - os=4.0 img=0.0 sys=5.2
"cygkrb5support-0.dll" v0.0 ts=2015-02-22 10:04
45k 2015/02/19 D:\Programs\cygwin64\bin\cyglber-2-4-2.dll - os=4.0 img=0.0 sys=5.2
"cyglber-2-4-2.dll" v0.0 ts=2015-02-19 14:39
246k 2015/02/19 D:\Programs\cygwin64\bin\cygldap-2-4-2.dll - os=4.0 img=0.0 sys=5.2
"cygldap-2-4-2.dll" v0.0 ts=2015-02-19 14:40
261k 2015/02/19 D:\Programs\cygwin64\bin\cygldap_r-2-4-2.dll - os=4.0 img=0.0 sys=5.2
"cygldap_r-2-4-2.dll" v0.0 ts=2015-02-19 14:41
6k 2015/05/08 D:\Programs\cygwin64\bin\cyglsa64.dll - os=4.0 img=0.0 sys=5.2
"cyglsa64.dll" v0.0 ts=2015-05-08 22:57
35k 2015/02/17 D:\Programs\cygwin64\bin\cygltdl-7.dll - os=4.0 img=0.0 sys=5.2
"cygltdl-7.dll" v0.0 ts=2015-02-17 18:26
139k 2015/05/03 D:\Programs\cygwin64\bin\cyglzma-5.dll - os=4.0 img=0.0 sys=5.2
"cyglzma-5.dll" v0.0 ts=2015-05-03 07:34
126k 2014/11/17 D:\Programs\cygwin64\bin\cyglzo2-2.dll - os=4.0 img=0.0 sys=5.2
"cyglzo2-2.dll" v0.0 ts=2014-11-17 11:24
113k 2015/05/06 D:\Programs\cygwin64\bin\cygmagic-1.dll - os=4.0 img=0.0 sys=5.2
"cygmagic-1.dll" v0.0 ts=2015-05-06 08:05
168k 2015/04/17 D:\Programs\cygwin64\bin\cygman-2-7-1.dll - os=4.0 img=0.0 sys=5.2
"cygman-2-7-1.dll" v0.0 ts=2015-04-17 21:36
22k 2015/04/17 D:\Programs\cygwin64\bin\cygmandb-2-7-1.dll - os=4.0 img=0.0 sys=5.2
"cygmandb-2-7-1.dll" v0.0 ts=2015-04-17 21:36
29k 2015/04/13 D:\Programs\cygwin64\bin\cygmenuw-10.dll - os=4.0 img=0.0 sys=5.2
"cygmenuw-10.dll" v0.0 ts=2015-04-13 07:50
89k 2015/03/01 D:\Programs\cygwin64\bin\cygmpc-3.dll - os=4.0 img=0.0 sys=5.2
"cygmpc-3.dll" v0.0 ts=2015-03-01 20:24
334k 2015/01/26 D:\Programs\cygwin64\bin\cygmpfr-4.dll - os=4.0 img=0.0 sys=5.2
"cygmpfr-4.dll" v0.0 ts=2015-01-26 16:14
53k 2015/04/13 D:\Programs\cygwin64\bin\cygncurses++w-10.dll - os=4.0 img=0.0 sys=5.2
"cygncurses++w-10.dll" v0.0 ts=2015-04-13 07:56
301k 2015/04/13 D:\Programs\cygwin64\bin\cygncursesw-10.dll - os=4.0 img=0.0 sys=5.2
"cygncursesw-10.dll" v0.0 ts=2015-04-13 07:48
185k 2015/02/12 D:\Programs\cygwin64\bin\cygnettle-4.dll - os=4.0 img=0.0 sys=5.2
"cygnettle-4.dll" v0.0 ts=2015-02-12 17:27
220k 2014/10/19 D:\Programs\cygwin64\bin\cygp11-kit-0.dll - os=4.0 img=0.0 sys=5.2
"cygp11-kit-0.dll" v0.0 ts=2014-10-19 14:36
14k 2015/04/13 D:\Programs\cygwin64\bin\cygpanelw-10.dll - os=4.0 img=0.0 sys=5.2
"cygpanelw-10.dll" v0.0 ts=2015-04-13 07:49
460k 2015/04/30 D:\Programs\cygwin64\bin\cygpcre-1.dll - os=4.0 img=0.0 sys=5.2
"cygpcre-1.dll" v0.0 ts=2015-04-30 02:03
1581k 2015/02/17 D:\Programs\cygwin64\bin\cygperl5_14.dll - os=4.0 img=0.0 sys=5.2
"cygperl5_14.dll" v0.0 ts=2015-02-17 20:41
39k 2015/04/09 D:\Programs\cygwin64\bin\cygpipeline-1.dll - os=4.0 img=0.0 sys=5.2
"cygpipeline-1.dll" v0.0 ts=2015-04-09 21:04
1160k 2015/02/11 D:\Programs\cygwin64\bin\cygplot-2.dll - os=4.0 img=0.0 sys=5.2
"cygplot-2.dll" v0.0 ts=2015-02-11 21:12
179k 2015/04/13 D:\Programs\cygwin64\bin\cygpng16-16.dll - os=4.0 img=0.0 sys=5.2
"cygpng16-16.dll" v0.0 ts=2015-04-13 19:47
41k 2013/10/21 D:\Programs\cygwin64\bin\cygpopt-0.dll - os=4.0 img=0.0 sys=5.2
"cygpopt-0.dll" v0.0 ts=2013-10-21 21:52
305k 2015/03/02 D:\Programs\cygwin64\bin\cygquadmath-0.dll - os=4.0 img=0.0 sys=5.2
"cygquadmath-0.dll" v0.0 ts=2015-03-02 21:37
207k 2015/01/27 D:\Programs\cygwin64\bin\cygreadline7.dll - os=4.0 img=0.0 sys=5.2
"cygreadline7.dll" v0.0 ts=2015-01-27 03:51
97k 2014/11/24 D:\Programs\cygwin64\bin\cygsasl2-3.dll - os=4.0 img=0.0 sys=5.2
"cygsasl2-3.dll" v0.0 ts=2014-11-24 18:22
28k 2014/01/14 D:\Programs\cygwin64\bin\cygSM-6.dll - os=4.0 img=0.0 sys=5.2
"cygSM-6.dll" v0.0 ts=2014-01-14 23:23
89k 2015/03/23 D:\Programs\cygwin64\bin\cygsmartcols-1.dll - os=4.0 img=0.0 sys=5.2
"cygsmartcols-1.dll" v0.0 ts=2015-03-23 09:46
765k 2015/05/12 D:\Programs\cygwin64\bin\cygsqlite3-0.dll - os=4.0 img=0.0 sys=5.2
"cygsqlite3-0.dll" v0.0 ts=2015-05-11 15:46
143k 2015/03/17 D:\Programs\cygwin64\bin\cygssh2-1.dll - os=4.0 img=0.0 sys=5.2
"cygssh2-1.dll" v0.0 ts=2015-03-17 04:00
419k 2015/03/19 D:\Programs\cygwin64\bin\cygssl-1.0.0.dll - os=4.0 img=0.0 sys=5.2
"cygssl-1.0.0.dll" v0.0 ts=2015-03-19 16:49
12k 2015/03/02 D:\Programs\cygwin64\bin\cygssp-0.dll - os=4.0 img=0.0 sys=5.2
"cygssp-0.dll" v0.0 ts=2015-03-02 21:33
941k 2015/03/02 D:\Programs\cygwin64\bin\cygstdc++-6.dll - os=4.0 img=0.0 sys=5.2
"cygstdc++-6.dll" v0.0 ts=2015-03-02 20:57
66k 2015/04/23 D:\Programs\cygwin64\bin\cygtasn1-6.dll - os=4.0 img=0.0 sys=5.2
"cygtasn1-6.dll" v0.0 ts=2015-04-23 11:16
52k 2015/04/13 D:\Programs\cygwin64\bin\cygticw-10.dll - os=4.0 img=0.0 sys=5.2
"cygticw-10.dll" v0.0 ts=2015-04-13 07:48
73k 2015/02/11 D:\Programs\cygwin64\bin\cygusb0.dll - os=4.0 img=0.0 sys=5.2
"cygusb0.dll" v0.0 ts=2015-02-11 01:16
15k 2015/03/23 D:\Programs\cygwin64\bin\cyguuid-1.dll - os=4.0 img=0.0 sys=5.2
"cyguuid-1.dll" v0.0 ts=2015-03-23 09:46
1134k 2015/03/26 D:\Programs\cygwin64\bin\cygX11-6.dll - os=4.0 img=0.0 sys=5.2
"cygX11-6.dll" v0.0 ts=2015-03-26 15:14
12k 2013/06/06 D:\Programs\cygwin64\bin\cygXau-6.dll - os=4.0 img=0.0 sys=5.2
"cygXau-6.dll" v0.0 ts=2013-06-06 06:23
368k 2014/08/10 D:\Programs\cygwin64\bin\cygXaw-7.dll - os=4.0 img=0.0 sys=5.2
"cygXaw-7.dll" v0.0 ts=1970-01-01 00:00
102k 2014/05/20 D:\Programs\cygwin64\bin\cygxcb-1.dll - os=4.0 img=0.0 sys=5.2
"cygxcb-1.dll" v0.0 ts=1970-01-01 00:00
21k 2015/03/26 D:\Programs\cygwin64\bin\cygXdmcp-6.dll - os=4.0 img=0.0 sys=5.2
"cygXdmcp-6.dll" v0.0 ts=2015-03-26 15:38
56k 2014/08/10 D:\Programs\cygwin64\bin\cygXext-6.dll - os=4.0 img=0.0 sys=5.2
"cygXext-6.dll" v0.0 ts=1970-01-01 00:00
1207k 2014/10/19 D:\Programs\cygwin64\bin\cygxml2-2.dll - os=4.0 img=0.0 sys=5.2
"cygxml2-2.dll" v0.0 ts=2014-10-19 08:52
85k 2014/01/15 D:\Programs\cygwin64\bin\cygXmu-6.dll - os=4.0 img=0.0 sys=5.2
"cygXmu-6.dll" v0.0 ts=2014-01-15 02:27
59k 2014/01/15 D:\Programs\cygwin64\bin\cygXpm-4.dll - os=4.0 img=0.0 sys=5.2
"cygXpm-4.dll" v0.0 ts=2014-01-15 00:59
320k 2014/08/10 D:\Programs\cygwin64\bin\cygXt-6.dll - os=4.0 img=0.0 sys=5.2
"cygXt-6.dll" v0.0 ts=1970-01-01 00:00
80k 2014/11/19 D:\Programs\cygwin64\bin\cygz.dll - os=4.0 img=0.0 sys=5.2
"cygz.dll" v0.0 ts=2014-11-19 23:08
3256k 2015/05/08 D:\Programs\cygwin64\bin\cygwin1.dll - os=4.0 img=0.0 sys=5.2
"cygwin1.dll" v0.0 ts=2015-05-08 23:17
Cygwin DLL version info:
DLL version: 2.0.2
DLL epoch: 19
DLL old termios: 5
DLL malloc env: 28
Cygwin conv: 181
API major: 0
API minor: 287
Shared data: 5
DLL identifier: cygwin1
Mount registry: 3
Cygwin registry name: Cygwin
Installations name: Installations
Cygdrive default prefix:
Build date:
Shared id: cygwin1S5
No Cygwin services found.
Cygwin Package Information
Last downloaded files to: D:\[REDACTED]\_zZz_\Tools\cygwin
Last downloaded files from: ftp://ftp.hawo.stw.uni-erlangen.de/cygwin/
Package Version Status
_autorebase 001002-1 OK
_update-info-dir 00425-1 OK
alternatives 1.3.30c-10 OK
autoconf 13-1 OK
autoconf2.1 2.13-12 OK
autoconf2.5 2.69-3 OK
automake1.15 1.15-1 OK
base-cygwin 3.8-1 OK
base-files 4.2-3 OK
bash 4.3.33-1 OK
bash-completion 1.3-1 OK
bc 1.06.95-2 OK
bcrypt 1.1-3 OK
binutils 2.25-1 OK
bsdtar 3.1.2-2 OK
bvi 1.3.2-3 OK
bzip2 1.0.6-2 OK
ca-certificates 2.3-1 OK
cmake 3.1.2-1 OK
cmake-doc 3.1.2-1 OK
colordiff 1.0.9-1 OK
coreutils 8.23-4 OK
csih 0.9.8-6 OK
cygrunsrv 1.62-1 OK
cygutils 1.4.14-1 OK
cygwin 2.0.2-1 OK
cygwin-debuginfo 2.0.2-1 OK
cygwin-devel 2.0.2-1 OK
dash 0.5.8-3 OK
diffutils 3.3-2 OK
dos2unix 7.2.1-1 OK
editrights 1.03-1 OK
file 5.22-2 OK
findutils 4.5.12-1 OK
gamin 0.1.10-15 OK
gawk 4.1.1-1 OK
gcc-core 4.9.2-3 OK
gcc-g++ 4.9.2-3 OK
gdb 7.8-2 OK
getent 2.18.90-4 OK
gnupg 1.4.19-2 OK
grep 2.21-2 OK
groff 1.22.3-1 OK
gsettings-desktop-schemas 3.14.1-1 OK
gzip 1.6-1 OK
hexedit 1.2.13-2 OK
hostname 3.13-1 OK
info 5.2-3 OK
ipc-utils 1.0-2 OK
less 458-2 OK
libarchive13 3.1.2-2 OK
libargp 20110921-2 OK
libatomic1 4.9.2-3 OK
libattr1 2.4.46-1 OK
libblkid1 2.25.2-2 OK
libbz2_1 1.0.6-2 OK
libcatgets1 1.1-2 OK
libcloog-isl4 0.18.0-2 OK
libcom_err2 1.42.12-2 OK
libcrypt0 1.1-1 OK
libcurl4 7.42.1-1 OK
libdb5.3 5.3.21-1 OK
libedit0 20130712-1 OK
libexpat1 2.1.0-3 OK
libext2fs2 1.42.12-2 OK
libfam0 0.1.10-15 OK
libffi6 3.2.1-1 OK
libgcc1 4.9.2-3 OK
libgdbm4 1.11-1 OK
libglib2.0_0 2.42.2-1 OK
libgmp10 6.0.0a-2 OK
libgnutls28 3.2.21-1 OK
libgomp1 4.9.2-3 OK
libgssapi_krb5_2 1.13.1-1 OK
libguile17 1.8.8-1 OK
libhogweed2 2.7-2 OK
libICE6 1.0.9-1 OK
libiconv 1.14-3 OK
libiconv2 1.14-3 OK
libidn11 1.29-1 OK
libintl8 0.19.4-1 OK
libisl10 0.11.1-2 OK
libk5crypto3 1.13.1-1 OK
libkrb5_3 1.13.1-1 OK
libkrb5support0 1.13.1-1 OK
libltdl7 2.4.6-1 OK
liblzma5 5.2.1-1 OK
liblzo2_2 2.08-1 OK
libmpc3 1.0.3-1 OK
libmpfr4 3.1.2-2 OK
libncursesw10 5.9-20150404-1 OK
libnettle4 2.7-2 OK
libopenldap2_4_2 2.4.40-2 OK
libopenssl100 1.0.2a-1 OK
libp11-kit0 0.20.7-1 OK
libpcre1 8.37-1 OK
libpipeline1 1.4.0-1 OK
libplot2 2.6-4 OK
libpng16 1.6.17-1 OK
Empty package libpopt0
libpopt0 1.16-1 OK
libquadmath0 4.9.2-3 OK
libreadline7 6.3.8-1 OK
libsasl2_3 2.1.26-9 OK
libSM6 1.2.2-1 OK
libsmartcols1 2.25.2-2 OK
libsqlite3_0 3.8.10.1-1 OK
libssh2_1 1.5.0-1 OK
libssp0 4.9.2-3 OK
libstdc++6 4.9.2-3 OK
libtasn1_6 4.4-1 OK
libusb0 1.2.6.0-2 OK
libuuid-devel 2.25.2-2 OK
libuuid1 2.25.2-2 OK
libX11_6 1.6.3-1 OK
libXau6 1.0.8-1 OK
libXaw7 1.0.12-2 OK
libxcb1 1.10-1 OK
libXdmcp6 1.1.2-1 OK
libXext6 1.3.3-1 OK
libxml2 2.9.2-1 OK
libXmu6 1.1.2-1 OK
libXpm4 3.5.11-1 OK
libXt6 1.1.4-2 OK
links 2.8-2 OK
login 1.11-1 OK
lynx 2.8.7-2 OK
lzip 1.14-1 OK
m4 1.4.17-1 OK
make 4.1-1 OK
man-db 2.7.1-1 OK
mc 4.8.14-1 OK
mintty 1.2-beta1-1 OK
nc 1.107-4 OK
nc6 1.0-1 OK
ncurses 5.9-20150404-1 OK
ncurses-demo 5.9-20150404-1 OK
openssh 6.8p1-1 OK
openssh-debuginfo 6.8p1-1 OK
openssl 1.0.2a-1 OK
openssl-devel 1.0.2a-1 OK
p11-kit 0.20.7-1 OK
p11-kit-trust 0.20.7-1 OK
p7zip 9.20.1-1 OK
patch 2.7.4-1 OK
patchutils 0.3.3-1 OK
perl 5.14.4-3 OK
perl-Carp 1.3301-2 OK
perl-TimeDate 2.30-1 OK
perl_autorebase 5.14.4-3 OK
perl_base 5.14.4-3 OK
ping 1.0.2-1 OK
plotutils 2.6-4 OK
popt 1.16-1 OK
pv 1.4.12-1 OK
python 2.7.9-1 OK
rebase 4.4.1-1 OK
rsync 3.1.1-1 OK
run 1.3.3-1 OK
sed 4.2.2-3 OK
shared-mime-info 1.3-3 OK
tar 1.27.1-1 OK
tcsh 6.18.01-6 OK
terminfo 5.9-20150404-1 OK
texinfo 5.2-3 OK
tzcode 2014j-1 OK
unzip 6.0-14 OK
util-linux 2.25.2-2 OK
vim 7.4.726-1 OK
vim-common 7.4.726-1 OK
vim-minimal 7.4.726-1 OK
w32api-headers 4.0.2-1 OK
w32api-runtime 4.0.2-1 OK
wdiff 1.2.2-1 OK
wget 1.16.3-1 OK
which 2.20-2 OK
windows-default-manifest 6.4-1 OK
wput 0.6.2+git20130413-1 OK
xxd 7.4.726-1 OK
xz 5.2.1-1 OK
zip 3.0-12 OK
zlib-devel 1.2.8-3 OK
zlib0 1.2.8-3 OK
Use -h to see help about each section
[-- Attachment #3: Type: text/plain, Size: 218 bytes --]
--
Problem reports: http://cygwin.com/problems.html
FAQ: http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2015-06-12 13:14 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-06-01 15:03 cygwin on W7: stalled scp (openssh-6.8p1), lost ssh-scp-pipe data Theodor.Kazhan
2015-06-01 18:54 ` Corinna Vinschen
2015-06-01 18:59 ` Corinna Vinschen
-- strict thread matches above, loose matches on Subject: below --
2015-06-12 12:59 Re: " Theodor.Kazhan
2015-06-12 13:14 ` Marco Atzeri
2015-05-22 9:13 Theodor.Kazhan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).