* [1.7] Pipes intermittently lose data on Cygwin 1.7 @ 2008-12-20 9:15 Lawrence Mayer 2008-12-20 20:31 ` Lawrence Mayer 0 siblings, 1 reply; 14+ messages in thread From: Lawrence Mayer @ 2008-12-20 9:15 UTC (permalink / raw) To: cygwin Pipes intermittently lose data on Cygwin 1.7.0-35 and -36. This bug appears generic to pipes under Cygwin 1.7 and not limited to any particular app. To reproduce this bug, create a ~ 5 MB text file foo. tr \32 \0 < foo | tr \0 \32 > bar should make bar = foo. But intermittently, bar is truncated and missing the end of foo. You can quickly tell by monitoring the file sizes: intermittently bar is smaller than foo. The bug appears generic to pipes under Cygwin 1.7, e.g. sed s/\x1a/\x0/ foo | sed s/\x0/\x1a/ > bar sort foo | tr \32 \0 > bar cat foo | tr \32 \0 > bar tac foo | tac > bar cat foo | cat | cat > bar all cause intermittent loss of data, where bar is sometimes truncated and missing the end of foo (or beginning of foo in tac example). (The last example contains 2 pipes, since cat foo | cat > bar appears more resistant to this bug and only occasionally loses data.) This bug is difficult to reproduce on my system when foo < ~ 3 MB. Hence the recommendation above for foo ~ 5 MB. This bug is present in Cygwin 1.7.0-35 and 1.7.0-36. I have not tested earlier 1.7 builds. This bug appears new to Cygwin 1.7 and not present in Cygwin 1.5.25-15. Greetings, Lawrence Versions tested: Cygwin 1.7.0-36 and 1.7.0-35 with coreutils 7.0-2 and sed 4.1.5-2 Cygwin 1.5.25-15 with coreutils 6.10-2 and sed 4.1.5-2 OS: Windows Server 2003 sp2 32-bit. Cygwin installed on NTFS drive C:. -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-20 9:15 [1.7] Pipes intermittently lose data on Cygwin 1.7 Lawrence Mayer @ 2008-12-20 20:31 ` Lawrence Mayer 2008-12-22 17:32 ` Christopher Faylor 0 siblings, 1 reply; 14+ messages in thread From: Lawrence Mayer @ 2008-12-20 20:31 UTC (permalink / raw) To: cygwin This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to work fine. As mentioned in my previous post, this bug appears new to Cygwin 1.7 and not present in Cygwin 1.5.25-15. Greetings, Lawrence -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-20 20:31 ` Lawrence Mayer @ 2008-12-22 17:32 ` Christopher Faylor 2008-12-22 18:32 ` Lawrence Mayer 0 siblings, 1 reply; 14+ messages in thread From: Christopher Faylor @ 2008-12-22 17:32 UTC (permalink / raw) To: cygwin On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote: > This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or > command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to > work fine. This may be fixed in the current Cygwin snapshot. I think I closed up a couple of race conditions there. http://cygwin.com/snapshots/ cgf -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 17:32 ` Christopher Faylor @ 2008-12-22 18:32 ` Lawrence Mayer 2008-12-22 18:47 ` Christopher Faylor 0 siblings, 1 reply; 14+ messages in thread From: Lawrence Mayer @ 2008-12-22 18:32 UTC (permalink / raw) To: cygwin > On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote: >> This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or >> command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to >> work fine. On 081222 09:31, Christopher Faylor wrote: > This may be fixed in the current Cygwin snapshot. I think I closed up a > couple of race conditions there. > > http://cygwin.com/snapshots/ > > cgf Not yet. The bug is still present in the current snapshot cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for responding to my post. Holiday Greetings, Lawrence -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 18:32 ` Lawrence Mayer @ 2008-12-22 18:47 ` Christopher Faylor 2008-12-22 20:07 ` Lawrence Mayer 0 siblings, 1 reply; 14+ messages in thread From: Christopher Faylor @ 2008-12-22 18:47 UTC (permalink / raw) To: cygwin On Mon, Dec 22, 2008 at 10:31:50AM -0800, Lawrence Mayer wrote: >> On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote: >>> This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or >>> command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to >>> work fine. > > > On 081222 09:31, Christopher Faylor wrote: >> This may be fixed in the current Cygwin snapshot. I think I closed up a >> couple of race conditions there. >> >> http://cygwin.com/snapshots/ >> >> cgf > > Not yet. The bug is still present in the current snapshot > cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for > responding to my post. Too bad. Since I can't duplicate the problem it will be difficult to fix it. It would be helpful if you provided more information like the cygcheck information requested in http://cygwin.com/problems.html. It would also be interesting to see the actual file sizes of foo and bar from your example. If they always vary in a consistent way that would be a clue. cgf -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 18:47 ` Christopher Faylor @ 2008-12-22 20:07 ` Lawrence Mayer 2008-12-22 22:41 ` Christopher Faylor 2008-12-23 0:49 ` Allan Schrum 0 siblings, 2 replies; 14+ messages in thread From: Lawrence Mayer @ 2008-12-22 20:07 UTC (permalink / raw) To: cygwin [-- Attachment #1: Type: text/plain, Size: 1874 bytes --] >> Not yet. The bug is still present in the current snapshot >> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for >> responding to my post. On 081222 10:47, Christopher Faylor wrote: > Too bad. Since I can't duplicate the problem it will be difficult to > fix it. Have you tried running the examples I provided in my original post (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)? I suggest running each example (in a DOS shell) at least 10 times, comparing the file sizes of foo and bar each time. On my system, size of bar < size of foo roughly 25-75% of the time. > It would be helpful if you provided more information like the cygcheck > information requested in http://cygwin.com/problems.html. Please see attached the output cygcheck -s -v -r > cygcheck.out. I ran cygcheck on the current snapshot cygwin-inst-20081220.tar.bz2. It would also > be interesting to see the actual file sizes of foo and bar from your > example. If they always vary in a consistent way that would be a clue. File sizes from latest test I ran (Example 1 of my original post) tr \32 \0 < foo | tr \0 \32 > bar on current snapshot cygwin-inst-20081220.tar.bz: foo = 5,138,895 bytes bar1 (runs 1-4, 6-7, 9-10) = 5,132,288 bytes bar2 (runs 5 and 8) = 5,136,384 bytes As you can see, there is some consistency. When I ran the above test 10 consecutive times, there were only two types of output. On 8/10 runs, bar was missing the same 6,607 (5,138,895 - 5,132,288) byte chunk. On the remaining 2/10 runs, bar was missing the same 2,511 byte chunk. As mentioned in my original post, the missing chunk is always at the end (or beginning in the tac example) of bar. It's as if the pipe exits too early, before all the data can make it through. I'm attaching foo, bar1, and bar2 from the above example (compressed with 7zip). Greetings, Lawrence [-- Attachment #2: cygcheck.out --] [-- Type: text/plain, Size: 12412 bytes --] Cygwin Configuration Diagnostics Current System Time: Mon Dec 22 11:02:06 2008 Windows 2003 Server Enterprise Edition Ver 5.2 Build 3790 Service Pack 2 Path: C:\OS1\system32 C:\OS1 C:\app\Microsoft\DbgTools C:\app\Microsoft\RKTools C:\app\Microsoft\STools C:\app\Microsoft\WDK C:\app\CLI C:\app\Westlake C:\app\Cygwin\bin C:\app\Gnu C:\app\Ch\bin C:\app\Common C:\app\Sysint C:\app\p-nand-q C:\app\Unlocker C:\app\WinRAR C:\app\7-Zip C:\app\UniExtract\bin C:\app\GTK\2.0\bin D:\computer\Install Output from C:\App\cygwin\bin\id.exe (nontsec) UID: 500(Administrator) GID: 513(None) 0(root) 544(Administrators) 545(Users) 513(None) Output from C:\App\cygwin\bin\id.exe (ntsec) UID: 500(Administrator) GID: 513(None) 0(root) 544(Administrators) 545(Users) 513(None) SysDir: C:\OS1\system32 WinDir: C:\OS1 CYGWIN = 'nodosfilewarning glob:ignorecase nontsec' Path = 'C:\OS1\system32;C:\OS1;C:\app\Microsoft\DbgTools;C:\app\Microsoft\RKTools;C:\app\Microsoft\STools;C:\app\Microsoft\WDK;C:\app\CLI;C:\app\Westlake;C:\app\Cygwin\bin;C:\app\Gnu;C:\app\Ch\bin;C:\app\Common;C:\app\Sysint;C:\app\p-nand-q;C:\app\Unlocker;C:\app\WinRAR;C:\app\7-Zip;C:\app\UniExtract\bin;C:\app\GTK\2.0\bin;D:\computer\Install' -10 = 'C:\OS1' -10a = 'C:\OS1\WinSxS' -10aa = 'C:\OS1\WinSxS\Manifests' -10ab = 'C:\OS1\WinSxS\Policies' -11 = 'C:\OS1\system32' -12 = 'C:\OS1\system32\drivers' -16422 = 'C:\OS1\Msi' -16427 = 'C:\OS1\Msi\Common' -16427a = 'C:\OS1\Msi\Common\Microsoft Shared' -17 = 'C:\OS1\inf' -18 = 'C:\OS1\Help' -20 = 'C:\OS1\Fonts' -24 = 'C:\' -52 = 'C:\OS1\system32\spool\drivers' ALLUSERSPROFILE = 'C:\OS1\Profiles\All Users' APPDATA = 'C:\data\appdata' CommonProgramFiles = 'C:\OS1\Msi\Common' COMPUTERNAME = 'AK31' ComSpec = 'C:\OS1\system32\cmd.exe' devmgr_show_nonpresent_devices = '1' FP_NO_HOST_CHECK = 'NO' GTKMM_BASEPATH = 'C:\app\GTK\2.0' GTK_BASEPATH = 'C:\app\GTK\2.0' HOMEDRIVE = 'C:' HOMEPATH = '\' LOGONSERVER = '\\AK31' NUMBER_OF_PROCESSORS = '1' OS = 'Windows_NT' PATHEXT = '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.CH' PROCESSOR_ARCHITECTURE = 'x86' PROCESSOR_IDENTIFIER = 'x86 Family 6 Model 8 Stepping 1, AuthenticAMD' PROCESSOR_LEVEL = '6' PROCESSOR_REVISION = '0801' ProgramFiles = 'C:\OS1\Msi' PROMPT = '$P$G' SystemDrive = 'C:' SystemRoot = 'C:\OS1' TEMP = 'C:\tmpdir\Temp' TMP = 'C:\tmpdir\Temp' USERDOMAIN = 'AK31' USERNAME = 'Administrator' USERPROFILE = 'C:\OS1\Profiles\Administrator' windir = 'C:\OS1' HKEY_CURRENT_USER\Software\Cygnus Solutions HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin\mounts v2 HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin\Program Options HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2 (default) = '/' cygdrive flags = 0x00000022 HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/ (default) = 'C:\App\cygwin' flags = 0x0000000a HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/usr/bin (default) = 'C:\App\cygwin/bin' flags = 0x0000000a HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/usr/lib (default) = 'C:\App\cygwin/lib' flags = 0x0000000a HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\Program Options a: fd N/A N/A c: hd NTFS 5004Mb 36% CP CS UN PA FC NT52 d: hd NTFS 65185Mb 21% CP CS UN PA FC User C:/App/cygwin / system binmode,noacl,posix=0 C:\App\cygwin\bin /usr/bin system binmode,noacl,posix=0 C:\App\cygwin\lib /usr/lib system binmode,noacl,posix=0 . / user binmode,cygdrive,noacl,posix=0 Found: C:\app\Cygwin\bin\awk.exe -> C:\App\cygwin\bin\gawk.exe Found: C:\app\Cygwin\bin\bash.exe Found: C:\app\Cygwin\bin\cat.exe Found: C:\app\Cygwin\bin\cp.exe Not Found: cpp (good!) Not Found: crontab Found: C:\OS1\system32\find.exe Found: C:\app\Cygwin\bin\find.exe Warning: C:\OS1\system32\find.exe hides C:\app\Cygwin\bin\find.exe Not Found: gcc Not Found: gdb Found: C:\app\Cygwin\bin\grep.exe Found: C:\app\Microsoft\DbgTools\kill.exe Found: C:\app\Cygwin\bin\kill.exe Warning: C:\app\Microsoft\DbgTools\kill.exe hides C:\app\Cygwin\bin\kill.exe Found: C:\app\Cygwin\bin\ld.exe Found: C:\app\Cygwin\bin\ls.exe Found: C:\app\Cygwin\bin\make.exe Found: C:\app\Cygwin\bin\mv.exe Found: C:\app\Cygwin\bin\patch.exe Found: C:\app\Cygwin\bin\perl.exe Found: C:\app\Cygwin\bin\rm.exe Found: C:\app\Cygwin\bin\sed.exe Not Found: ssh Found: C:\app\Cygwin\bin\sh.exe Found: C:\app\Cygwin\bin\tar.exe Found: C:\app\Cygwin\bin\test.exe Found: C:\app\Ch\bin\vi.exe Found: C:\app\Ch\bin\vim.exe 61k 2008/04/01 C:\app\Cygwin\bin\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0 "cygbz2-1.dll" v0.0 ts=2008/3/31 20:37 7k 2003/10/19 C:\app\Cygwin\bin\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0 "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57 1064k 2008/09/30 C:\app\Cygwin\bin\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27 221k 2007/06/30 C:\app\Cygwin\bin\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0 "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54 943k 2007/12/17 C:\app\Cygwin\bin\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12 1296k 2007/12/17 C:\app\Cygwin\bin\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12 118k 2008/05/09 C:\app\Cygwin\bin\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0 "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03 40k 2006/11/15 C:\app\Cygwin\bin\cygform-8.dll - os=4.0 img=1.0 sys=4.0 "cygform-8.dll" v0.0 ts=2006/11/14 23:06 19k 2006/11/19 C:\app\Cygwin\bin\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18 8k 2006/11/19 C:\app\Cygwin\bin\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18 219k 2008/10/04 C:\app\Cygwin\bin\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48 288k 2008/10/04 C:\app\Cygwin\bin\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48 24k 2008/11/29 C:\app\Cygwin\bin\cyghistory6.dll - os=4.0 img=1.0 sys=4.0 "cyghistory6.dll" v0.0 ts=2008/11/29 6:30 271k 2007/08/24 C:\app\Cygwin\bin\cygicons-0.dll - os=4.0 img=1.0 sys=4.0 "cygicons-0.dll" v0.0 ts=2007/8/24 0:24 978k 2008/11/10 C:\app\Cygwin\bin\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0 "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35 37k 2003/08/10 C:\app\Cygwin\bin\cygintl-2.dll - os=4.0 img=1.0 sys=4.0 "cygintl-2.dll" v0.0 ts=2003/8/10 14:50 31k 2005/11/20 C:\app\Cygwin\bin\cygintl-3.dll - os=4.0 img=1.0 sys=4.0 "cygintl-3.dll" v0.0 ts=2005/11/19 18:04 31k 2008/11/10 C:\app\Cygwin\bin\cygintl-8.dll - os=4.0 img=1.0 sys=4.0 "cygintl-8.dll" v0.0 ts=2008/11/9 17:32 5k 2008/12/21 C:\app\Cygwin\bin\cyglsa.dll - os=4.0 img=1.0 sys=4.0 "cyglsa.dll" v0.0 ts=2008/12/20 18:28 9k 2008/12/21 C:\app\Cygwin\bin\cyglsa64.dll - os=4.0 img=0.0 sys=5.2 83k 2007/06/06 C:\app\Cygwin\bin\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0 "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41 21k 2006/11/15 C:\app\Cygwin\bin\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0 "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05 121k 2008/10/04 C:\app\Cygwin\bin\cygmp-3.dll - os=4.0 img=1.0 sys=4.0 "cygmp-3.dll" v0.0 ts=2008/10/4 16:48 67k 2006/11/15 C:\app\Cygwin\bin\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13 237k 2006/11/15 C:\app\Cygwin\bin\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02 12k 2006/11/15 C:\app\Cygwin\bin\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0 "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04 181k 2008/09/07 C:\app\Cygwin\bin\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36 302k 2008/09/07 C:\app\Cygwin\bin\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36 7k 2008/09/07 C:\app\Cygwin\bin\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36 1543k 2008/07/03 C:\app\Cygwin\bin\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0 "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06 22k 2002/06/09 C:\app\Cygwin\bin\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0 "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45 155k 2008/11/29 C:\app\Cygwin\bin\cygreadline6.dll - os=4.0 img=1.0 sys=4.0 "cygreadline6.dll" v0.0 ts=2008/11/29 6:30 118k 2007/06/27 C:\app\Cygwin\bin\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0 "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56 218k 2008/09/30 C:\app\Cygwin\bin\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28 65k 2006/10/16 C:\app\Cygwin\bin\cygz.dll - os=4.0 img=1.0 sys=4.0 "cygz.dll" v0.0 ts=2006/10/15 18:10 2358k 2008/12/21 C:\app\Cygwin\bin\cygwin1.dll - os=4.0 img=1.0 sys=4.0 "cygwin1.dll" v0.0 ts=2008/12/20 18:28 Cygwin DLL version info: DLL version: 1.7.0 DLL epoch: 19 DLL old termios: 5 DLL malloc env: 28 API major: 0 API minor: 190 Shared data: 5 DLL identifier: cygwin1 Mount registry: 3 Cygwin registry name: Cygwin Program options name: Program Options Cygdrive default prefix: Build date: Sat Dec 20 21:28:21 EST 2008 Snapshot date: 20081220-21:25:00 Shared id: cygwin1S5 Can't find the cygrunsrv utility, skipping services check. Cygwin Package Information Last downloaded files to: D:\computer\Install\AppsToCopy\cygwin Last downloaded files from: http://sources-redhat.mirror.redwire.net/cygwin/ Package Version _update-info-dir 00788-1 alternatives 1.3.30c-2 arc 5.21m-1 ash 20040127-4 astyle 1.22-2 base-cygwin 1.1-1 base-files 3.7-1 base-passwd 2.2-1 bash 3.2.48-21 bashdb 3.1_0.09-1 binutils 20080624-2 bzip2 1.0.5-2 coreutils 7.0-2 crypt 1.1-1 curl 7.16.3-1 cygutils 1.3.2-1 cygwin 1.7.0-36 cygwin-doc 1.5-1 diffutils 2.8.7-1 e2fsprogs 1.35-3 editrights 1.01-2 expat 2.0.1-1 file 4.21-1 findutils 4.5.3-1 gawk 3.1.6-1 grep 2.5.3-1 groff 1.19.2-2 gzip 1.3.12-2 indent 2.2.9-2 ipc-utils 1.0-1 less 382-1 libbz2_1 1.0.5-2 libcurl4 7.16.3-1 libdb4.5 4.5.20.2-2 libexpat1 2.0.1-1 libexpat1-devel 2.0.1-1 libgdbm4 1.8.3-8 libgmp3 4.2.4-1 libiconv2 1.12-1 libintl2 0.12.1-3 libintl3 0.14.5-1 libintl8 0.17-1 libncurses-devel 5.5-3 libncurses8 5.5-3 libpcre0 7.8-1 libpopt0 1.6.4-4 libreadline6 5.2.13-11 libssh2_1 0.15-1 login 1.9-8 make 3.81-2 man 1.6e-1 openssl 0.9.8i-1 patch 2.5.8-9 perl 5.10.0-5 readline 5.2.13-11 rebase 2.4.4-1 rsync 3.0.4-1 run 1.1.10-1 sed 4.1.5-2 tar 1.20-2 termcap 20050421-1 terminfo 5.5_20061104-1 texinfo 4.8a-1 time 1.7-2 tzcode 2008h-1 unzip 5.52-2 util-linux 2.13.1-2 wget 1.11.4-2 which 2.19-1 zlib 1.2.3-2 zsh 4.3.9-1 Use -h to see help about each section [-- Attachment #3: foobar.7z --] [-- Type: application/octet-stream, Size: 103406 bytes --] [-- Attachment #4: Type: text/plain, Size: 218 bytes --] -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 20:07 ` Lawrence Mayer @ 2008-12-22 22:41 ` Christopher Faylor 2008-12-23 0:28 ` Lawrence Mayer 2008-12-23 0:49 ` Allan Schrum 1 sibling, 1 reply; 14+ messages in thread From: Christopher Faylor @ 2008-12-22 22:41 UTC (permalink / raw) To: cygwin On Mon, Dec 22, 2008 at 12:06:16PM -0800, Lawrence Mayer wrote: >>> Not yet. The bug is still present in the current snapshot >>> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for >>> responding to my post. > >On 081222 10:47, Christopher Faylor wrote: >>Too bad. Since I can't duplicate the problem it will be difficult to >>fix it. > >Have you tried running the examples I provided in my original post >(with foo = ~ 5MB text file) on a DOS shell (cmd.exe)? Yes. That's what I meant by "I can't duplicate the problem". >I suggest running each example (in a DOS shell) at least 10 times, >comparing the file sizes of foo and bar each time. On my system, size >of bar < size of foo roughly 25-75% of the time. I ran it, in a loop, thousands of times, throughout the day on Sunday. > I'm attaching foo, bar1, and bar2 from the above example (compressed with > 7zip). Urk. There was no need to spam thousands of people with something like this. If I needed the data I would have asked that you send it just to me. cgf -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 22:41 ` Christopher Faylor @ 2008-12-23 0:28 ` Lawrence Mayer 2008-12-23 19:00 ` Christopher Faylor 0 siblings, 1 reply; 14+ messages in thread From: Lawrence Mayer @ 2008-12-23 0:28 UTC (permalink / raw) To: cygwin [-- Attachment #1: Type: text/plain, Size: 1368 bytes --] >>> Too bad. Since I can't duplicate the problem it will be difficult to >>> fix it. >> Have you tried running the examples I provided in my original post >> (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)? > Yes. That's what I meant by "I can't duplicate the problem". Just ran current snapshot cygwin-inst-20081220 on a different computer running a different OS: Windows XP Home sp2 32 bit on NTFS. See attached output from cygcheck. Both this and the previous computer have Athlon XP+ CPUs. Running a DOS window (cmd.exe) with Example 1 of my original post tr \32 \0 < foo | tr \0 \32 > bar using the same input file foo attached to my previous post gives: foo = 5,138,895 bytes bar = 5,132,288 bytes I ran the test twice and got identical output. Moreover, (output) bar on this computer was identical to (output) bar1 (attached to my previous post) obtained on the other computer (running Windows Server 2003 sp2 32 bit on NTFS.) With identical output I mean binary identical, not just identical file size. Thus, there is some consistency to this bug even between different computers running different versions of Windows. Not complete consistency though, as noted in my previous post: sometimes output was bar2 not bar1. And on some runs the bug doesn't appear at all, and output size = input size. Greetings, Lawrence [-- Attachment #2: cygcheck.out --] [-- Type: text/plain, Size: 12745 bytes --] Cygwin Configuration Diagnostics Current System Time: Mon Dec 22 16:06:58 2008 Windows XP Home Edition Ver 5.1 Build 2600 Service Pack 2 Path: C:\WINDOWS\system32 C:\WINDOWS C:\WINDOWS\System32\Wbem C:\Program Files\ATI Technologies\ATI Control Panel SysDir: C:\WINDOWS\system32 WinDir: C:\WINDOWS Path = 'C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\ATI Technologies\ATI Control Panel' ALLUSERSPROFILE = 'C:\Documents and Settings\All Users' APPDATA = 'C:\Documents and Settings\Samuel\Application Data' CLIENTNAME = 'Console' CommonProgramFiles = 'C:\Program Files\Common Files' COMPUTERNAME = 'SYSTEM' ComSpec = 'C:\WINDOWS\system32\cmd.exe' devmgr_show_nonpresent_devices = '1' FP_NO_HOST_CHECK = 'NO' HOMEDRIVE = 'C:' HOMEPATH = '\Documents and Settings\Samuel' LOGONSERVER = '\\SYSTEM' NUMBER_OF_PROCESSORS = '1' OS = 'Windows_NT' PATHEXT = '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH' PROCESSOR_ARCHITECTURE = 'x86' PROCESSOR_IDENTIFIER = 'x86 Family 6 Model 10 Stepping 0, AuthenticAMD' PROCESSOR_LEVEL = '6' PROCESSOR_REVISION = '0a00' ProgramFiles = 'C:\Program Files' PROMPT = '$P$G' SESSIONNAME = 'Console' SystemDrive = 'C:' SystemRoot = 'C:\WINDOWS' TEMP = 'D:\Temp' TMP = 'D:\Temp' USERDOMAIN = 'SYSTEM' USERNAME = 'Samuel' USERPROFILE = 'C:\Documents and Settings\Samuel' windir = 'C:\WINDOWS' a: fd N/A N/A c: hd NTFS 4502Mb 95% CP CS UN PA FC XPCore d: hd NTFS 1004Mb 13% CP CS UN PA FC XPTemp e: hd NTFS 32655Mb 44% CP CS UN PA FC User f: hd NTFS 19539Mb 66% CP CS UN PA FC 19GDisk g: cd CDFS 467Mb 100% CS UN OFFICE12 h: cd N/A N/A i: fd FAT 1927Mb 1% CP UN C:/App/cygwin / system binmode,noacl,posix=0 C:\App\cygwin\bin /usr/bin system binmode,noacl,posix=0 C:\App\cygwin\lib /usr/lib system binmode,noacl,posix=0 . / user binmode,cygdrive,noacl,posix=0 Not Found: awk Not Found: bash Not Found: cat Not Found: cp Not Found: cpp (good!) Not Found: crontab Found: C:\WINDOWS\system32\find.exe Not Found: gcc Not Found: gdb Not Found: grep Not Found: kill Not Found: ld Not Found: ls Not Found: make Not Found: mv Not Found: patch Not Found: perl Not Found: rm Found: C:\WINDOWS\sed.exe Not Found: ssh Not Found: sh Not Found: tar Not Found: test Not Found: vi Not Found: vim 61k 2008/04/01 .\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0 "cygbz2-1.dll" v0.0 ts=2008/3/31 19:37 7k 2003/10/19 .\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0 "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57 1064k 2008/09/30 .\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27 221k 2007/06/30 .\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0 "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54 943k 2007/12/17 .\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12 1296k 2007/12/17 .\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12 118k 2008/05/09 .\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0 "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03 40k 2006/11/15 .\cygform-8.dll - os=4.0 img=1.0 sys=4.0 "cygform-8.dll" v0.0 ts=2006/11/14 23:06 19k 2006/11/19 .\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18 8k 2006/11/19 .\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18 219k 2008/10/04 .\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48 288k 2008/10/04 .\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48 24k 2008/11/29 .\cyghistory6.dll - os=4.0 img=1.0 sys=4.0 "cyghistory6.dll" v0.0 ts=2008/11/29 6:30 271k 2007/08/24 .\cygicons-0.dll - os=4.0 img=1.0 sys=4.0 "cygicons-0.dll" v0.0 ts=2007/8/24 0:24 978k 2008/11/10 .\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0 "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35 37k 2003/08/10 .\cygintl-2.dll - os=4.0 img=1.0 sys=4.0 "cygintl-2.dll" v0.0 ts=2003/8/10 14:50 31k 2005/11/20 .\cygintl-3.dll - os=4.0 img=1.0 sys=4.0 "cygintl-3.dll" v0.0 ts=2005/11/19 18:04 31k 2008/11/10 .\cygintl-8.dll - os=4.0 img=1.0 sys=4.0 "cygintl-8.dll" v0.0 ts=2008/11/9 17:32 5k 2008/12/21 .\cyglsa.dll - os=4.0 img=1.0 sys=4.0 "cyglsa.dll" v0.0 ts=2008/12/20 18:28 9k 2008/12/21 .\cyglsa64.dll - os=4.0 img=0.0 sys=5.2 83k 2007/06/06 .\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0 "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41 21k 2006/11/15 .\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0 "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05 121k 2008/10/04 .\cygmp-3.dll - os=4.0 img=1.0 sys=4.0 "cygmp-3.dll" v0.0 ts=2008/10/4 16:48 67k 2006/11/15 .\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13 237k 2006/11/15 .\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02 12k 2006/11/15 .\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0 "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04 181k 2008/09/07 .\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36 302k 2008/09/07 .\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36 7k 2008/09/07 .\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36 1543k 2008/07/03 .\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0 "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06 22k 2002/06/09 .\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0 "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45 155k 2008/11/29 .\cygreadline6.dll - os=4.0 img=1.0 sys=4.0 "cygreadline6.dll" v0.0 ts=2008/11/29 6:30 118k 2007/06/27 .\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0 "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56 218k 2008/09/30 .\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28 65k 2006/10/16 .\cygz.dll - os=4.0 img=1.0 sys=4.0 "cygz.dll" v0.0 ts=2006/10/15 18:10 2358k 2008/12/21 .\cygwin1.dll - os=4.0 img=1.0 sys=4.0 "cygwin1.dll" v0.0 ts=2008/12/20 18:28 Cygwin DLL version info: DLL version: 1.7.0 DLL epoch: 19 DLL old termios: 5 DLL malloc env: 28 API major: 0 API minor: 190 Shared data: 5 DLL identifier: cygwin1 Mount registry: 3 Cygwin registry name: Cygwin Program options name: Program Options Cygdrive default prefix: Build date: Sat Dec 20 21:28:21 EST 2008 Snapshot date: 20081220-21:25:00 Shared id: cygwin1S5 61k 2008/04/01 E:\Larry\cygwin\bin\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0 "cygbz2-1.dll" v0.0 ts=2008/3/31 19:37 7k 2003/10/19 E:\Larry\cygwin\bin\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0 "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57 1064k 2008/09/30 E:\Larry\cygwin\bin\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27 221k 2007/06/30 E:\Larry\cygwin\bin\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0 "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54 943k 2007/12/17 E:\Larry\cygwin\bin\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12 1296k 2007/12/17 E:\Larry\cygwin\bin\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0 "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12 118k 2008/05/09 E:\Larry\cygwin\bin\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0 "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03 40k 2006/11/15 E:\Larry\cygwin\bin\cygform-8.dll - os=4.0 img=1.0 sys=4.0 "cygform-8.dll" v0.0 ts=2006/11/14 23:06 19k 2006/11/19 E:\Larry\cygwin\bin\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18 8k 2006/11/19 E:\Larry\cygwin\bin\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0 "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18 219k 2008/10/04 E:\Larry\cygwin\bin\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48 288k 2008/10/04 E:\Larry\cygwin\bin\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0 "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48 24k 2008/11/29 E:\Larry\cygwin\bin\cyghistory6.dll - os=4.0 img=1.0 sys=4.0 "cyghistory6.dll" v0.0 ts=2008/11/29 6:30 271k 2007/08/24 E:\Larry\cygwin\bin\cygicons-0.dll - os=4.0 img=1.0 sys=4.0 "cygicons-0.dll" v0.0 ts=2007/8/24 0:24 978k 2008/11/10 E:\Larry\cygwin\bin\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0 "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35 37k 2003/08/10 E:\Larry\cygwin\bin\cygintl-2.dll - os=4.0 img=1.0 sys=4.0 "cygintl-2.dll" v0.0 ts=2003/8/10 14:50 31k 2005/11/20 E:\Larry\cygwin\bin\cygintl-3.dll - os=4.0 img=1.0 sys=4.0 "cygintl-3.dll" v0.0 ts=2005/11/19 18:04 31k 2008/11/10 E:\Larry\cygwin\bin\cygintl-8.dll - os=4.0 img=1.0 sys=4.0 "cygintl-8.dll" v0.0 ts=2008/11/9 17:32 5k 2008/12/21 E:\Larry\cygwin\bin\cyglsa.dll - os=4.0 img=1.0 sys=4.0 "cyglsa.dll" v0.0 ts=2008/12/20 18:28 9k 2008/12/21 E:\Larry\cygwin\bin\cyglsa64.dll - os=4.0 img=0.0 sys=5.2 83k 2007/06/06 E:\Larry\cygwin\bin\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0 "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41 21k 2006/11/15 E:\Larry\cygwin\bin\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0 "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05 121k 2008/10/04 E:\Larry\cygwin\bin\cygmp-3.dll - os=4.0 img=1.0 sys=4.0 "cygmp-3.dll" v0.0 ts=2008/10/4 16:48 67k 2006/11/15 E:\Larry\cygwin\bin\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13 237k 2006/11/15 E:\Larry\cygwin\bin\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0 "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02 12k 2006/11/15 E:\Larry\cygwin\bin\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0 "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04 181k 2008/09/07 E:\Larry\cygwin\bin\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36 302k 2008/09/07 E:\Larry\cygwin\bin\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36 7k 2008/09/07 E:\Larry\cygwin\bin\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0 "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36 1543k 2008/07/03 E:\Larry\cygwin\bin\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0 "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06 22k 2002/06/09 E:\Larry\cygwin\bin\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0 "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45 155k 2008/11/29 E:\Larry\cygwin\bin\cygreadline6.dll - os=4.0 img=1.0 sys=4.0 "cygreadline6.dll" v0.0 ts=2008/11/29 6:30 118k 2007/06/27 E:\Larry\cygwin\bin\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0 "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56 218k 2008/09/30 E:\Larry\cygwin\bin\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0 "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28 65k 2006/10/16 E:\Larry\cygwin\bin\cygz.dll - os=4.0 img=1.0 sys=4.0 "cygz.dll" v0.0 ts=2006/10/15 18:10 2358k 2008/12/21 E:\Larry\cygwin\bin\cygwin1.dll - os=4.0 img=1.0 sys=4.0 "cygwin1.dll" v0.0 ts=2008/12/20 18:28 Cygwin DLL version info: DLL version: 1.7.0 DLL epoch: 19 DLL old termios: 5 DLL malloc env: 28 API major: 0 API minor: 190 Shared data: 5 DLL identifier: cygwin1 Mount registry: 3 Cygwin registry name: Cygwin Program options name: Program Options Cygdrive default prefix: Build date: Sat Dec 20 21:28:21 EST 2008 Snapshot date: 20081220-21:25:00 Shared id: cygwin1S5 Warning: There are multiple cygwin1.dlls on your path Can't find the cygrunsrv utility, skipping services check. Cygwin Package Information No setup information found Use -h to see help about each section [-- Attachment #3: Type: text/plain, Size: 218 bytes --] -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-23 0:28 ` Lawrence Mayer @ 2008-12-23 19:00 ` Christopher Faylor 2008-12-23 20:32 ` Lawrence Mayer 0 siblings, 1 reply; 14+ messages in thread From: Christopher Faylor @ 2008-12-23 19:00 UTC (permalink / raw) To: cygwin On Mon, Dec 22, 2008 at 04:27:14PM -0800, Lawrence Mayer wrote: >>>> Too bad. Since I can't duplicate the problem it will be difficult to >>>> fix it. > >>> Have you tried running the examples I provided in my original post >>> (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)? > >> Yes. That's what I meant by "I can't duplicate the problem". > > Just ran current snapshot cygwin-inst-20081220 on a different computer > running a different OS: Windows XP Home sp2 32 bit on NTFS. See attached > output from cygcheck. Both this and the previous computer have Athlon XP+ > CPUs. > > Running a DOS window (cmd.exe) with Example 1 of my original post > > tr \32 \0 < foo | tr \0 \32 > bar > > using the same input file foo attached to my previous post gives: > > foo = 5,138,895 bytes > bar = 5,132,288 bytes I'm uploading a new version of the DLL now. Please give it a try. It should be there in 5 - 10 minutes. http://cygwin.com/snapshots/ cgf -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-23 19:00 ` Christopher Faylor @ 2008-12-23 20:32 ` Lawrence Mayer 0 siblings, 0 replies; 14+ messages in thread From: Lawrence Mayer @ 2008-12-23 20:32 UTC (permalink / raw) To: cygwin On 081223 10:59, Christopher Faylor wrote: > I'm uploading a new version of the DLL now. Please give it a try. It > should be there in 5 - 10 minutes. > > http://cygwin.com/snapshots/ Bug appears fixed in current snapshot cygwin-inst-20081223! Thanks Christopher! I appreciate your work. I'm especially impressed if you were able to fix this bug without even being able to duplicate it. Holiday Greetings, Lawrence -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* RE: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-22 20:07 ` Lawrence Mayer 2008-12-22 22:41 ` Christopher Faylor @ 2008-12-23 0:49 ` Allan Schrum 2008-12-23 2:36 ` Lawrence Mayer 1 sibling, 1 reply; 14+ messages in thread From: Allan Schrum @ 2008-12-23 0:49 UTC (permalink / raw) To: cygwin > > >> Not yet. The bug is still present in the current snapshot > >> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for > >> responding to my post. > > > On 081222 10:47, Christopher Faylor wrote: > > Too bad. Since I can't duplicate the problem it will be difficult to > > fix it. > > Have you tried running the examples I provided in my original post > (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)? > > I suggest running each example (in a DOS shell) at least 10 times, > comparing the file sizes of foo and bar each time. On my system, size > of bar < size of foo roughly 25-75% of the time. > > > > It would be helpful if you provided more information like the > cygcheck > > information requested in http://cygwin.com/problems.html. > > Please see attached the output cygcheck -s -v -r > cygcheck.out. I ran > cygcheck on the current snapshot cygwin-inst-20081220.tar.bz2. > > It would also > > be interesting to see the actual file sizes of foo and bar from your > > example. If they always vary in a consistent way that would be a > clue. > > File sizes from latest test I ran (Example 1 of my original post) > > tr \32 \0 < foo | tr \0 \32 > bar > > on current snapshot cygwin-inst-20081220.tar.bz: > > foo = 5,138,895 bytes > bar1 (runs 1-4, 6-7, 9-10) = 5,132,288 bytes > bar2 (runs 5 and 8) = 5,136,384 bytes > > As you can see, there is some consistency. When I ran the above test 10 > consecutive times, there were only two types of output. On 8/10 runs, > bar was missing the same 6,607 (5,138,895 - 5,132,288) byte chunk. On > the remaining 2/10 runs, bar was missing the same 2,511 byte chunk. > > As mentioned in my original post, the missing chunk is always at the > end (or beginning in the tac example) of bar. It's as if the pipe exits > too early, before all the data can make it through. > > I'm attaching foo, bar1, and bar2 from the above example (compressed > with 7zip). > > Greetings, > Lawrence A couple of observations that might trigger a clear thought. The numbers 5,132,288 and 5,138,895 are multiples of 4096. Assuming a standard 4096-byte block, these sizes of "bar" are files of size 1253 and 1254 blocks. The file "foo" only contains 1254 blocks with a remainder of 2511 bytes. Since the last block, or sometimes the last two blocks, are not copied, this might imply some type of race condition that only appears on Lawrence's machine. Christopher's machine might be faster and not subject to this race condition. Lawrence: what is the hardware that your are running this test upon? What other processes are running at the same time (e.g. CPU usage, I/O usage, etc.)? It would appear the leading "tr" writes the file "foo" to the pipe, and closes the pipe. This may cause the trailing "tr" to get a signal that it does not handle well before it can complete the read from the pipe. If the hardware is too slow, or occupied, then perhaps it happens because of this rather than on other hardware which might be faster (or perhaps the reverse). Christopher: could you run the example in a mode where your computer is heavily loaded with other tasks? Only a suggestion. Regards, -Allan -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-23 0:49 ` Allan Schrum @ 2008-12-23 2:36 ` Lawrence Mayer 2008-12-23 3:03 ` Allan Schrum 0 siblings, 1 reply; 14+ messages in thread From: Lawrence Mayer @ 2008-12-23 2:36 UTC (permalink / raw) To: cygwin On 081222 16:48, Allan Schrum wrote: > The numbers 5,132,288 and 5,138,895 are multiples of 4096. Thanks for writing Allan. I think you mean 5,132,288 and 5,136,384 (the two output sizes) are multiples of 4096. > Lawrence: what is the hardware that your are running this test upon? What other processes are running at the same time (e.g. CPU usage, I/O usage, etc.)? Please see my previous post, where I found the same bug on different hardware running a different OS. Here are more details: Computer 1 (from my original post): Motherboard: Shuttle AK31 v3.1 Chipset: Via KT266 northbridge, VT8233 southbridge CPU: Athlon XP 2000+ @ 2 GHz Memory: 512 MB DDR OS: Windows Server 2003 sp2 32 bit on NTFS CPU usage: 0-1% normally, 22-23% max during Cygwin tests Handles 3907 Threads 192 Processes 23 Commit Charge (K): Total 294448 Limit 533992 Peak 426364 Physical Memory (K): Total 523752 Available 180124 System Cache 235732 Kernel Memory (K): Total 53912 Paged 34284 Nonpaged 19628 Computer 2 (from my previous post): Motherboard: MSI K7N2 Delta Chipset: Nvidia Nforce2 CPU: Athlon XP 3200+ @ 2.13 GHz Memory: 2 GB DDR OS: Windows XP Home sp2 32 bit on NTFS CPU usage: 0-1% normally, 21-22% max during Cygwin tests Handles 3904 Threads 193 Processes 23 Commit Charge (K): Total 717884 Limit 1964364 Peak 841376 Physical Memory (K): Total 2096624 Available 1161980 System Cache 1298916 Kernel Memory (K): Total 104788 Paged 76104 Nonpaged 28696 -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* RE: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-23 2:36 ` Lawrence Mayer @ 2008-12-23 3:03 ` Allan Schrum 2008-12-23 6:43 ` Lawrence Mayer 0 siblings, 1 reply; 14+ messages in thread From: Allan Schrum @ 2008-12-23 3:03 UTC (permalink / raw) To: cygwin > -----Original Message----- > From: cygwin-owner@cygwin.com [mailto:cygwin-owner@cygwin.com] On > Behalf Of Lawrence Mayer > Sent: Monday, December 22, 2008 9:28 PM > To: cygwin@cygwin.com > Subject: Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 > > On 081222 16:48, Allan Schrum wrote: > > The numbers 5,132,288 and 5,138,895 are multiples of 4096. > > Thanks for writing Allan. I think you mean 5,132,288 and 5,136,384 (the > two output sizes) are multiples of 4096. > Yes - thanks - copying too many numbers can result in silly errors. > > Lawrence: what is the hardware that your are running this test upon? > What other processes are running at the same time (e.g. CPU usage, I/O > usage, etc.)? > > Please see my previous post, where I found the same bug on different > hardware running a different OS. Here are more details: > > Computer 1 (from my original post): > Motherboard: Shuttle AK31 v3.1 > Chipset: Via KT266 northbridge, VT8233 southbridge > CPU: Athlon XP 2000+ @ 2 GHz > Memory: 512 MB DDR > OS: Windows Server 2003 sp2 32 bit on NTFS > CPU usage: 0-1% normally, 22-23% max during Cygwin tests > Handles 3907 Threads 192 Processes 23 > Commit Charge (K): Total 294448 Limit 533992 Peak 426364 > Physical Memory (K): Total 523752 Available 180124 System Cache 235732 > Kernel Memory (K): Total 53912 Paged 34284 Nonpaged 19628 > > > Computer 2 (from my previous post): > Motherboard: MSI K7N2 Delta > Chipset: Nvidia Nforce2 > CPU: Athlon XP 3200+ @ 2.13 GHz > Memory: 2 GB DDR > OS: Windows XP Home sp2 32 bit on NTFS > CPU usage: 0-1% normally, 21-22% max during Cygwin tests > Handles 3904 Threads 193 Processes 23 > Commit Charge (K): Total 717884 Limit 1964364 Peak 841376 > Physical Memory (K): Total 2096624 Available 1161980 System Cache > 1298916 > Kernel Memory (K): Total 104788 Paged 76104 Nonpaged 28696 > Would it be worth trying to heavily load one of your computers to see if the problem presents itself differently? It is obvious that your systems are fast! -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [1.7] Pipes intermittently lose data on Cygwin 1.7 2008-12-23 3:03 ` Allan Schrum @ 2008-12-23 6:43 ` Lawrence Mayer 0 siblings, 0 replies; 14+ messages in thread From: Lawrence Mayer @ 2008-12-23 6:43 UTC (permalink / raw) To: cygwin On 081222 19:02, Allan Schrum wrote: > Would it be worth trying to heavily load one of your computers to see if the problem presents itself differently? It is obvious that your systems are fast! Allan, at your suggestion, I repeated the trials on Computer 1 (details in previous post) under two opposite load conditions: Condition 1: Maximum Load All Cygwin trials performed during continuous run of Stress Prime 2004's Blend Test http://sp2004.fre3.com/ , a torture test which I use for stability testing when overclocking. The Blend Test stresses both CPU and RAM and keeps CPU usage at 100%. Condition 2: Minimum Load All Cygwin tests performed with minimum other apps running: just one DOS window (to run Cygwin tests) and one Explorer window (to keep track of bar's size). Running a DOS window (cmd.exe) with Example 1 of my original post tr \32 \0 < foo | tr \0 \32 > bar I ran 21 trials under each load condition with the following results: Condition 1 (Maximum Load) foo = 5,138,895 bytes bar = 5,138,895 bytes (no error) on 1 trial bar = 5,136,384 bytes (1254 x 4096) on 6 trials bar = 5,132,288 bytes (1253 x 4096) on 14 trials Condition 2 (Minimum Load) foo = 5,138,895 bytes bar = 5,138,895 bytes (no error) on 1 trial bar = 5,136,384 bytes (1254 x 4096) on 2 trials bar = 5,132,288 bytes (1253 x 4096) on 18 trials As you can see, there was little difference in Cygwin's behavior under opposite load conditions. If anything, Cygwin did better under Condition 1 (Maximum Load), but I don't think the difference is statistically significant. Greetings, Lawrence -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/ ^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2008-12-23 20:32 UTC | newest] Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2008-12-20 9:15 [1.7] Pipes intermittently lose data on Cygwin 1.7 Lawrence Mayer 2008-12-20 20:31 ` Lawrence Mayer 2008-12-22 17:32 ` Christopher Faylor 2008-12-22 18:32 ` Lawrence Mayer 2008-12-22 18:47 ` Christopher Faylor 2008-12-22 20:07 ` Lawrence Mayer 2008-12-22 22:41 ` Christopher Faylor 2008-12-23 0:28 ` Lawrence Mayer 2008-12-23 19:00 ` Christopher Faylor 2008-12-23 20:32 ` Lawrence Mayer 2008-12-23 0:49 ` Allan Schrum 2008-12-23 2:36 ` Lawrence Mayer 2008-12-23 3:03 ` Allan Schrum 2008-12-23 6:43 ` Lawrence Mayer
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).