[1.7] Pipes intermittently lose data on Cygwin 1.7

[1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

Pipes intermittently lose data on Cygwin 1.7.0-35 and -36. This bug 
appears generic to pipes under Cygwin 1.7 and not limited to any 
particular app.

To reproduce this bug, create a ~ 5 MB text file foo.

tr \32 \0 < foo | tr \0 \32 > bar

should make bar = foo. But intermittently, bar is truncated and missing 
the end of foo. You can quickly tell by monitoring the file sizes: 
intermittently bar is smaller than foo.

The bug appears generic to pipes under Cygwin 1.7, e.g.

sed s/\x1a/\x0/ foo | sed s/\x0/\x1a/ > bar

sort foo | tr \32 \0 > bar

cat foo | tr \32 \0 > bar

tac foo | tac > bar

cat foo | cat | cat > bar

all cause intermittent loss of data, where bar is sometimes truncated 
and missing the end of foo (or beginning of foo in tac example). (The 
last example contains 2 pipes, since cat foo | cat > bar appears more 
resistant to this bug and only occasionally loses data.)

This bug is difficult to reproduce on my system when foo < ~ 3 MB. Hence 
the recommendation above for foo ~ 5 MB.

This bug is present in Cygwin 1.7.0-35 and 1.7.0-36. I have not tested 
earlier 1.7 builds.

This bug appears new to Cygwin 1.7 and not present in Cygwin 1.5.25-15.

Greetings,
Lawrence

Versions tested:
Cygwin 1.7.0-36 and 1.7.0-35 with coreutils 7.0-2 and sed 4.1.5-2
Cygwin 1.5.25-15 with coreutils 6.10-2 and sed 4.1.5-2

OS: Windows Server 2003 sp2 32-bit. Cygwin installed on NTFS drive C:.


--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or 
command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to 
work fine.

As mentioned in my previous post, this bug appears new to Cygwin 1.7 and 
not present in Cygwin 1.5.25-15.

Greetings,
Lawrence

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Christopher Faylor]

On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote:
> This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or 
> command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to 
> work fine.

This may be fixed in the current Cygwin snapshot.  I think I closed up a
couple of race conditions there.

http://cygwin.com/snapshots/

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

> On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote:
>> This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or
>> command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to
>> work fine.


On 081222 09:31, Christopher Faylor wrote:
> This may be fixed in the current Cygwin snapshot.  I think I closed up a
> couple of race conditions there.
>
> http://cygwin.com/snapshots/
>
> cgf

Not yet. The bug is still present in the current snapshot 
cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for 
responding to my post.

Holiday Greetings,
Lawrence

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Christopher Faylor]

On Mon, Dec 22, 2008 at 10:31:50AM -0800, Lawrence Mayer wrote:
>> On Sat, Dec 20, 2008 at 12:31:26PM -0800, Lawrence Mayer wrote:
>>> This bug appears specific to Cygwin 1.7 pipes on Win32 DOS (cmd.exe or
>>> command.exe). Cygwin 1.7 pipes on bash 3.2.48-21 or zsh 4.3.9-1 seem to
>>> work fine.
>
>
> On 081222 09:31, Christopher Faylor wrote:
>> This may be fixed in the current Cygwin snapshot.  I think I closed up a
>> couple of race conditions there.
>>
>> http://cygwin.com/snapshots/
>>
>> cgf
>
> Not yet. The bug is still present in the current snapshot 
> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for 
> responding to my post.

Too bad.  Since I can't duplicate the problem it will be difficult to
fix it.

It would be helpful if you provided more information like the cygcheck
information requested in http://cygwin.com/problems.html.  It would also
be interesting to see the actual file sizes of foo and bar from your
example.  If they always vary in a consistent way that would be a clue.

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

[-- Attachment #1: Type: text/plain, Size: 1874 bytes --]

>> Not yet. The bug is still present in the current snapshot
>> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for
>> responding to my post.


On 081222 10:47, Christopher Faylor wrote:
> Too bad.  Since I can't duplicate the problem it will be difficult to
> fix it.

Have you tried running the examples I provided in my original post (with 
foo = ~ 5MB text file) on a DOS shell (cmd.exe)?

I suggest running each example (in a DOS shell) at least 10 times, 
comparing the file sizes of foo and bar each time. On my system, size of 
bar < size of foo roughly 25-75% of the time.


> It would be helpful if you provided more information like the cygcheck
> information requested in http://cygwin.com/problems.html.

Please see attached the output cygcheck -s -v -r > cygcheck.out. I ran 
cygcheck on the current snapshot cygwin-inst-20081220.tar.bz2.

It would also
> be interesting to see the actual file sizes of foo and bar from your
> example.  If they always vary in a consistent way that would be a clue.

File sizes from latest test I ran (Example 1 of my original post)

	tr \32 \0 < foo | tr \0 \32 > bar

on current snapshot cygwin-inst-20081220.tar.bz:

	foo = 5,138,895 bytes
	bar1 (runs 1-4, 6-7, 9-10) = 5,132,288 bytes
	bar2 (runs 5 and 8) = 5,136,384 bytes

As you can see, there is some consistency. When I ran the above test 10 
consecutive times, there were only two types of output. On 8/10 runs, 
bar was missing the same 6,607 (5,138,895 - 5,132,288) byte chunk. On 
the remaining 2/10 runs, bar was missing the same 2,511 byte chunk.

As mentioned in my original post, the missing chunk is always at the end 
(or beginning in the tac example) of bar. It's as if the pipe exits too 
early, before all the data can make it through.

I'm attaching foo, bar1, and bar2 from the above example (compressed 
with 7zip).

Greetings,
Lawrence


[-- Attachment #2: cygcheck.out --]
[-- Type: text/plain, Size: 12412 bytes --]


Cygwin Configuration Diagnostics
Current System Time: Mon Dec 22 11:02:06 2008

Windows 2003 Server Enterprise Edition Ver 5.2 Build 3790 Service Pack 2

Path:	C:\OS1\system32
	C:\OS1
	C:\app\Microsoft\DbgTools
	C:\app\Microsoft\RKTools
	C:\app\Microsoft\STools
	C:\app\Microsoft\WDK
	C:\app\CLI
	C:\app\Westlake
	C:\app\Cygwin\bin
	C:\app\Gnu
	C:\app\Ch\bin
	C:\app\Common
	C:\app\Sysint
	C:\app\p-nand-q
	C:\app\Unlocker
	C:\app\WinRAR
	C:\app\7-Zip
	C:\app\UniExtract\bin
	C:\app\GTK\2.0\bin
	D:\computer\Install

Output from C:\App\cygwin\bin\id.exe (nontsec)
UID: 500(Administrator) GID: 513(None)
0(root)                 544(Administrators)     545(Users)
513(None)

Output from C:\App\cygwin\bin\id.exe (ntsec)
UID: 500(Administrator) GID: 513(None)
0(root)                 544(Administrators)     545(Users)
513(None)

SysDir: C:\OS1\system32
WinDir: C:\OS1

CYGWIN = 'nodosfilewarning glob:ignorecase nontsec'
Path = 'C:\OS1\system32;C:\OS1;C:\app\Microsoft\DbgTools;C:\app\Microsoft\RKTools;C:\app\Microsoft\STools;C:\app\Microsoft\WDK;C:\app\CLI;C:\app\Westlake;C:\app\Cygwin\bin;C:\app\Gnu;C:\app\Ch\bin;C:\app\Common;C:\app\Sysint;C:\app\p-nand-q;C:\app\Unlocker;C:\app\WinRAR;C:\app\7-Zip;C:\app\UniExtract\bin;C:\app\GTK\2.0\bin;D:\computer\Install'

-10 = 'C:\OS1'
-10a = 'C:\OS1\WinSxS'
-10aa = 'C:\OS1\WinSxS\Manifests'
-10ab = 'C:\OS1\WinSxS\Policies'
-11 = 'C:\OS1\system32'
-12 = 'C:\OS1\system32\drivers'
-16422 = 'C:\OS1\Msi'
-16427 = 'C:\OS1\Msi\Common'
-16427a = 'C:\OS1\Msi\Common\Microsoft Shared'
-17 = 'C:\OS1\inf'
-18 = 'C:\OS1\Help'
-20 = 'C:\OS1\Fonts'
-24 = 'C:\'
-52 = 'C:\OS1\system32\spool\drivers'
ALLUSERSPROFILE = 'C:\OS1\Profiles\All Users'
APPDATA = 'C:\data\appdata'
CommonProgramFiles = 'C:\OS1\Msi\Common'
COMPUTERNAME = 'AK31'
ComSpec = 'C:\OS1\system32\cmd.exe'
devmgr_show_nonpresent_devices = '1'
FP_NO_HOST_CHECK = 'NO'
GTKMM_BASEPATH = 'C:\app\GTK\2.0'
GTK_BASEPATH = 'C:\app\GTK\2.0'
HOMEDRIVE = 'C:'
HOMEPATH = '\'
LOGONSERVER = '\\AK31'
NUMBER_OF_PROCESSORS = '1'
OS = 'Windows_NT'
PATHEXT = '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.CH'
PROCESSOR_ARCHITECTURE = 'x86'
PROCESSOR_IDENTIFIER = 'x86 Family 6 Model 8 Stepping 1, AuthenticAMD'
PROCESSOR_LEVEL = '6'
PROCESSOR_REVISION = '0801'
ProgramFiles = 'C:\OS1\Msi'
PROMPT = '$P$G'
SystemDrive = 'C:'
SystemRoot = 'C:\OS1'
TEMP = 'C:\tmpdir\Temp'
TMP = 'C:\tmpdir\Temp'
USERDOMAIN = 'AK31'
USERNAME = 'Administrator'
USERPROFILE = 'C:\OS1\Profiles\Administrator'
windir = 'C:\OS1'

HKEY_CURRENT_USER\Software\Cygnus Solutions
HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin
HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin\mounts v2
HKEY_CURRENT_USER\Software\Cygnus Solutions\Cygwin\Program Options
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2
  (default) = '/'
  cygdrive flags = 0x00000022
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/
  (default) = 'C:\App\cygwin'
  flags = 0x0000000a
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/usr/bin
  (default) = 'C:\App\cygwin/bin'
  flags = 0x0000000a
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\mounts v2\/usr/lib
  (default) = 'C:\App\cygwin/lib'
  flags = 0x0000000a
HKEY_LOCAL_MACHINE\SOFTWARE\Cygnus Solutions\Cygwin\Program Options

a:  fd             N/A    N/A                    
c:  hd  NTFS      5004Mb  36% CP CS UN PA FC     NT52
d:  hd  NTFS     65185Mb  21% CP CS UN PA FC     User

C:/App/cygwin      /         system  binmode,noacl,posix=0
C:\App\cygwin\bin  /usr/bin  system  binmode,noacl,posix=0
C:\App\cygwin\lib  /usr/lib  system  binmode,noacl,posix=0
.                  /         user    binmode,cygdrive,noacl,posix=0

Found: C:\app\Cygwin\bin\awk.exe
 -> C:\App\cygwin\bin\gawk.exe
Found: C:\app\Cygwin\bin\bash.exe
Found: C:\app\Cygwin\bin\cat.exe
Found: C:\app\Cygwin\bin\cp.exe
Not Found: cpp (good!)
Not Found: crontab
Found: C:\OS1\system32\find.exe
Found: C:\app\Cygwin\bin\find.exe
Warning: C:\OS1\system32\find.exe hides C:\app\Cygwin\bin\find.exe
Not Found: gcc
Not Found: gdb
Found: C:\app\Cygwin\bin\grep.exe
Found: C:\app\Microsoft\DbgTools\kill.exe
Found: C:\app\Cygwin\bin\kill.exe
Warning: C:\app\Microsoft\DbgTools\kill.exe hides C:\app\Cygwin\bin\kill.exe
Found: C:\app\Cygwin\bin\ld.exe
Found: C:\app\Cygwin\bin\ls.exe
Found: C:\app\Cygwin\bin\make.exe
Found: C:\app\Cygwin\bin\mv.exe
Found: C:\app\Cygwin\bin\patch.exe
Found: C:\app\Cygwin\bin\perl.exe
Found: C:\app\Cygwin\bin\rm.exe
Found: C:\app\Cygwin\bin\sed.exe
Not Found: ssh
Found: C:\app\Cygwin\bin\sh.exe
Found: C:\app\Cygwin\bin\tar.exe
Found: C:\app\Cygwin\bin\test.exe
Found: C:\app\Ch\bin\vi.exe
Found: C:\app\Ch\bin\vim.exe

   61k 2008/04/01 C:\app\Cygwin\bin\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygbz2-1.dll" v0.0 ts=2008/3/31 20:37
    7k 2003/10/19 C:\app\Cygwin\bin\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57
 1064k 2008/09/30 C:\app\Cygwin\bin\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27
  221k 2007/06/30 C:\app\Cygwin\bin\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0
                  "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54
  943k 2007/12/17 C:\app\Cygwin\bin\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12
 1296k 2007/12/17 C:\app\Cygwin\bin\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12
  118k 2008/05/09 C:\app\Cygwin\bin\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03
   40k 2006/11/15 C:\app\Cygwin\bin\cygform-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygform-8.dll" v0.0 ts=2006/11/14 23:06
   19k 2006/11/19 C:\app\Cygwin\bin\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18
    8k 2006/11/19 C:\app\Cygwin\bin\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18
  219k 2008/10/04 C:\app\Cygwin\bin\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48
  288k 2008/10/04 C:\app\Cygwin\bin\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48
   24k 2008/11/29 C:\app\Cygwin\bin\cyghistory6.dll - os=4.0 img=1.0 sys=4.0
                  "cyghistory6.dll" v0.0 ts=2008/11/29 6:30
  271k 2007/08/24 C:\app\Cygwin\bin\cygicons-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygicons-0.dll" v0.0 ts=2007/8/24 0:24
  978k 2008/11/10 C:\app\Cygwin\bin\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35
   37k 2003/08/10 C:\app\Cygwin\bin\cygintl-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-2.dll" v0.0 ts=2003/8/10 14:50
   31k 2005/11/20 C:\app\Cygwin\bin\cygintl-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-3.dll" v0.0 ts=2005/11/19 18:04
   31k 2008/11/10 C:\app\Cygwin\bin\cygintl-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-8.dll" v0.0 ts=2008/11/9 17:32
    5k 2008/12/21 C:\app\Cygwin\bin\cyglsa.dll - os=4.0 img=1.0 sys=4.0
                  "cyglsa.dll" v0.0 ts=2008/12/20 18:28
    9k 2008/12/21 C:\app\Cygwin\bin\cyglsa64.dll - os=4.0 img=0.0 sys=5.2
   83k 2007/06/06 C:\app\Cygwin\bin\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41
   21k 2006/11/15 C:\app\Cygwin\bin\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05
  121k 2008/10/04 C:\app\Cygwin\bin\cygmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygmp-3.dll" v0.0 ts=2008/10/4 16:48
   67k 2006/11/15 C:\app\Cygwin\bin\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13
  237k 2006/11/15 C:\app\Cygwin\bin\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02
   12k 2006/11/15 C:\app\Cygwin\bin\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04
  181k 2008/09/07 C:\app\Cygwin\bin\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36
  302k 2008/09/07 C:\app\Cygwin\bin\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36
    7k 2008/09/07 C:\app\Cygwin\bin\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36
 1543k 2008/07/03 C:\app\Cygwin\bin\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0
                  "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06
   22k 2002/06/09 C:\app\Cygwin\bin\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45
  155k 2008/11/29 C:\app\Cygwin\bin\cygreadline6.dll - os=4.0 img=1.0 sys=4.0
                  "cygreadline6.dll" v0.0 ts=2008/11/29 6:30
  118k 2007/06/27 C:\app\Cygwin\bin\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56
  218k 2008/09/30 C:\app\Cygwin\bin\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28
   65k 2006/10/16 C:\app\Cygwin\bin\cygz.dll - os=4.0 img=1.0 sys=4.0
                  "cygz.dll" v0.0 ts=2006/10/15 18:10
 2358k 2008/12/21 C:\app\Cygwin\bin\cygwin1.dll - os=4.0 img=1.0 sys=4.0
                  "cygwin1.dll" v0.0 ts=2008/12/20 18:28
    Cygwin DLL version info:
        DLL version: 1.7.0
        DLL epoch: 19
        DLL old termios: 5
        DLL malloc env: 28
        API major: 0
        API minor: 190
        Shared data: 5
        DLL identifier: cygwin1
        Mount registry: 3
        Cygwin registry name: Cygwin
        Program options name: Program Options
        Cygdrive default prefix: 
        Build date: Sat Dec 20 21:28:21 EST 2008
        Snapshot date: 20081220-21:25:00
        Shared id: cygwin1S5


Can't find the cygrunsrv utility, skipping services check.


Cygwin Package Information
Last downloaded files to: D:\computer\Install\AppsToCopy\cygwin
Last downloaded files from: http://sources-redhat.mirror.redwire.net/cygwin/

Package              Version
_update-info-dir     00788-1
alternatives         1.3.30c-2
arc                  5.21m-1
ash                  20040127-4
astyle               1.22-2
base-cygwin          1.1-1
base-files           3.7-1
base-passwd          2.2-1
bash                 3.2.48-21
bashdb               3.1_0.09-1
binutils             20080624-2
bzip2                1.0.5-2
coreutils            7.0-2
crypt                1.1-1
curl                 7.16.3-1
cygutils             1.3.2-1
cygwin               1.7.0-36
cygwin-doc           1.5-1
diffutils            2.8.7-1
e2fsprogs            1.35-3
editrights           1.01-2
expat                2.0.1-1
file                 4.21-1
findutils            4.5.3-1
gawk                 3.1.6-1
grep                 2.5.3-1
groff                1.19.2-2
gzip                 1.3.12-2
indent               2.2.9-2
ipc-utils            1.0-1
less                 382-1
libbz2_1             1.0.5-2
libcurl4             7.16.3-1
libdb4.5             4.5.20.2-2
libexpat1            2.0.1-1
libexpat1-devel      2.0.1-1
libgdbm4             1.8.3-8
libgmp3              4.2.4-1
libiconv2            1.12-1
libintl2             0.12.1-3
libintl3             0.14.5-1
libintl8             0.17-1
libncurses-devel     5.5-3
libncurses8          5.5-3
libpcre0             7.8-1
libpopt0             1.6.4-4
libreadline6         5.2.13-11
libssh2_1            0.15-1
login                1.9-8
make                 3.81-2
man                  1.6e-1
openssl              0.9.8i-1
patch                2.5.8-9
perl                 5.10.0-5
readline             5.2.13-11
rebase               2.4.4-1
rsync                3.0.4-1
run                  1.1.10-1
sed                  4.1.5-2
tar                  1.20-2
termcap              20050421-1
terminfo             5.5_20061104-1
texinfo              4.8a-1
time                 1.7-2
tzcode               2008h-1
unzip                5.52-2
util-linux           2.13.1-2
wget                 1.11.4-2
which                2.19-1
zlib                 1.2.3-2
zsh                  4.3.9-1
Use -h to see help about each section

[-- Attachment #3: foobar.7z --]
[-- Type: application/octet-stream, Size: 103406 bytes --]

[-- Attachment #4: Type: text/plain, Size: 218 bytes --]

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Christopher Faylor]

On Mon, Dec 22, 2008 at 12:06:16PM -0800, Lawrence Mayer wrote:
>>> Not yet. The bug is still present in the current snapshot
>>> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for
>>> responding to my post.
>
>On 081222 10:47, Christopher Faylor wrote:
>>Too bad.  Since I can't duplicate the problem it will be difficult to
>>fix it.
>
>Have you tried running the examples I provided in my original post
>(with foo = ~ 5MB text file) on a DOS shell (cmd.exe)?

Yes.  That's what I meant by "I can't duplicate the problem".

>I suggest running each example (in a DOS shell) at least 10 times,
>comparing the file sizes of foo and bar each time.  On my system, size
>of bar < size of foo roughly 25-75% of the time.

I ran it, in a loop, thousands of times, throughout the day on Sunday.

> I'm attaching foo, bar1, and bar2 from the above example (compressed with 
> 7zip).

Urk.  There was no need to spam thousands of people with something like
this.  If I needed the data I would have asked that you send it just
to me.

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

[-- Attachment #1: Type: text/plain, Size: 1368 bytes --]

>>> Too bad.  Since I can't duplicate the problem it will be difficult to
>>> fix it.

>> Have you tried running the examples I provided in my original post
>> (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)?

> Yes.  That's what I meant by "I can't duplicate the problem".

Just ran current snapshot cygwin-inst-20081220 on a different computer 
running a different OS: Windows XP Home sp2 32 bit on NTFS. See attached 
output from cygcheck. Both this and the previous computer have Athlon 
XP+ CPUs.

Running a DOS window (cmd.exe) with Example 1 of my original post

     tr \32 \0 < foo | tr \0 \32 > bar

using the same input file foo attached to my previous post gives:

     foo = 5,138,895 bytes
     bar = 5,132,288 bytes

I ran the test twice and got identical output. Moreover, (output) bar on 
this computer was identical to (output) bar1 (attached to my previous 
post) obtained on the other computer (running Windows Server 2003 sp2 32 
bit on NTFS.) With identical output I mean binary identical, not just 
identical file size.

Thus, there is some consistency to this bug even between different 
computers running different versions of Windows. Not complete 
consistency though, as noted in my previous post: sometimes output was 
bar2 not bar1. And on some runs the bug doesn't appear at all, and 
output size = input size.

Greetings,
Lawrence

[-- Attachment #2: cygcheck.out --]
[-- Type: text/plain, Size: 12745 bytes --]


Cygwin Configuration Diagnostics
Current System Time: Mon Dec 22 16:06:58 2008

Windows XP Home Edition Ver 5.1 Build 2600 Service Pack 2

Path:	C:\WINDOWS\system32
	C:\WINDOWS
	C:\WINDOWS\System32\Wbem
	C:\Program Files\ATI Technologies\ATI Control Panel

SysDir: C:\WINDOWS\system32
WinDir: C:\WINDOWS

Path = 'C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\ATI Technologies\ATI Control Panel'

ALLUSERSPROFILE = 'C:\Documents and Settings\All Users'
APPDATA = 'C:\Documents and Settings\Samuel\Application Data'
CLIENTNAME = 'Console'
CommonProgramFiles = 'C:\Program Files\Common Files'
COMPUTERNAME = 'SYSTEM'
ComSpec = 'C:\WINDOWS\system32\cmd.exe'
devmgr_show_nonpresent_devices = '1'
FP_NO_HOST_CHECK = 'NO'
HOMEDRIVE = 'C:'
HOMEPATH = '\Documents and Settings\Samuel'
LOGONSERVER = '\\SYSTEM'
NUMBER_OF_PROCESSORS = '1'
OS = 'Windows_NT'
PATHEXT = '.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH'
PROCESSOR_ARCHITECTURE = 'x86'
PROCESSOR_IDENTIFIER = 'x86 Family 6 Model 10 Stepping 0, AuthenticAMD'
PROCESSOR_LEVEL = '6'
PROCESSOR_REVISION = '0a00'
ProgramFiles = 'C:\Program Files'
PROMPT = '$P$G'
SESSIONNAME = 'Console'
SystemDrive = 'C:'
SystemRoot = 'C:\WINDOWS'
TEMP = 'D:\Temp'
TMP = 'D:\Temp'
USERDOMAIN = 'SYSTEM'
USERNAME = 'Samuel'
USERPROFILE = 'C:\Documents and Settings\Samuel'
windir = 'C:\WINDOWS'


a:  fd             N/A    N/A                    
c:  hd  NTFS      4502Mb  95% CP CS UN PA FC     XPCore
d:  hd  NTFS      1004Mb  13% CP CS UN PA FC     XPTemp
e:  hd  NTFS     32655Mb  44% CP CS UN PA FC     User
f:  hd  NTFS     19539Mb  66% CP CS UN PA FC     19GDisk
g:  cd  CDFS       467Mb 100%    CS UN           OFFICE12
h:  cd             N/A    N/A                    
i:  fd  FAT       1927Mb   1% CP    UN           

C:/App/cygwin      /         system  binmode,noacl,posix=0
C:\App\cygwin\bin  /usr/bin  system  binmode,noacl,posix=0
C:\App\cygwin\lib  /usr/lib  system  binmode,noacl,posix=0
.                  /         user    binmode,cygdrive,noacl,posix=0

Not Found: awk
Not Found: bash
Not Found: cat
Not Found: cp
Not Found: cpp (good!)
Not Found: crontab
Found: C:\WINDOWS\system32\find.exe
Not Found: gcc
Not Found: gdb
Not Found: grep
Not Found: kill
Not Found: ld
Not Found: ls
Not Found: make
Not Found: mv
Not Found: patch
Not Found: perl
Not Found: rm
Found: C:\WINDOWS\sed.exe
Not Found: ssh
Not Found: sh
Not Found: tar
Not Found: test
Not Found: vi
Not Found: vim

   61k 2008/04/01 .\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygbz2-1.dll" v0.0 ts=2008/3/31 19:37
    7k 2003/10/19 .\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57
 1064k 2008/09/30 .\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27
  221k 2007/06/30 .\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0
                  "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54
  943k 2007/12/17 .\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12
 1296k 2007/12/17 .\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12
  118k 2008/05/09 .\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03
   40k 2006/11/15 .\cygform-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygform-8.dll" v0.0 ts=2006/11/14 23:06
   19k 2006/11/19 .\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18
    8k 2006/11/19 .\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18
  219k 2008/10/04 .\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48
  288k 2008/10/04 .\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48
   24k 2008/11/29 .\cyghistory6.dll - os=4.0 img=1.0 sys=4.0
                  "cyghistory6.dll" v0.0 ts=2008/11/29 6:30
  271k 2007/08/24 .\cygicons-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygicons-0.dll" v0.0 ts=2007/8/24 0:24
  978k 2008/11/10 .\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35
   37k 2003/08/10 .\cygintl-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-2.dll" v0.0 ts=2003/8/10 14:50
   31k 2005/11/20 .\cygintl-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-3.dll" v0.0 ts=2005/11/19 18:04
   31k 2008/11/10 .\cygintl-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-8.dll" v0.0 ts=2008/11/9 17:32
    5k 2008/12/21 .\cyglsa.dll - os=4.0 img=1.0 sys=4.0
                  "cyglsa.dll" v0.0 ts=2008/12/20 18:28
    9k 2008/12/21 .\cyglsa64.dll - os=4.0 img=0.0 sys=5.2
   83k 2007/06/06 .\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41
   21k 2006/11/15 .\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05
  121k 2008/10/04 .\cygmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygmp-3.dll" v0.0 ts=2008/10/4 16:48
   67k 2006/11/15 .\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13
  237k 2006/11/15 .\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02
   12k 2006/11/15 .\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04
  181k 2008/09/07 .\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36
  302k 2008/09/07 .\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36
    7k 2008/09/07 .\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36
 1543k 2008/07/03 .\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0
                  "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06
   22k 2002/06/09 .\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45
  155k 2008/11/29 .\cygreadline6.dll - os=4.0 img=1.0 sys=4.0
                  "cygreadline6.dll" v0.0 ts=2008/11/29 6:30
  118k 2007/06/27 .\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56
  218k 2008/09/30 .\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28
   65k 2006/10/16 .\cygz.dll - os=4.0 img=1.0 sys=4.0
                  "cygz.dll" v0.0 ts=2006/10/15 18:10
 2358k 2008/12/21 .\cygwin1.dll - os=4.0 img=1.0 sys=4.0
                  "cygwin1.dll" v0.0 ts=2008/12/20 18:28
    Cygwin DLL version info:
        DLL version: 1.7.0
        DLL epoch: 19
        DLL old termios: 5
        DLL malloc env: 28
        API major: 0
        API minor: 190
        Shared data: 5
        DLL identifier: cygwin1
        Mount registry: 3
        Cygwin registry name: Cygwin
        Program options name: Program Options
        Cygdrive default prefix: 
        Build date: Sat Dec 20 21:28:21 EST 2008
        Snapshot date: 20081220-21:25:00
        Shared id: cygwin1S5

   61k 2008/04/01 E:\Larry\cygwin\bin\cygbz2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygbz2-1.dll" v0.0 ts=2008/3/31 19:37
    7k 2003/10/19 E:\Larry\cygwin\bin\cygcrypt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypt-0.dll" v0.0 ts=2003/10/19 0:57
 1064k 2008/09/30 E:\Larry\cygwin\bin\cygcrypto-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygcrypto-0.9.8.dll" v0.0 ts=2008/9/30 8:27
  221k 2007/06/30 E:\Larry\cygwin\bin\cygcurl-4.dll - os=4.0 img=1.0 sys=4.0
                  "cygcurl-4.dll" v0.0 ts=2007/6/29 17:54
  943k 2007/12/17 E:\Larry\cygwin\bin\cygdb-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb-4.5.dll" v0.0 ts=2007/12/17 5:12
 1296k 2007/12/17 E:\Larry\cygwin\bin\cygdb_cxx-4.5.dll - os=4.0 img=1.0 sys=4.0
                  "cygdb_cxx-4.5.dll" v0.0 ts=2007/12/17 5:12
  118k 2008/05/09 E:\Larry\cygwin\bin\cygexpat-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygexpat-1.dll" v0.0 ts=2008/5/8 21:03
   40k 2006/11/15 E:\Larry\cygwin\bin\cygform-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygform-8.dll" v0.0 ts=2006/11/14 23:06
   19k 2006/11/19 E:\Larry\cygwin\bin\cyggdbm-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm-4.dll" v0.0 ts=2006/11/19 0:18
    8k 2006/11/19 E:\Larry\cygwin\bin\cyggdbm_compat-4.dll - os=4.0 img=1.0 sys=4.0
                  "cyggdbm_compat-4.dll" v0.0 ts=2006/11/19 0:18
  219k 2008/10/04 E:\Larry\cygwin\bin\cyggmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmp-3.dll" v0.0 ts=2008/10/4 16:48
  288k 2008/10/04 E:\Larry\cygwin\bin\cyggmpxx-3.dll - os=4.0 img=1.0 sys=4.0
                  "cyggmpxx-3.dll" v0.0 ts=2008/10/4 16:48
   24k 2008/11/29 E:\Larry\cygwin\bin\cyghistory6.dll - os=4.0 img=1.0 sys=4.0
                  "cyghistory6.dll" v0.0 ts=2008/11/29 6:30
  271k 2007/08/24 E:\Larry\cygwin\bin\cygicons-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygicons-0.dll" v0.0 ts=2007/8/24 0:24
  978k 2008/11/10 E:\Larry\cygwin\bin\cygiconv-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygiconv-2.dll" v0.0 ts=2008/11/9 16:35
   37k 2003/08/10 E:\Larry\cygwin\bin\cygintl-2.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-2.dll" v0.0 ts=2003/8/10 14:50
   31k 2005/11/20 E:\Larry\cygwin\bin\cygintl-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-3.dll" v0.0 ts=2005/11/19 18:04
   31k 2008/11/10 E:\Larry\cygwin\bin\cygintl-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygintl-8.dll" v0.0 ts=2008/11/9 17:32
    5k 2008/12/21 E:\Larry\cygwin\bin\cyglsa.dll - os=4.0 img=1.0 sys=4.0
                  "cyglsa.dll" v0.0 ts=2008/12/20 18:28
    9k 2008/12/21 E:\Larry\cygwin\bin\cyglsa64.dll - os=4.0 img=0.0 sys=5.2
   83k 2007/06/06 E:\Larry\cygwin\bin\cygmagic-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygmagic-1.dll" v0.0 ts=2007/6/6 3:41
   21k 2006/11/15 E:\Larry\cygwin\bin\cygmenu-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygmenu-8.dll" v0.0 ts=2006/11/14 23:05
  121k 2008/10/04 E:\Larry\cygwin\bin\cygmp-3.dll - os=4.0 img=1.0 sys=4.0
                  "cygmp-3.dll" v0.0 ts=2008/10/4 16:48
   67k 2006/11/15 E:\Larry\cygwin\bin\cygncurses++-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses++-8.dll" v0.0 ts=2006/11/14 23:13
  237k 2006/11/15 E:\Larry\cygwin\bin\cygncurses-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygncurses-8.dll" v0.0 ts=2006/11/14 23:02
   12k 2006/11/15 E:\Larry\cygwin\bin\cygpanel-8.dll - os=4.0 img=1.0 sys=4.0
                  "cygpanel-8.dll" v0.0 ts=2006/11/14 23:04
  181k 2008/09/07 E:\Larry\cygwin\bin\cygpcre-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcre-0.dll" v0.0 ts=2008/9/6 20:36
  302k 2008/09/07 E:\Larry\cygwin\bin\cygpcrecpp-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcrecpp-0.dll" v0.0 ts=2008/9/6 20:36
    7k 2008/09/07 E:\Larry\cygwin\bin\cygpcreposix-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpcreposix-0.dll" v0.0 ts=2008/9/6 20:36
 1543k 2008/07/03 E:\Larry\cygwin\bin\cygperl5_10.dll - os=4.0 img=1.0 sys=4.0
                  "cygperl5_10.dll" v0.0 ts=2008/6/30 9:06
   22k 2002/06/09 E:\Larry\cygwin\bin\cygpopt-0.dll - os=4.0 img=1.0 sys=4.0
                  "cygpopt-0.dll" v0.0 ts=2002/6/8 22:45
  155k 2008/11/29 E:\Larry\cygwin\bin\cygreadline6.dll - os=4.0 img=1.0 sys=4.0
                  "cygreadline6.dll" v0.0 ts=2008/11/29 6:30
  118k 2007/06/27 E:\Larry\cygwin\bin\cygssh2-1.dll - os=4.0 img=1.0 sys=4.0
                  "cygssh2-1.dll" v0.0 ts=2007/6/26 22:56
  218k 2008/09/30 E:\Larry\cygwin\bin\cygssl-0.9.8.dll - os=4.0 img=1.0 sys=4.0
                  "cygssl-0.9.8.dll" v0.0 ts=2008/9/30 8:28
   65k 2006/10/16 E:\Larry\cygwin\bin\cygz.dll - os=4.0 img=1.0 sys=4.0
                  "cygz.dll" v0.0 ts=2006/10/15 18:10
 2358k 2008/12/21 E:\Larry\cygwin\bin\cygwin1.dll - os=4.0 img=1.0 sys=4.0
                  "cygwin1.dll" v0.0 ts=2008/12/20 18:28
    Cygwin DLL version info:
        DLL version: 1.7.0
        DLL epoch: 19
        DLL old termios: 5
        DLL malloc env: 28
        API major: 0
        API minor: 190
        Shared data: 5
        DLL identifier: cygwin1
        Mount registry: 3
        Cygwin registry name: Cygwin
        Program options name: Program Options
        Cygdrive default prefix: 
        Build date: Sat Dec 20 21:28:21 EST 2008
        Snapshot date: 20081220-21:25:00
        Shared id: cygwin1S5

Warning: There are multiple cygwin1.dlls on your path

Can't find the cygrunsrv utility, skipping services check.


Cygwin Package Information
No setup information found
Use -h to see help about each section


[-- Attachment #3: Type: text/plain, Size: 218 bytes --]

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

RE: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Allan Schrum]

> 
> >> Not yet. The bug is still present in the current snapshot
> >> cygwin-inst-20081220.tar.bz2. Thanks for trying to fix it and for
> >> responding to my post.
> 
> 
> On 081222 10:47, Christopher Faylor wrote:
> > Too bad.  Since I can't duplicate the problem it will be difficult to
> > fix it.
> 
> Have you tried running the examples I provided in my original post
> (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)?
> 
> I suggest running each example (in a DOS shell) at least 10 times,
> comparing the file sizes of foo and bar each time. On my system, size
> of bar < size of foo roughly 25-75% of the time.
> 
> 
> > It would be helpful if you provided more information like the
> cygcheck
> > information requested in http://cygwin.com/problems.html.
> 
> Please see attached the output cygcheck -s -v -r > cygcheck.out. I ran
> cygcheck on the current snapshot cygwin-inst-20081220.tar.bz2.
> 
> It would also
> > be interesting to see the actual file sizes of foo and bar from your
> > example.  If they always vary in a consistent way that would be a
> clue.
> 
> File sizes from latest test I ran (Example 1 of my original post)
> 
> 	tr \32 \0 < foo | tr \0 \32 > bar
> 
> on current snapshot cygwin-inst-20081220.tar.bz:
> 
> 	foo = 5,138,895 bytes
> 	bar1 (runs 1-4, 6-7, 9-10) = 5,132,288 bytes
> 	bar2 (runs 5 and 8) = 5,136,384 bytes
> 
> As you can see, there is some consistency. When I ran the above test 10
> consecutive times, there were only two types of output. On 8/10 runs,
> bar was missing the same 6,607 (5,138,895 - 5,132,288) byte chunk. On
> the remaining 2/10 runs, bar was missing the same 2,511 byte chunk.
> 
> As mentioned in my original post, the missing chunk is always at the
> end (or beginning in the tac example) of bar. It's as if the pipe exits
> too early, before all the data can make it through.
> 
> I'm attaching foo, bar1, and bar2 from the above example (compressed
> with 7zip).
> 
> Greetings,
> Lawrence

A couple of observations that might trigger a clear thought. The numbers 5,132,288 and 5,138,895 are multiples of 4096. Assuming a standard 4096-byte block, these sizes of "bar" are files of size 1253 and 1254 blocks. The file "foo" only contains 1254 blocks with a remainder of 2511 bytes. Since the last block, or sometimes the last two blocks, are not copied, this might imply some type of race condition that only appears on Lawrence's machine. Christopher's machine might be faster and not subject to this race condition.

Lawrence: what is the hardware that your are running this test upon? What other processes are running at the same time (e.g. CPU usage, I/O usage, etc.)?

It would appear the leading "tr" writes the file "foo" to the pipe, and closes the pipe. This may cause the trailing "tr" to get a signal that it does not handle well before it can complete the read from the pipe. If the hardware is too slow, or occupied, then perhaps it happens because of this rather than on other hardware which might be faster (or perhaps the reverse).

Christopher: could you run the example in a mode where your computer is heavily loaded with other tasks?

Only a suggestion.

Regards,

-Allan

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

On 081222 16:48, Allan Schrum wrote:
> The numbers 5,132,288 and 5,138,895 are multiples of 4096.

Thanks for writing Allan. I think you mean 5,132,288 and 5,136,384 (the 
two output sizes) are multiples of 4096.

> Lawrence: what is the hardware that your are running this test upon? What other processes are running at the same time (e.g. CPU usage, I/O usage, etc.)?

Please see my previous post, where I found the same bug on different 
hardware running a different OS. Here are more details:

Computer 1 (from my original post):
Motherboard: Shuttle AK31 v3.1
Chipset: Via KT266 northbridge, VT8233 southbridge
CPU: Athlon XP 2000+ @ 2 GHz
Memory: 512 MB DDR
OS: Windows Server 2003 sp2 32 bit on NTFS
CPU usage: 0-1% normally, 22-23% max during Cygwin tests
Handles 3907 Threads 192 Processes 23
Commit Charge (K): Total 294448 Limit 533992 Peak 426364
Physical Memory (K): Total 523752 Available 180124 System Cache 235732
Kernel Memory (K): Total 53912 Paged 34284 Nonpaged 19628


Computer 2 (from my previous post):
Motherboard: MSI K7N2 Delta
Chipset: Nvidia Nforce2
CPU: Athlon XP 3200+ @ 2.13 GHz
Memory: 2 GB DDR
OS: Windows XP Home sp2 32 bit on NTFS
CPU usage: 0-1% normally, 21-22% max during Cygwin tests
Handles 3904 Threads 193 Processes 23
Commit Charge (K): Total 717884 Limit 1964364 Peak 841376
Physical Memory (K): Total 2096624 Available 1161980 System Cache 1298916
Kernel Memory (K): Total 104788 Paged 76104 Nonpaged 28696

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

RE: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Allan Schrum]

> -----Original Message-----
> From: cygwin-owner@cygwin.com [mailto:cygwin-owner@cygwin.com] On
> Behalf Of Lawrence Mayer
> Sent: Monday, December 22, 2008 9:28 PM
> To: cygwin@cygwin.com
> Subject: Re: [1.7] Pipes intermittently lose data on Cygwin 1.7
> 
> On 081222 16:48, Allan Schrum wrote:
> > The numbers 5,132,288 and 5,138,895 are multiples of 4096.
> 
> Thanks for writing Allan. I think you mean 5,132,288 and 5,136,384 (the
> two output sizes) are multiples of 4096.
> 
Yes - thanks - copying too many numbers can result in silly errors.

> > Lawrence: what is the hardware that your are running this test upon?
> What other processes are running at the same time (e.g. CPU usage, I/O
> usage, etc.)?
> 
> Please see my previous post, where I found the same bug on different
> hardware running a different OS. Here are more details:
> 
> Computer 1 (from my original post):
> Motherboard: Shuttle AK31 v3.1
> Chipset: Via KT266 northbridge, VT8233 southbridge
> CPU: Athlon XP 2000+ @ 2 GHz
> Memory: 512 MB DDR
> OS: Windows Server 2003 sp2 32 bit on NTFS
> CPU usage: 0-1% normally, 22-23% max during Cygwin tests
> Handles 3907 Threads 192 Processes 23
> Commit Charge (K): Total 294448 Limit 533992 Peak 426364
> Physical Memory (K): Total 523752 Available 180124 System Cache 235732
> Kernel Memory (K): Total 53912 Paged 34284 Nonpaged 19628
> 
> 
> Computer 2 (from my previous post):
> Motherboard: MSI K7N2 Delta
> Chipset: Nvidia Nforce2
> CPU: Athlon XP 3200+ @ 2.13 GHz
> Memory: 2 GB DDR
> OS: Windows XP Home sp2 32 bit on NTFS
> CPU usage: 0-1% normally, 21-22% max during Cygwin tests
> Handles 3904 Threads 193 Processes 23
> Commit Charge (K): Total 717884 Limit 1964364 Peak 841376
> Physical Memory (K): Total 2096624 Available 1161980 System Cache
> 1298916
> Kernel Memory (K): Total 104788 Paged 76104 Nonpaged 28696
> 

Would it be worth trying to heavily load one of your computers to see if the problem presents itself differently? It is obvious that your systems are fast!

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

On 081222 19:02, Allan Schrum wrote:
> Would it be worth trying to heavily load one of your computers to see if the problem presents itself differently? It is obvious that your systems are fast!

Allan, at your suggestion, I repeated the trials on Computer 1 (details 
in previous post) under two opposite load conditions:

Condition 1: Maximum Load
All Cygwin trials performed during continuous run of Stress Prime 2004's 
Blend Test http://sp2004.fre3.com/ , a torture test which I use for 
stability testing when overclocking. The Blend Test stresses both CPU 
and RAM and keeps CPU usage at 100%.

Condition 2: Minimum Load
All Cygwin tests performed with minimum other apps running: just one DOS 
window (to run Cygwin tests) and one Explorer window (to keep track of 
bar's size).

Running a DOS window (cmd.exe) with Example 1 of my original post

	tr \32 \0 < foo | tr \0 \32 > bar

I ran 21 trials under each load condition with the following results:

Condition 1 (Maximum Load)
	foo = 5,138,895 bytes
	bar = 5,138,895 bytes (no error)	on 1 trial
	bar = 5,136,384 bytes (1254 x 4096)	on 6 trials
	bar = 5,132,288 bytes (1253 x 4096)	on 14 trials

Condition 2 (Minimum Load)
	foo = 5,138,895 bytes
	bar = 5,138,895 bytes (no error)	on 1 trial
	bar = 5,136,384 bytes (1254 x 4096)	on 2 trials
	bar = 5,132,288 bytes (1253 x 4096)	on 18 trials

As you can see, there was little difference in Cygwin's behavior under 
opposite load conditions. If anything, Cygwin did better under Condition 
1 (Maximum Load), but I don't think the difference is statistically 
significant.

Greetings,
Lawrence

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Christopher Faylor]

On Mon, Dec 22, 2008 at 04:27:14PM -0800, Lawrence Mayer wrote:
>>>> Too bad.  Since I can't duplicate the problem it will be difficult to
>>>> fix it.
>
>>> Have you tried running the examples I provided in my original post
>>> (with foo = ~ 5MB text file) on a DOS shell (cmd.exe)?
>
>> Yes.  That's what I meant by "I can't duplicate the problem".
>
> Just ran current snapshot cygwin-inst-20081220 on a different computer 
> running a different OS: Windows XP Home sp2 32 bit on NTFS. See attached 
> output from cygcheck. Both this and the previous computer have Athlon XP+ 
> CPUs.
>
> Running a DOS window (cmd.exe) with Example 1 of my original post
>
>     tr \32 \0 < foo | tr \0 \32 > bar
>
> using the same input file foo attached to my previous post gives:
>
>     foo = 5,138,895 bytes
>     bar = 5,132,288 bytes

I'm uploading a new version of the DLL now.  Please give it a try.  It
should be there in 5 - 10 minutes.

http://cygwin.com/snapshots/

cgf

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/

Re: [1.7] Pipes intermittently lose data on Cygwin 1.7

[Lawrence Mayer]

On 081223 10:59, Christopher Faylor wrote:
> I'm uploading a new version of the DLL now.  Please give it a try.  It
> should be there in 5 - 10 minutes.
>
> http://cygwin.com/snapshots/

Bug appears fixed in current snapshot cygwin-inst-20081223! Thanks 
Christopher! I appreciate your work. I'm especially impressed if you 
were able to fix this bug without even being able to duplicate it.

Holiday Greetings,
Lawrence

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/