From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from barramail.cs.umass.edu (barramail.cs.umass.edu [128.119.240.3]) by sourceware.org (Postfix) with ESMTPS id 9DF673856DC0 for ; Tue, 29 Aug 2023 13:43:32 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 9DF673856DC0 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=cs.umass.edu Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=cs.umass.edu X-ASG-Debug-ID: 1693316611-24039d7c1760fe70001-w5GHUG Received: from mailsrv.cs.umass.edu (mailsrv.cs.umass.edu [128.119.240.136]) by barramail.cs.umass.edu with ESMTP id 35Pz1Qjg7zaHzHxQ (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 29 Aug 2023 09:43:31 -0400 (EDT) X-Barracuda-Envelope-From: moss@cs.umass.edu X-Barracuda-RBL-Trusted-Forwarder: 128.119.240.136 Received: from [192.168.50.148] (c-24-62-201-179.hsd1.ma.comcast.net [24.62.201.179]) by mailsrv.cs.umass.edu (Postfix) with ESMTPSA id 705504012542; Tue, 29 Aug 2023 09:43:31 -0400 (EDT) Message-ID: X-Barracuda-RBL-Trusted-Forwarder: 192.168.50.148 Date: Tue, 29 Aug 2023 09:43:30 -0400 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Reply-To: moss@cs.umass.edu Subject: Re: Faster rsync? Content-Language: en-US X-ASG-Orig-Subj: Re: Faster rsync? To: Mario Emmenlauer , Adam Kessel , cygwin@cygwin.com References: <65367e55-57ab-22ec-d651-85ec5afe0416@rosi-kessel.org> <4a3ca0f6-128e-adb7-0140-cacb20f06544@emmenlauer.de> From: Eliot Moss In-Reply-To: <4a3ca0f6-128e-adb7-0140-cacb20f06544@emmenlauer.de> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Barracuda-Connect: mailsrv.cs.umass.edu[128.119.240.136] X-Barracuda-Start-Time: 1693316611 X-Barracuda-Encrypted: ECDHE-RSA-AES128-GCM-SHA256 X-Barracuda-URL: https://barramail.cs.umass.edu:443/cgi-mod/mark.cgi X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at cs.umass.edu X-Barracuda-Scan-Msg-Size: 1512 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=5.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.113393 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,JMQ_SPF_NEUTRAL,KAM_DMARC_STATUS,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On 8/29/2023 9:17 AM, Mario Emmenlauer via Cygwin wrote: > On 29.08.23 14:32, Adam Kessel via Cygwin wrote: >> I've found rsync to be painfully slow on large folders -- hours to sync thousands of files, even >> when they already match size and --size-only is used. It's much faster between native Linux boxes. I've been told (on this list) that how you mount the Windows drive in Cygwin matters. I use this in my /etc/fstab: d:/ /cygdrive/d ntfs binary,posix=0,user,auto,notexec 0 0 Unfortunately, it's still not as quick as I think it ought to be. (If someone out there can recommend better settings, I'm open!) I regularly rsync a collection of hundreds of files, each about 2Gb in size. Windows describes the partition as an NTFS Basic Data Partition. It takes rsync a long time to get started (i.e., to figure out which files need transferring). My rsync uses these flags: rsync -avuP --partial --partial-dir=.rsync-partial --log-file=... --log-file-format=... > I've been using rsync, unison and similar tools on Windows and Linux since basically forever. In my > humble opinion, the problem is the Windows file system performance, not the synchronization tools. > As a separate example, try to download the boost source code, and extract the archive. I can do the > extraction in way under a minute on Linux, but have to wait many many minutes on a similarly > equipped Windows machine. > > Just my two cents. > >     Mario > Regards - Eliot Moss