From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from barramail.cs.umass.edu (barramail.cs.umass.edu [128.119.240.3]) by sourceware.org (Postfix) with ESMTPS id E08B33858D20 for ; Tue, 29 Aug 2023 17:55:29 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org E08B33858D20 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=cs.umass.edu Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=cs.umass.edu X-ASG-Debug-ID: 1693331727-24039d7c17637120001-w5GHUG Received: from mailsrv.cs.umass.edu (mailsrv.cs.umass.edu [128.119.240.136]) by barramail.cs.umass.edu with ESMTP id AI9GtZrB7hWrljdx (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 29 Aug 2023 13:55:27 -0400 (EDT) X-Barracuda-Envelope-From: moss@cs.umass.edu X-Barracuda-RBL-Trusted-Forwarder: 128.119.240.136 Received: from [192.168.50.148] (c-24-62-201-179.hsd1.ma.comcast.net [24.62.201.179]) by mailsrv.cs.umass.edu (Postfix) with ESMTPSA id A0639401059D; Tue, 29 Aug 2023 13:55:27 -0400 (EDT) Message-ID: X-Barracuda-RBL-Trusted-Forwarder: 192.168.50.148 Date: Tue, 29 Aug 2023 13:55:27 -0400 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Reply-To: moss@cs.umass.edu Subject: Re: Faster rsync? Content-Language: en-US X-ASG-Orig-Subj: Re: Faster rsync? From: Eliot Moss To: Mario Emmenlauer , Adam Kessel , cygwin@cygwin.com References: <65367e55-57ab-22ec-d651-85ec5afe0416@rosi-kessel.org> <4a3ca0f6-128e-adb7-0140-cacb20f06544@emmenlauer.de> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Barracuda-Connect: mailsrv.cs.umass.edu[128.119.240.136] X-Barracuda-Start-Time: 1693331727 X-Barracuda-Encrypted: ECDHE-RSA-AES128-GCM-SHA256 X-Barracuda-URL: https://barramail.cs.umass.edu:443/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at cs.umass.edu X-Barracuda-Scan-Msg-Size: 1239 X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=5.7 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.113401 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,JMQ_SPF_NEUTRAL,KAM_DMARC_STATUS,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On 8/29/2023 9:43 AM, Eliot Moss wrote: > On 8/29/2023 9:17 AM, Mario Emmenlauer via Cygwin wrote: >> On 29.08.23 14:32, Adam Kessel via Cygwin wrote: >>> I've found rsync to be painfully slow on large folders -- hours to sync thousands of files, even >>> when they already match size and --size-only is used. It's much faster between native Linux boxes. > > I've been told (on this list) that how you mount the Windows drive in Cygwin matters. > > I use this in my /etc/fstab: > > d:/ /cygdrive/d ntfs binary,posix=0,user,auto,notexec 0 0 > > Unfortunately, it's still not as quick as I think it ought to be. > (If someone out there can recommend better settings, I'm open!) > > I regularly rsync a collection of hundreds of files, each about 2Gb in size. > > Windows describes the partition as an NTFS Basic Data Partition.  It takes > rsync a long time to get started (i.e., to figure out which files need > transferring). > > My rsync uses these flags: > > rsync -avuP --partial --partial-dir=.rsync-partial --log-file=... --log-file-format=... These flags seems to give speedy directory scanning: rsync -r --chmod=D2700,F600 -t -z -p -v --size-only --partial-dir=.rsync-partial Regards - EM