From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ot1-x335.google.com (mail-ot1-x335.google.com [IPv6:2607:f8b0:4864:20::335]) by sourceware.org (Postfix) with ESMTPS id C04E03857811 for ; Mon, 31 Jan 2022 15:13:56 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org C04E03857811 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com Received: by mail-ot1-x335.google.com with SMTP id e21-20020a9d0195000000b005a3cd7c1e09so6577880ote.6 for ; Mon, 31 Jan 2022 07:13:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=message-id:date:mime-version:user-agent:subject:content-language:to :newsgroups:references:from:in-reply-to:content-transfer-encoding; bh=kcZXUKkVPX/NKlbfkzb+fJBPNeuD+PxGN0sjj3r31+o=; b=hNOTk9+AwMIpxelp6G5uLoS7G7nboW5DYD0rra3SxeiCRKtGFZQbMgHTDuEQ4tKLGY Fi4QJnZhetJjsikW+QOmVnu5NSe/X9t7IHqFbWvkgPYmeelV7IefErFTom9SZfNQq9ub OP+XVyQ2HzRekD+bObj5r6CQPioCHbgk+q9SF18x7si3Ke1S0gSC4YQ7qS56BcpZaF5v v8HFsbIC/MPrSdguT8fkR2D3b05hfGt0W69/CislvN+9EzmYArQIM5M7owIodP+z7I7t Ed/6Cc0WWnaNYsoTU3jOV3dx6Md7bxZLkddAbo7c+YblCi9D3rXg7IIPdCfVWOqvZHrn et9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:to:newsgroups:references:from:in-reply-to :content-transfer-encoding; bh=kcZXUKkVPX/NKlbfkzb+fJBPNeuD+PxGN0sjj3r31+o=; b=c6vKX5cwLGusqoL6t+MyDg2jnVO9R6+q3EVVjt7je2qXQWZNl0tj4HbflAy0e0vcI6 ckVadtW2Pj4yUDh8Y+hrjeFZluotAFnqTik6IE1hyBCzYuA6Ha1jLNpeRcshjWHEdgR+ qRqQf+qs6nK+LnCXUcckE5NYq1ydp9GQuRll2oMS0LxeEB3MqN81KqBTYx47kTmIEkEC Z8InYlG45KoCRX1j2ecErSY3aVaRemXHSAs0k7lXzYgKCMQIKVzLte0I4098aA91l33r VRUowvJBoBDYaOPXpvvHKuVVX5JXFeUdjF1xCRtoZtt+DdM7PPlq6r60feRjt9Md0wUJ exng== X-Gm-Message-State: AOAM531vu6PwzrvaA3oGzX+5H9We8taYTSOlo+9Vd8DHt7blvWOwkwpe PmtiEhYR4isXsNseBhuqKJsxwyfV1sa73w== X-Google-Smtp-Source: ABdhPJzVx7NZ78Cnb8dw0SJXutB2LHe/yx/8sgiQ8KJp7NsJiHPGk0dF4U2BpbjZF7d5iSry7JhVIw== X-Received: by 2002:a9d:2278:: with SMTP id o111mr11398945ota.278.1643642035989; Mon, 31 Jan 2022 07:13:55 -0800 (PST) Received: from [192.168.10.5] (dial-200-57-195-23.zone-3.ip.static-ftth.axtel.net.mx. [200.57.195.23]) by smtp.gmail.com with ESMTPSA id c21sm8685442oto.55.2022.01.31.07.13.55 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 31 Jan 2022 07:13:55 -0800 (PST) Message-ID: Date: Mon, 31 Jan 2022 09:13:59 -0600 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.19) Gecko/20081209 Lightning/0.9 Thunderbird/2.0.0.19 Mnenhy/0.7.6.0 Subject: Re: Renaming (with 'mv') very large files is SLOW Content-Language: en-US To: cygwin@cygwin.com Newsgroups: gmane.os.cygwin References: <25079.63376.349893.86395@consult.pretender> From: =?UTF-8?Q?Ren=c3=a9_Berber?= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_FROM, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: cygwin@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: General Cygwin discussions and problem reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Jan 2022 15:13:58 -0000 On 1/31/2022 8:59 AM, Eliot Moss wrote: > On 1/31/2022 9:52 AM, cygwin@kosowsky.org wrote: >> I tried renaming some very large files (20-40 GB) using: mv >> without changing the directory of course. >> >> The process took about 10-20 minutes with Task Manager showing >> disk activity of 100+ MB/s. >> >> Is there something about such large 'renaming' that actually >> results in the file being really moved (aka copied) rather than >> just renamed? > > The two places are probably on different volumes (loosely, different > disks). That requires a physical move, even under Linux. Your > volumes seem a bit slow to access - is one perhaps across a slow > network? The rates you cite suggest movement of 50Mb/s (50Mb read + > 50Mb write = 100Mb overall). For 40 Gb that should take 40Gb / 50Mb > = about 820 secs = a little under 14 mins. > > (When I say your volumes are slow, I speak from the luxury of having > a 2Tb solid state drive! Actually, those speeds may be reasonable > depending on the nature of your system.) > > If the two locations are on different drives, there's no real > avoiding this. Nope, I've also complained about this (long ago), if the two locations are the same remote drive... Cygwin moves the entire file over the network. I ended up writing my own Samba mv command. -- R. Berber