From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtpout2.vodafonemail.de (smtpout2.vodafonemail.de [145.253.239.133]) by sourceware.org (Postfix) with ESMTPS id B4D7D3858D35 for ; Sun, 9 Jan 2022 11:05:29 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org B4D7D3858D35 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=nexgo.de Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=nexgo.de Received: from smtp.vodafone.de (smtpa08.fra-mediabeam.com [10.2.0.39]) by smtpout2.vodafonemail.de (Postfix) with ESMTP id A5DF260CFE for ; Sun, 9 Jan 2022 12:05:27 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nexgo.de; s=vfde-smtpout-mb-15sep; t=1641726327; bh=prJnqVbN9B/PRLok/mJEJm5/YqkP2LL1ne6n4yZyuL4=; h=From:To:Subject:Date; b=G1b6on5LpvFdv5MDK3w94mvDTGZ+y/Jmf7u2cddRBAS3yG4gD8fNQfyozilc+jJ3p lK7oIm0loWmvgljTmq/BmfUx2JYU9Z2CMLZBl0HE5nittA+ADOMVdWvYAsnEfLtSRn +NQMPMaslQSoztBn6nnT1K0kvnvgvl/PfHmycBCc= Received: from Gertrud (p5b2f3fbc.dip0.t-ipconnect.de [91.47.63.188]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by smtp.vodafone.de (Postfix) with ESMTPSA id 4JWvJ70CgXz9sFP for ; Sun, 9 Jan 2022 11:05:23 +0000 (UTC) From: Achim Gratz To: cygwin-apps@cygwin.com Subject: Using ZChunk for =?utf-8?Q?setup=E2=80=A6?= Date: Sun, 09 Jan 2022 12:05:17 +0100 Message-ID: <87h7ad5fv6.fsf@Rainer.invalid> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-purgate-type: clean X-purgate-Ad: Categorized by eleven eXpurgate (R) http://www.eleven.de X-purgate: This mail is considered clean (visit http://www.eleven.de for further information) X-purgate: clean X-purgate-size: 1753 X-purgate-ID: 155817::1641726327-000051D6-05862BB8/0/0 X-Spam-Status: No, score=-3030.0 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_BARRACUDACENTRAL, RCVD_IN_DNSWL_LOW, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: cygwin-apps@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin package maintainer discussion list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Jan 2022 11:05:32 -0000 I've been experimenting with ZChunk with the idea of eventually using it for setup: https://www.jdieter.net/posts/2018/05/31/what-is-zchunk/ https://github.com/zchunk/zchunk The chunked ini file is ~10=E2=80=A615% larger than the original (after compression). In order to minimize the overhead, I've re-arranged the package entries to have one chunk for every source package. The actual benefit is that the typical download size reduces to less than 5% of the original. Two examples of much longer timespans between updates are provided at the end, which would still download only around a third of the original: --8<---------------cut here---------------start------------->8--- # no changes, only header gets downloaded update from 20220109 to 20220109 Would download 82277 of 4061994 bytes Matched 4103 of 4103 chunks update from 20220106 to 20220109 Would download 112022 of 4061994 bytes Matched 4078 of 4103 chunks update from 20211221 to 20220106 Would download 172069 of 4061583 bytes Matched 4024 of 4103 chunks update from 20211218 to 20211221 Would download 216879 of 4052330 bytes Matched 4012 of 4098 chunks update from 20211204 to 20211218 Would download 248101 of 4020714 bytes Matched 3997 of 4097 chunks update from 20200102 to 20210703 Would download 1438581 of 3960442 bytes Matched 2938 of 4087 chunks update from 20190101 to 20200102 Would download 1139408 of 3723670 bytes Matched 3142 of 3987 chunks --8<---------------cut here---------------end--------------->8--- WDYT? Regards, Achim. --=20 +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ Wavetables for the Terratec KOMPLEXER: http://Synth.Stromeko.net/Downloads.html#KomplexerWaves