From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 51343 invoked by alias); 22 Oct 2017 13:11:43 -0000 Mailing-List: contact cygwin-apps-help@cygwin.com; run by ezmlm Precedence: bulk Sender: cygwin-apps-owner@cygwin.com List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Mail-Followup-To: cygwin-apps@cygwin.com Received: (qmail 51293 invoked by uid 89); 22 Oct 2017 13:11:43 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-6.4 required=5.0 tests=AWL,BAYES_00,GIT_PATCH_2,SPF_PASS autolearn=ham version=3.3.2 spammy=contemporary, patent, Facebook, Hx-languages-length:4002 X-HELO: vsmx009.vodafonemail.xion.oxcs.net Received: from vsmx009.vodafonemail.xion.oxcs.net (HELO vsmx009.vodafonemail.xion.oxcs.net) (153.92.174.87) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Sun, 22 Oct 2017 13:11:41 +0000 Received: from vsmx001.vodafonemail.xion.oxcs.net (unknown [192.168.75.191]) by mta-5-out.mta.xion.oxcs.net (Postfix) with ESMTP id B7293C41C1 for ; Sun, 22 Oct 2017 13:11:38 +0000 (UTC) Received: from Gertrud (unknown [91.47.62.96]) by mta-5-out.mta.xion.oxcs.net (Postfix) with ESMTPA id 89BF730084A for ; Sun, 22 Oct 2017 13:11:36 +0000 (UTC) From: Achim Gratz To: cygwin-apps@cygwin.com Subject: [ITP] Zstd compression tools and libraries Date: Sun, 22 Oct 2017 13:11:00 -0000 Message-ID: <87376bgwdz.fsf@Rainer.invalid> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-VADE-STATUS: LEGIT X-SW-Source: 2017-10/txt/msg00096.txt.bz2 I would like to package Zstd for Cygwin. The latest release of Zstd is BSD/GPLv2 dual-licensed (the Facebook Patent clause it had applied earlier has been dropped). Support for LZ4, Xz/LZMA GZip formats is compiled in. There are packages available for the major GNU/Linux distributions and Zstd is be built into the Linux kernel for filesystem compression since 4.14. I'd like to thank Yaakov for helping with getting the custom build system patched up so it does something sensible on Cygwin. Zstd has a wide range of compression levels, starting out at roughly comparable to gzip in compression ratio while compressing much faster to not-quite LZMA compression ratio at about the same speed or slightly slower. Decompression is a lot faster than either of these, both decompression to the file system and even more so decompression into memory. Multithreaded operation is optionally possible for both compression and decompression, although usually compression benefits more. LZO and LZ4 are faster in both respects still, but have typically significantly worse compression ratio. This means that in many practical cases performance will be limited by network or filesystem throughput while storage requirements are roughly the same as they are with other contemporary solutions. root=http://cygwin.stromeko.net/ repo=$root/maint/$arch/release/zstd --8<---------------cut here---------------start------------->8--- $repo/zstd-1.3.2-1-src.tar.xz $repo/zstd-1.3.2-1.hint $repo/zstd-1.3.2-1.tar.xz $repo/libzstd-devel/libzstd-devel-1.3.2-1.hint $repo/libzstd-devel/libzstd-devel-1.3.2-1.tar.xz $repo/libzstd1/libzstd1-1.3.2-1.hint $repo/libzstd1/libzstd1-1.3.2-1.tar.xz $repo/zstd-debuginfo/zstd-debuginfo-1.3.2-1.hint $repo/zstd-debuginfo/zstd-debuginfo-1.3.2-1.tar.xz --8<---------------cut here---------------end--------------->8--- Since I hope to eventually use Zstd in setup.exe, the following cross-compilation packages are available as well. root=http://cygwin.stromeko.net/ repo=$root/maint/noarch/release --8<---------------cut here---------------start------------->8--- $repo/mingw64-i686-zstd/mingw64-i686-zstd-debuginfo/mingw64-i686-zstd-debuginfo-1.3.2-1.hint $repo/mingw64-i686-zstd/mingw64-i686-zstd-debuginfo/mingw64-i686-zstd-debuginfo-1.3.2-1.tar.xz $repo/mingw64-i686-zstd/mingw64-i686-zstd-1.3.2-1-src.tar.xz $repo/mingw64-i686-zstd/mingw64-i686-zstd-1.3.2-1.hint $repo/mingw64-i686-zstd/mingw64-i686-zstd-1.3.2-1.tar.xz $repo/mingw64-x86_64-zstd/mingw64-x86_64-zstd-debuginfo/mingw64-x86_64-zstd-debuginfo-1.3.2-1.hint $repo/mingw64-x86_64-zstd/mingw64-x86_64-zstd-debuginfo/mingw64-x86_64-zstd-debuginfo-1.3.2-1.tar.xz $repo/mingw64-x86_64-zstd/mingw64-x86_64-zstd-1.3.2-1-src.tar.xz $repo/mingw64-x86_64-zstd/mingw64-x86_64-zstd-1.3.2-1.hint $repo/mingw64-x86_64-zstd/mingw64-x86_64-zstd-1.3.2-1.tar.xz --8<---------------cut here---------------end--------------->8--- Alternatively, point setup.exe at $root and it should offer those packages for installation. The setup.ini is signed with my PGP key available at $root/stromeko.gpg, which you can download and then feed to setup.exe via the -K switch. The fingerprint of that key is: B22B 4890 B89E 5E5A 795C E305 B40B EC75 3152 B1C3 If you have the keyart script (Python, you can just download from https://raw.githubusercontent.com/atoponce/keyart/master/keyart), this is what you should see after importing the key into your public keyring: > keyart stromeko +-----[DSA 2048]----+ | ^. | | ^ . | | ^ E | | . . ^ : | |. . ^ : . | |.^ . ^.:S | | .. . :^. | |. .^ ^.^ | |. ^:.^ .. | | ^:... . | |.^ . | +-----[3152B1C3]----+ +-------------------+ | :X| | . ^^^| | : ..^| | . : . E | | i . . . | | ^ S l : . | | i l ^ ^ | | ^ . . | | . . | | . . | | ... | +-------------------+ Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ Factory and User Sound Singles for Waldorf Q+, Q and microQ: http://Synth.Stromeko.net/Downloads.html#WaldorfSounds