From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.137]) by sourceware.org (Postfix) with ESMTPS id 56F53386EC47 for ; Fri, 8 Jan 2021 16:52:30 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 56F53386EC47 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=SystematicSw.ab.ca Authentication-Results: sourceware.org; spf=none smtp.mailfrom=brian.inglis@systematicsw.ab.ca Received: from [192.168.1.104] ([24.64.172.44]) by shaw.ca with ESMTP id xuzzkhXYMbYg3xv00kpO1d; Fri, 08 Jan 2021 09:52:28 -0700 X-Authority-Analysis: v=2.4 cv=Q4RsX66a c=1 sm=1 tr=0 ts=5ff88dcc a=kiZT5GMN3KAWqtYcXc+/4Q==:117 a=kiZT5GMN3KAWqtYcXc+/4Q==:17 a=IkcTkHD0fZMA:10 a=srm7gmjjAAAA:8 a=Lfi0IGIEAAAA:8 a=TImcKGuyeGIbufSLrCcA:9 a=QEXdDO2ut3YA:10 a=LYwJG3PkshbpebU8YZOc:22 a=3gmJrRwo7HZU4ah-P2rN:22 Reply-To: cygwin-apps@cygwin.com To: cygwin-apps@cygwin.com References: <3cd5f2f8-b292-0ac1-de18-753a4513f6ba@gmail.com> <87wnwnk1er.fsf@Otto.invalid> From: Brian Inglis Organization: Systematic Software Subject: Re: scallywag / cygport not pulling lzip Message-ID: Date: Fri, 8 Jan 2021 09:52:27 -0700 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-CA Content-Transfer-Encoding: 8bit X-CMAE-Envelope: MS4xfHC/8vlr2XIWVjSYR5G3LcBIwVLGTzDIArG2jx8JT1aWRh8/YpcNOhmanu3dU+6sjj8DgmdK5oYBYZVfor0tNUTNBVzOR5gqhkxSiTTsu72DzSrPGppf SpHForVJNRwtdG6LQb8ukV5mMeQl8XbZ56fqrbj1pDC8M4E9Wyz80h0qBppKwzDe2wygc+alAiY4tAfZ2DsRMsSVu/J0lqiuEHg= X-Spam-Status: No, score=-4.4 required=5.0 tests=BAYES_00, BODY_8BITS, KAM_DMARC_STATUS, KAM_LAZY_DOMAIN_SECURITY, NICE_REPLY_A, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H3, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: cygwin-apps@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin package maintainer discussion list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Jan 2021 16:52:32 -0000 On 2021-01-08 07:21, Jon Turney wrote: > On 08/01/2021 13:58, Marco Atzeri via Cygwin-apps wrote: >> On 08.01.2021 14:23, ASSI wrote: >>> Marco Atzeri via Cygwin-apps writes: >>>> it seems that cygport is not pulling the decompressor >>>> that is supposed to recognise: >>>> >>>> https://ci.appveyor.com/project/cygwin/scallywag/builds/37134000/job/0m9h56ptrwwyg3hc >>>> >>>> >>>>>> Unpacking source flex-2.6.4.tar.lz >>>> tar (child): lzip: Cannot exec: No such file or directory >>>> tar (child): Error is not recoverable: exiting now >>>> tar: Child returned status 2 >>>> tar: Error is not recoverable: exiting now >>>> *** ERROR: tar xf flex-2.6.4.tar.lz failed >>> >>> Since tar is a Base package it doesn't require lzip (which would >>> effectively make it a Base install).  You have to add lzip to >>> BUILD_REQUIRES or switch to the GZip archive. >>> >>> >>> Regards, >>> Achim. >>> >> >> Hi Achim, >> >> this is an upstream source package. >> >> IMHO cygport should pull tar and all the decompressor that >> is supposed to manage. >> >>   $ grep  SRC_URI NEWS >> ... >>          * SRC_URI supports .tar.lz archives. >>          * SRC_URI accepts .tar.xz archives. >>          * SRC_URI accepts .tar.lzo archives. >> ... > > Yeah, perhaps lzip should be a dependency of cygport. ...and zstd as Achim is working on that. I do not think we should encourage use of lower compression ratio packages in cygport and calm, and their libraries in setup. It appears zstd gives up compression to gain faster decompression with less memory which may be advantageous for loading a kernel, but less optimal for MBs of base packages. [Download size will remain significant in regions with poor or unreliable infrastructure, and that may include large rural populations and remote areas in developed countries, where achievable transfer rates and/or download limits are low, base data charges or overages are expensive e.g. Canada telecomm costs are higher than most other countries, has many areas with limited services, and remote communities and indigenous reservations may still have only metered landline/microwave service AKA long distance dialup at best, and many northern and western areas of Canada and the US still have little or no GSM mobile coverage, perhaps only legacy systems https://www.gsma.com/coverage/ ]. > For the moment, I've applied a tweak to scallywag to ensure lzip gets installed. ...and zstd also please. Perhaps consideration should also be given to setting appropriate compression defaults in cygport for all supported package compressors e.g. GZIP=-9, XZ_OPT=-7 which does not increase the memory required from the default -6 but improves compression, ZSTD_CLEVEL=19 and ZSTD_NBTHREADS=`nproc` perhaps? -- Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada This email may be disturbing to some readers as it contains too much technical detail. Reader discretion is advised. [Data in binary units and prefixes, physical quantities in SI.]