[PATCH] src-release.sh: Use -T0 for xz compression

[PATCH] src-release.sh: Use -T0 for xz compression

[Mark Wielaard]

Use parallel compression to create the xz archive.

On my machine (using 4 cores) this reduces the time to create
binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.

xz has supported -T0 since version 5.2.0 (released 2014-12-21).
---
 src-release.sh | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/src-release.sh b/src-release.sh
index e454893298da..f29362aac207 100755
--- a/src-release.sh
+++ b/src-release.sh
@@ -239,7 +239,7 @@ do_xz()
     ver=$2
     echo "==> Xzipping $package-$ver.tar.xz"
     rm -f $package-$ver.tar.xz
-    $XZPROG -k -v -9 $package-$ver.tar
+    $XZPROG -k -v -9 -T0 $package-$ver.tar
 }
 
 # Compress the output with zstd
-- 
2.45.1

Re: [PATCH] src-release.sh: Use -T0 for xz compression

[Sam James]

[-- Attachment #1: Type: text/plain, Size: 908 bytes --]

Mark Wielaard <mark@klomp.org> writes:

> Use parallel compression to create the xz archive.
>
> On my machine (using 4 cores) this reduces the time to create
> binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.
>
> xz has supported -T0 since version 5.2.0 (released 2014-12-21).

LGTM and it's the default from >=5.6.0 anyway. For >=5.4.0, you can use
it for parallel *de*compression too.

> ---
>  src-release.sh | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/src-release.sh b/src-release.sh
> index e454893298da..f29362aac207 100755
> --- a/src-release.sh
> +++ b/src-release.sh
> @@ -239,7 +239,7 @@ do_xz()
>      ver=$2
>      echo "==> Xzipping $package-$ver.tar.xz"
>      rm -f $package-$ver.tar.xz
> -    $XZPROG -k -v -9 $package-$ver.tar
> +    $XZPROG -k -v -9 -T0 $package-$ver.tar
>  }
>  
>  # Compress the output with zstd

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 377 bytes --]

Re: [PATCH] src-release.sh: Use -T0 for xz compression

[Sam James]

[-- Attachment #1: Type: text/plain, Size: 1066 bytes --]

Sam James <sam@gentoo.org> writes:

> Mark Wielaard <mark@klomp.org> writes:
>
>> Use parallel compression to create the xz archive.
>>
>> On my machine (using 4 cores) this reduces the time to create
>> binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.
>>
>> xz has supported -T0 since version 5.2.0 (released 2014-12-21).
>
> LGTM and it's the default from >=5.6.0 anyway. For >=5.4.0, you can use
> it for parallel *de*compression too.
>

Note that we made the same change for GCC a while ago in r13-4261-g2650b6f9147c0d.

>> ---
>>  src-release.sh | 2 +-
>>  1 file changed, 1 insertion(+), 1 deletion(-)
>>
>> diff --git a/src-release.sh b/src-release.sh
>> index e454893298da..f29362aac207 100755
>> --- a/src-release.sh
>> +++ b/src-release.sh
>> @@ -239,7 +239,7 @@ do_xz()
>>      ver=$2
>>      echo "==> Xzipping $package-$ver.tar.xz"
>>      rm -f $package-$ver.tar.xz
>> -    $XZPROG -k -v -9 $package-$ver.tar
>> +    $XZPROG -k -v -9 -T0 $package-$ver.tar
>>  }
>>  
>>  # Compress the output with zstd

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 377 bytes --]

Re: [PATCH] src-release.sh: Use -T0 for xz compression

[Eli Zaretskii]

> From: Sam James <sam@gentoo.org>
> Cc: binutils@sourceware.org,  gdb-patches@sourceware.org
> Date: Thu, 30 May 2024 22:56:50 +0100
> 
> > On my machine (using 4 cores) this reduces the time to create
> > binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.
> >
> > xz has supported -T0 since version 5.2.0 (released 2014-12-21).
> 
> LGTM and it's the default from >=5.6.0 anyway.

The same 5.6.0 which introduced the backdoor?  How are its defaults
relevant, when no one in their right mind will ever use those
versions??

Re: [PATCH] src-release.sh: Use -T0 for xz compression

[Sam James]

[-- Attachment #1: Type: text/plain, Size: 741 bytes --]

Eli Zaretskii <eliz@gnu.org> writes:

>> From: Sam James <sam@gentoo.org>
>> Cc: binutils@sourceware.org,  gdb-patches@sourceware.org
>> Date: Thu, 30 May 2024 22:56:50 +0100
>> 
>> > On my machine (using 4 cores) this reduces the time to create
>> > binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.
>> >
>> > xz has supported -T0 since version 5.2.0 (released 2014-12-21).
>> 
>> LGTM and it's the default from >=5.6.0 anyway.
>
> The same 5.6.0 which introduced the backdoor?  How are its defaults
> relevant, when no one in their right mind will ever use those
> versions??

xz continues as a project after this incident and fixed releases were
issued 2 days ago. I'm not sure what your point is here.


[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 377 bytes --]

Re: [PATCH] src-release.sh: Use -T0 for xz compression

[Mark Wielaard]

Hi,

On Thu, May 30, 2024 at 10:56:50PM +0100, Sam James wrote:
> Mark Wielaard <mark@klomp.org> writes:
> > Use parallel compression to create the xz archive.
> >
> > On my machine (using 4 cores) this reduces the time to create
> > binutils-2.42.50.tar.xz from 1 minute 40 seconds to 56 seconds.
> >
> > xz has supported -T0 since version 5.2.0 (released 2014-12-21).
> 
> LGTM and it's the default from >=5.6.0 anyway.

Thanks. I have pushed this now because I believe all questions people
had have been answered. And it helps the snapshot builder become a bit
faster.

Cheers,

Mark