From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 7852) id 557503858C60; Thu, 8 Feb 2024 18:33:09 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 557503858C60 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org; s=default; t=1707417189; bh=6jrLFxM09EoXUuOrYnWOAAw+/qtgdlBTfHB9IL/Q9ss=; h=From:To:Subject:Date:From; b=Q/VL0hCgkeWUGTLtnfGvXXTtfVAAcQBWfroN1zfE+T5X4dV7E5p6dCXqUXFIzYgvP i59oU39+O5C5tMQJPPYWEGqtFq7SC6tIMXd2vcvbFxHAb/anYcfaRd+rwIRv5h5ogB uRXPW0g1GQ1A0yHoWKo5I52kxpakCwawc93Jy6eE= Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: Sunil Pandey To: glibc-cvs@sourceware.org Subject: [glibc/release/2.29/master] x86_64: Optimize ffsll function code size. X-Act-Checkin: glibc X-Git-Author: Sunil K Pandey X-Git-Refname: refs/heads/release/2.29/master X-Git-Oldrev: bb7c57219d18f345acac3587c2b14ed3b9c1e261 X-Git-Newrev: d04b63770f7f8db79e22a80135fc89dfabaab174 Message-Id: <20240208183309.557503858C60@sourceware.org> Date: Thu, 8 Feb 2024 18:33:09 +0000 (GMT) List-Id: https://sourceware.org/git/gitweb.cgi?p=glibc.git;h=d04b63770f7f8db79e22a80135fc89dfabaab174 commit d04b63770f7f8db79e22a80135fc89dfabaab174 Author: Sunil K Pandey Date: Wed Jul 26 08:34:05 2023 -0700 x86_64: Optimize ffsll function code size. Ffsll function randomly regress by ~20%, depending on how code gets aligned in memory. Ffsll function code size is 17 bytes. Since default function alignment is 16 bytes, it can load on 16, 32, 48 or 64 bytes aligned memory. When ffsll function load at 16, 32 or 64 bytes aligned memory, entire code fits in single 64 bytes cache line. When ffsll function load at 48 bytes aligned memory, it splits in two cache line, hence random regression. Ffsll function size reduction from 17 bytes to 12 bytes ensures that it will always fit in single 64 bytes cache line. This patch fixes ffsll function random performance regression. Reviewed-by: Carlos O'Donell (cherry picked from commit 9d94997b5f9445afd4f2bccc5fa60ff7c4361ec1) Diff: --- sysdeps/x86_64/ffsll.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/sysdeps/x86_64/ffsll.c b/sysdeps/x86_64/ffsll.c index 1caf6ac155..ef686da5ca 100644 --- a/sysdeps/x86_64/ffsll.c +++ b/sysdeps/x86_64/ffsll.c @@ -27,13 +27,13 @@ int ffsll (long long int x) { long long int cnt; - long long int tmp; - asm ("bsfq %2,%0\n" /* Count low bits in X and store in %1. */ - "cmoveq %1,%0\n" /* If number was zero, use -1 as result. */ - : "=&r" (cnt), "=r" (tmp) : "rm" (x), "1" (-1)); + asm ("mov $-1,%k0\n" /* Initialize cnt to -1. */ + "bsf %1,%0\n" /* Count low bits in x and store in cnt. */ + "inc %k0\n" /* Increment cnt by 1. */ + : "=&r" (cnt) : "r" (x)); - return cnt + 1; + return cnt; } #ifndef __ILP32__