From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 7806) id A1DF238582BD; Fri, 3 Mar 2023 16:13:05 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org A1DF238582BD DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gcc.gnu.org; s=default; t=1677859985; bh=LPlj5YBO+CnDOwJiSRmH+qv6IDPSZaL+6GEjJu1wbbw=; h=From:To:Subject:Date:From; b=uj4q1OA7tEkkR06joaeNzCVu9Woqh1LJglbU+Tte8w9AZpL/r3t/MYDiSeWrJax3Q A+4rDopwO0yHQ7+8Mop68/596buAXq328H2sTmLo6KdATe4AMdS1sGb1gDWJZ1EAwa cjd7TOnrymXfT8IsKpYBNWzcynEVOnRym/2FMycI= MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="utf-8" From: Stefan Schulze Frielinghaus To: gcc-cvs@gcc.gnu.org Subject: [gcc r12-9213] s390: libatomic: Fix 16 byte atomic {cas,load,store} X-Act-Checkin: gcc X-Git-Author: Stefan Schulze Frielinghaus X-Git-Refname: refs/heads/releases/gcc-12 X-Git-Oldrev: 2583365912c8700abe1f4a23ed611acb80fac09d X-Git-Newrev: dce178f4275343ddbdfeb4fe154a48731000b2ed Message-Id: <20230303161305.A1DF238582BD@sourceware.org> Date: Fri, 3 Mar 2023 16:13:05 +0000 (GMT) List-Id: https://gcc.gnu.org/g:dce178f4275343ddbdfeb4fe154a48731000b2ed commit r12-9213-gdce178f4275343ddbdfeb4fe154a48731000b2ed Author: Stefan Schulze Frielinghaus Date: Fri Mar 3 17:12:37 2023 +0100 s390: libatomic: Fix 16 byte atomic {cas,load,store} This is a follow-up to commit a4c6bd0821099f6b8c0f64a96ffd9d01a025c413 introducing a runtime check for alignment for 16 byte atomic compare-exchange, load, and store. libatomic/ChangeLog: * config/s390/cas_n.c: New file. * config/s390/load_n.c: New file. * config/s390/store_n.c: New file. (cherry picked from commit 9056d0df830c5a295d7594d517d409d10476990d) Diff: --- libatomic/config/s390/cas_n.c | 65 +++++++++++++++++++++++++++++++++++++++++ libatomic/config/s390/load_n.c | 57 ++++++++++++++++++++++++++++++++++++ libatomic/config/s390/store_n.c | 54 ++++++++++++++++++++++++++++++++++ 3 files changed, 176 insertions(+) diff --git a/libatomic/config/s390/cas_n.c b/libatomic/config/s390/cas_n.c new file mode 100644 index 00000000000..44b7152ca5d --- /dev/null +++ b/libatomic/config/s390/cas_n.c @@ -0,0 +1,65 @@ +/* Copyright (C) 2018-2023 Free Software Foundation, Inc. + + This file is part of the GNU Atomic Library (libatomic). + + Libatomic is free software; you can redistribute it and/or modify it + under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3 of the License, or + (at your option) any later version. + + Libatomic is distributed in the hope that it will be useful, but WITHOUT ANY + WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS + FOR A PARTICULAR PURPOSE. See the GNU General Public License for + more details. + + Under Section 7 of GPL version 3, you are granted additional + permissions described in the GCC Runtime Library Exception, version + 3.1, as published by the Free Software Foundation. + + You should have received a copy of the GNU General Public License and + a copy of the GCC Runtime Library Exception along with this program; + see the files COPYING3 and COPYING.RUNTIME respectively. If not, see + . */ + +#include + + +/* Analog to config/s390/exch_n.c. */ + +#if !DONE && N == 16 +bool +SIZE(libat_compare_exchange) (UTYPE *mptr, UTYPE *eptr, UTYPE newval, + int smodel, int fmodel UNUSED) +{ + if (!((uintptr_t)mptr & 0xf)) + { + return __atomic_compare_exchange_n ( + (UTYPE *)__builtin_assume_aligned (mptr, 16), eptr, newval, false, + __ATOMIC_SEQ_CST, __ATOMIC_RELAXED); + } + else + { + UTYPE oldval; + UWORD magic; + bool ret; + + pre_seq_barrier (smodel); + magic = protect_start (mptr); + + oldval = *mptr; + ret = (oldval == *eptr); + if (ret) + *mptr = newval; + else + *eptr = oldval; + + protect_end (mptr, magic); + post_seq_barrier (smodel); + + return ret; + } +} +#define DONE 1 +#endif /* N == 16 */ + +#include "../../cas_n.c" diff --git a/libatomic/config/s390/load_n.c b/libatomic/config/s390/load_n.c new file mode 100644 index 00000000000..335d2f8b2c3 --- /dev/null +++ b/libatomic/config/s390/load_n.c @@ -0,0 +1,57 @@ +/* Copyright (C) 2018-2023 Free Software Foundation, Inc. + + This file is part of the GNU Atomic Library (libatomic). + + Libatomic is free software; you can redistribute it and/or modify it + under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3 of the License, or + (at your option) any later version. + + Libatomic is distributed in the hope that it will be useful, but WITHOUT ANY + WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS + FOR A PARTICULAR PURPOSE. See the GNU General Public License for + more details. + + Under Section 7 of GPL version 3, you are granted additional + permissions described in the GCC Runtime Library Exception, version + 3.1, as published by the Free Software Foundation. + + You should have received a copy of the GNU General Public License and + a copy of the GCC Runtime Library Exception along with this program; + see the files COPYING3 and COPYING.RUNTIME respectively. If not, see + . */ + +#include + + +/* Analog to config/s390/exch_n.c. */ + +#if !DONE && N == 16 +UTYPE +SIZE(libat_load) (UTYPE *mptr, int smodel) +{ + if (!((uintptr_t)mptr & 0xf)) + { + return __atomic_load_n ((UTYPE *)__builtin_assume_aligned (mptr, 16), + __ATOMIC_SEQ_CST); + } + else + { + UTYPE ret; + UWORD magic; + + pre_seq_barrier (smodel); + magic = protect_start (mptr); + + ret = *mptr; + + protect_end (mptr, magic); + post_seq_barrier (smodel); + + return ret; + } +} +#define DONE 1 +#endif /* N == 16 */ + +#include "../../load_n.c" diff --git a/libatomic/config/s390/store_n.c b/libatomic/config/s390/store_n.c new file mode 100644 index 00000000000..9e5b2b8213d --- /dev/null +++ b/libatomic/config/s390/store_n.c @@ -0,0 +1,54 @@ +/* Copyright (C) 2018-2023 Free Software Foundation, Inc. + + This file is part of the GNU Atomic Library (libatomic). + + Libatomic is free software; you can redistribute it and/or modify it + under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3 of the License, or + (at your option) any later version. + + Libatomic is distributed in the hope that it will be useful, but WITHOUT ANY + WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS + FOR A PARTICULAR PURPOSE. See the GNU General Public License for + more details. + + Under Section 7 of GPL version 3, you are granted additional + permissions described in the GCC Runtime Library Exception, version + 3.1, as published by the Free Software Foundation. + + You should have received a copy of the GNU General Public License and + a copy of the GCC Runtime Library Exception along with this program; + see the files COPYING3 and COPYING.RUNTIME respectively. If not, see + . */ + +#include + + +/* Analog to config/s390/exch_n.c. */ + +#if !DONE && N == 16 +void +SIZE(libat_store) (UTYPE *mptr, UTYPE newval, int smodel) +{ + if (!((uintptr_t)mptr & 0xf)) + { + __atomic_store_n ((UTYPE *)__builtin_assume_aligned (mptr, 16), newval, + __ATOMIC_SEQ_CST); + } + else + { + UWORD magic; + + pre_seq_barrier (smodel); + magic = protect_start (mptr); + + *mptr = newval; + + protect_end (mptr, magic); + post_seq_barrier (smodel); + } +} +#define DONE 1 +#endif /* N == 16 */ + +#include "../../store_n.c"