public inbox for glibc-cvs@sourceware.org help / color / mirror / Atom feed
From: Florian Weimer <fw@sourceware.org> To: glibc-cvs@sourceware.org Subject: [glibc] stdlib: Fix array bounds protection in insertion sort phase of qsort Date: Mon, 4 Dec 2023 05:56:04 +0000 (GMT) [thread overview] Message-ID: <20231204055604.8B59D3858C78@sourceware.org> (raw) https://sourceware.org/git/gitweb.cgi?p=glibc.git;h=b9390ba93676c4b1e87e218af5e7e4bb596312ac commit b9390ba93676c4b1e87e218af5e7e4bb596312ac Author: Florian Weimer <fweimer@redhat.com> Date: Mon Dec 4 06:35:56 2023 +0100 stdlib: Fix array bounds protection in insertion sort phase of qsort The previous check did not do anything because tmp_ptr already points before run_ptr due to the way it is initialized. Fixes commit e4d8117b82065dc72e8df80097360e7c05a349b9 ("stdlib: Avoid another self-comparison in qsort"). Reviewed-by: Adhemerval Zanella <adhemerval.zanella@linaro.org> Diff: --- stdlib/Makefile | 1 + stdlib/qsort.c | 2 +- stdlib/tst-qsort6.c | 60 +++++++++++++++++++++++++++++++++++++++++++++++++++++ 3 files changed, 62 insertions(+), 1 deletion(-) diff --git a/stdlib/Makefile b/stdlib/Makefile index 6194d1cb22..0b154e57c5 100644 --- a/stdlib/Makefile +++ b/stdlib/Makefile @@ -216,6 +216,7 @@ tests := \ tst-qsort2 \ tst-qsort3 \ tst-qsort5 \ + tst-qsort6 \ tst-quick_exit \ tst-rand48 \ tst-rand48-2 \ diff --git a/stdlib/qsort.c b/stdlib/qsort.c index be01fb5598..62477010b6 100644 --- a/stdlib/qsort.c +++ b/stdlib/qsort.c @@ -238,7 +238,7 @@ insertion_sort_qsort_partitions (void *const pbase, size_t total_elems, while ((run_ptr += size) <= end_ptr) { tmp_ptr = run_ptr - size; - while (run_ptr != tmp_ptr && cmp (run_ptr, tmp_ptr, arg) < 0) + while (tmp_ptr != base_ptr && cmp (run_ptr, tmp_ptr, arg) < 0) tmp_ptr -= size; tmp_ptr += size; diff --git a/stdlib/tst-qsort6.c b/stdlib/tst-qsort6.c new file mode 100644 index 0000000000..8ec0a6b633 --- /dev/null +++ b/stdlib/tst-qsort6.c @@ -0,0 +1,60 @@ +/* Test qsort with invalid comparison functions. + Copyright (C) 2023 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + <http://www.gnu.org/licenses/>. */ + +#include <array_length.h> +#include <stdlib.h> +#include <support/check.h> + +/* Invalid comparison function that always returns -1. */ +static int +invalid_compare_1 (const void *a1, const void *b1) +{ + const int *a = a1; + const int *b = b1; + /* Check that the marker value matches, which means that we are + likely within the array. */ + TEST_COMPARE (*a, 842523635); + TEST_COMPARE (*b, 842523635); + TEST_VERIFY_EXIT (*a == 842523635); + TEST_VERIFY_EXIT (*b == 842523635); + return -1; +} + +/* Invalid comparison function that always returns 1. */ +static int +invalid_compare_2 (const void *a1, const void *b1) +{ + const int *a = a1; + const int *b = b1; + TEST_COMPARE (*a, 842523635); + TEST_COMPARE (*b, 842523635); + TEST_VERIFY_EXIT (*a == 842523635); + TEST_VERIFY_EXIT (*b == 842523635); + return 1; +} + +static int +do_test (void) +{ + int array[] = {842523635, 842523635, 842523635, 842523635, 842523635}; + qsort (array, array_length (array), sizeof (array[0]), invalid_compare_1); + qsort (array, array_length (array), sizeof (array[0]), invalid_compare_2); + return 0; +} + +#include <support/test-driver.c>
reply other threads:[~2023-12-04 5:56 UTC|newest] Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20231204055604.8B59D3858C78@sourceware.org \ --to=fw@sourceware.org \ --cc=glibc-cvs@sourceware.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).