[Bug rtl-optimization/100978] New: [10/11/12 Regression] ICE: qsort checking failed: qsort comparator non-negative on sorted output: 1 with -O3 -frename-registers -fno-sched-critical-path-heuristic -fsched2-use-superblocks

[Bug rtl-optimization/100978] New: [10/11/12 Regression] ICE: qsort checking failed: qsort comparator non-negative on sorted output: 1 with -O3 -frename-registers -fno-sched-critical-path-heuristic -fsched2-use-superblocks

[zsojka at seznam dot cz]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=100978

            Bug ID: 100978
           Summary: [10/11/12 Regression] ICE: qsort checking failed:
                    qsort comparator non-negative on sorted output: 1 with
                    -O3 -frename-registers
                    -fno-sched-critical-path-heuristic
                    -fsched2-use-superblocks
           Product: gcc
           Version: 12.0
            Status: UNCONFIRMED
          Keywords: ice-on-valid-code
          Severity: normal
          Priority: P3
         Component: rtl-optimization
          Assignee: unassigned at gcc dot gnu.org
          Reporter: zsojka at seznam dot cz
  Target Milestone: ---
              Host: x86_64-pc-linux-gnu

Created attachment 50966
  --> https://gcc.gnu.org/bugzilla/attachment.cgi?id=50966&action=edit
reduced testcase

Compiler output:
$ x86_64-pc-linux-gnu-gcc -O3 -frename-registers
-fno-sched-critical-path-heuristic -fsched2-use-superblocks testcase.c 
testcase.c: In function 'foo':
testcase.c:21:1: error: qsort comparator non-negative on sorted output: 1
   21 | }
      | ^
during RTL pass: sched2
testcase.c:21:1: internal compiler error: qsort checking failed
0xa1bf87 qsort_chk_error
        /repo/gcc-trunk/gcc/vec.c:214
0xa1c093 qsort_chk(void*, unsigned long, unsigned long, int (*)(void const*,
void const*, void*), void*)
        /repo/gcc-trunk/gcc/vec.c:256
0x1d79fb5 gcc_qsort(void*, unsigned long, unsigned long, int (*)(void const*,
void const*))
        /repo/gcc-trunk/gcc/sort.cc:270
0x1bd83c0 ready_sort_real
        /repo/gcc-trunk/gcc/haifa-sched.c:3095
0x1be09c5 ready_sort
        /repo/gcc-trunk/gcc/haifa-sched.c:3111
0x1be09c5 schedule_block(basic_block_def**, void*)
        /repo/gcc-trunk/gcc/haifa-sched.c:6709
0x1cb32ab schedule_ebb(rtx_insn*, rtx_insn*, bool)
        /repo/gcc-trunk/gcc/sched-ebb.c:536
0x1cb39d2 schedule_ebbs()
        /repo/gcc-trunk/gcc/sched-ebb.c:655
0x1015b2c rest_of_handle_sched2
        /repo/gcc-trunk/gcc/sched-rgn.c:3740
0x1015b2c execute
        /repo/gcc-trunk/gcc/sched-rgn.c:3878
Please submit a full bug report,
with preprocessed source if appropriate.
Please include the complete backtrace with any bug report.
See <https://gcc.gnu.org/bugs/> for instructions.

$ x86_64-pc-linux-gnu-gcc -v
Using built-in specs.
COLLECT_GCC=/repo/gcc-trunk/binary-latest/bin/x86_64-pc-linux-gnu-gcc
COLLECT_LTO_WRAPPER=/repo/gcc-trunk/binary-trunk-r12-1295-20210608150918-g7a56d3d3e99-checking-yes-rtl-df-extra-amd64/bin/../libexec/gcc/x86_64-pc-linux-gnu/12.0.0/lto-wrapper
Target: x86_64-pc-linux-gnu
Configured with: /repo/gcc-trunk//configure --enable-languages=c,c++
--enable-valgrind-annotations --disable-nls --enable-checking=yes,rtl,df,extra
--with-cloog --with-ppl --with-isl --build=x86_64-pc-linux-gnu
--host=x86_64-pc-linux-gnu --target=x86_64-pc-linux-gnu
--with-ld=/usr/bin/x86_64-pc-linux-gnu-ld
--with-as=/usr/bin/x86_64-pc-linux-gnu-as --disable-libstdcxx-pch
--prefix=/repo/gcc-trunk//binary-trunk-r12-1295-20210608150918-g7a56d3d3e99-checking-yes-rtl-df-extra-amd64
Thread model: posix
Supported LTO compression algorithms: zlib zstd
gcc version 12.0.0 20210608 (experimental) (GCC)

[Bug rtl-optimization/100978] [10/11/12 Regression] ICE: qsort checking failed: qsort comparator non-negative on sorted output: 1 with -O3 -frename-registers -fno-sched-critical-path-heuristic -fsched2-use-superblocks

[rguenth at gcc dot gnu.org]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=100978

Richard Biener <rguenth at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |ice-checking
   Target Milestone|---                         |10.4
             Target|                            |x86_64-pc-linux-gnu
               Host|x86_64-pc-linux-gnu         |

--- Comment #1 from Richard Biener <rguenth at gcc dot gnu.org> ---
Wow, the comparator is complicated (rank_for_schedule).

[Bug rtl-optimization/100978] [10/11/12 Regression] ICE: qsort checking failed: qsort comparator non-negative on sorted output: 1 with -O3 -frename-registers -fno-sched-critical-path-heuristic -fsched2-use-superblocks

[pinskia at gcc dot gnu.org]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=100978

Andrew Pinski <pinskia at gcc dot gnu.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
         Resolution|---                         |DUPLICATE

--- Comment #2 from Andrew Pinski <pinskia at gcc dot gnu.org> ---
Dup of bug 84345.

*** This bug has been marked as a duplicate of bug 84345 ***