From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) by sourceware.org (Postfix) with ESMTPS id 1DD553858C36 for ; Tue, 14 Feb 2023 14:21:55 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 1DD553858C36 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=suse.de Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=suse.de Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 1F08F22222; Tue, 14 Feb 2023 14:21:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1676384514; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type; bh=JOQOFqSvbjXuyIXuFmjKJvPHn1oZa1ej6cpXC8Gzul8=; b=N9cLJxLABN99h5gy/RzAGq82WoiN43crBBlOBaqjmPQtFj9OSD9XqAJ/hHs4064OTyXTMJ Xavc1IRuDIElP7Cp9Pn8bKtoV0ssafbOl5Sy4YfyCnXmgxU9hSmYAEPRwwrnq+a3dOU5VJ uxhG9jYqH/LbaJEC1fd1EpBkXXhBF+w= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1676384514; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type; bh=JOQOFqSvbjXuyIXuFmjKJvPHn1oZa1ej6cpXC8Gzul8=; b=RF+npvQ3CG5iELd/cKjInSwjXeQLtf8eakdfUw4vlZ3X/DNwU+rMSPK2XvX7ELRJ4i5fxX u86zUf/qA8tDXlBA== Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id 09F8D13A21; Tue, 14 Feb 2023 14:21:54 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id 8eKHAQKZ62NCUQAAMHmgww (envelope-from ); Tue, 14 Feb 2023 14:21:54 +0000 Date: Tue, 14 Feb 2023 15:21:53 +0100 (CET) From: Richard Biener To: gcc-patches@gcc.gnu.org cc: Jakub Jelinek Subject: [PATCH] Speedup DF dataflow solver MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Message-Id: <20230214142154.09F8D13A21@imap2.suse-dmz.suse.de> X-Spam-Status: No, score=-11.8 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,GIT_PATCH_0,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: The following makes sure to process blocks that follow the current block in the iteration order in the same iteration and only postpone blocks that would be visited earlier to the next iteration. For the all.i testcase in PR26854 at -O2 this shaves off 50% of the time to solve the DF RD problem, other problems also improve but not as drastically. Bootstrapped on x86_64-unknown-linux-gnu, testing in progress. OK for trunk? Thanks, Richard. PR middle-end/26854 * df-core.cc (df_worklist_propagate_forward): Put later blocks on worklist and only earlier blocks on pending. (df_worklist_propagate_backward): Likewise. (df_worklist_dataflow_doublequeue): Change the iteration to process new blocks in the same iteration if that maintains the iteration order. --- gcc/df-core.cc | 54 ++++++++++++++++++++++++++++++++------------------ 1 file changed, 35 insertions(+), 19 deletions(-) diff --git a/gcc/df-core.cc b/gcc/df-core.cc index e5ae9ab9348..38f69ac5743 100644 --- a/gcc/df-core.cc +++ b/gcc/df-core.cc @@ -874,7 +874,8 @@ make_pass_df_finish (gcc::context *ctxt) /* Helper function for df_worklist_dataflow. Propagate the dataflow forward. Given a BB_INDEX, do the dataflow propagation - and set bits on for successors in PENDING + and set bits on for successors in PENDING for earlier + and WORKLIST for later in bbindex_to_postorder if the out set of the dataflow has changed. AGE specify time when BB was visited last time. @@ -890,10 +891,11 @@ make_pass_df_finish (gcc::context *ctxt) static bool df_worklist_propagate_forward (struct dataflow *dataflow, - unsigned bb_index, - unsigned *bbindex_to_postorder, - bitmap pending, - sbitmap considered, + unsigned bb_index, + unsigned *bbindex_to_postorder, + bitmap worklist, + bitmap pending, + sbitmap considered, vec &last_change_age, int age) { @@ -924,7 +926,13 @@ df_worklist_propagate_forward (struct dataflow *dataflow, unsigned ob_index = e->dest->index; if (bitmap_bit_p (considered, ob_index)) - bitmap_set_bit (pending, bbindex_to_postorder[ob_index]); + { + if (bbindex_to_postorder[bb_index] + < bbindex_to_postorder[ob_index]) + bitmap_set_bit (worklist, bbindex_to_postorder[ob_index]); + else + bitmap_set_bit (pending, bbindex_to_postorder[ob_index]); + } } return true; } @@ -937,10 +945,11 @@ df_worklist_propagate_forward (struct dataflow *dataflow, static bool df_worklist_propagate_backward (struct dataflow *dataflow, - unsigned bb_index, - unsigned *bbindex_to_postorder, - bitmap pending, - sbitmap considered, + unsigned bb_index, + unsigned *bbindex_to_postorder, + bitmap worklist, + bitmap pending, + sbitmap considered, vec &last_change_age, int age) { @@ -971,7 +980,13 @@ df_worklist_propagate_backward (struct dataflow *dataflow, unsigned ob_index = e->src->index; if (bitmap_bit_p (considered, ob_index)) - bitmap_set_bit (pending, bbindex_to_postorder[ob_index]); + { + if (bbindex_to_postorder[bb_index] + < bbindex_to_postorder[ob_index]) + bitmap_set_bit (worklist, bbindex_to_postorder[ob_index]); + else + bitmap_set_bit (pending, bbindex_to_postorder[ob_index]); + } } return true; } @@ -1021,36 +1036,37 @@ df_worklist_dataflow_doublequeue (struct dataflow *dataflow, and pending is for the next. */ while (!bitmap_empty_p (pending)) { - bitmap_iterator bi; - unsigned int index; - std::swap (pending, worklist); - EXECUTE_IF_SET_IN_BITMAP (worklist, 0, index, bi) + do { + unsigned index = bitmap_first_set_bit (worklist); + bitmap_clear_bit (worklist, index); + unsigned bb_index; dcount++; - bitmap_clear_bit (pending, index); bb_index = blocks_in_postorder[index]; prev_age = last_visit_age[index]; if (dir == DF_FORWARD) changed = df_worklist_propagate_forward (dataflow, bb_index, bbindex_to_postorder, - pending, considered, + worklist, pending, + considered, last_change_age, prev_age); else changed = df_worklist_propagate_backward (dataflow, bb_index, bbindex_to_postorder, - pending, considered, + worklist, pending, + considered, last_change_age, prev_age); last_visit_age[index] = ++age; if (changed) last_change_age[index] = age; } - bitmap_clear (worklist); + while (!bitmap_empty_p (worklist)); } BITMAP_FREE (worklist); -- 2.35.3