From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) by sourceware.org (Postfix) with ESMTPS id 87F533938C32 for ; Fri, 23 Apr 2021 07:18:25 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 87F533938C32 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=suse.cz Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=mliska@suse.cz X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id 62E16AE03; Fri, 23 Apr 2021 07:18:23 +0000 (UTC) Subject: Re: State of AutoFDO in GCC To: Richard Biener , Xinliang David Li Cc: "gcc@gcc.gnu.org" , Jan Hubicka , Eugene Rozenfeld References: <62330f82-201d-af7d-d1ed-1c8c529cc0f7@suse.cz> <20210422222906.GB5803@kam.mff.cuni.cz> From: =?UTF-8?Q?Martin_Li=c5=a1ka?= Message-ID: Date: Fri, 23 Apr 2021 09:18:22 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.9.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-5.3 required=5.0 tests=BAYES_00, KAM_DMARC_STATUS, KAM_SHORT, NICE_REPLY_A, RCVD_IN_MSPIKE_H3, RCVD_IN_MSPIKE_WL, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: gcc@gcc.gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gcc mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Apr 2021 07:18:27 -0000 On 4/23/21 9:00 AM, Richard Biener via Gcc wrote: > On Fri, Apr 23, 2021 at 7:28 AM Xinliang David Li via Gcc > wrote: >> >> Hi, the create_gcov tool was probably removed with the assumption that it >> was only used with Google GCC branch, but it is actually used with GCC >> trunk as well. >> >> Given that, the tool will be restored in the github repo. It seems to build >> and work fine with the regression test. >> >> The tool may ust work as it is right now, but there is no guarantee it >> won't break in the future unless someone in the GCC community tries to >> maintain it. Hi. The current situation is that AutoFDO doesn't work with pretty simple test-cases we have in testsuite: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=71672 https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81379 These are ~5 years old and nothing has happened. I'm pretty sure the current autofdo can't emit a .gcda file format that I've changed in the recent years. > > I think if we want to keep the feature it makes sense to provide create_gcov > functionality either directly from perf (input data producer) or from gcc > (data consumer). Of course I have no idea about its complexity, license > or implementation language ... For me, it's just an i386 feature (maybe aarch64 has perf counters too?), supported only by vendor (Intel) and I'm not planning working on that. I don't like having a feature that is obviously broken and potential GCC users get bad experience every time they try to use it. Can we at least deprecate the feature for GCC 11? If these is enough interest, we can fix it, if not, I would remove it in GCC 13 timeframe. Thoughts? Martin > > Having the tool third-party makes keeping the whole chain working more > difficult. > > Richard. > >> Thanks, >> >> David >> >> On Thu, Apr 22, 2021 at 3:29 PM Jan Hubicka wrote: >> >>>> On 4/22/21 9:58 PM, Eugene Rozenfeld via Gcc wrote: >>>>> GCC documentation for AutoFDO points to create_gcov tool that converts >>> perf.data file into gcov format that can be consumed by gcc with >>> -fauto-profile (https://gcc.gnu.org/onlinedocs/gcc/Optimize-Options.html, >>> https://gcc.gnu.org/wiki/AutoFDO/Tutorial). >>>>> >>>>> I noticed that the source code for create_gcov has been deleted from >>> https://github.com/google/autofdo on April 7. I asked about that change >>> in that repo and got the following reply: >>>>> >>>>> https://github.com/google/autofdo/pull/107#issuecomment-819108738 >>>>> >>>>> "Actually we didn't use create_gcov and havn't updated create_gcov for >>> years, and we also didn't have enough tests to guarantee it works (It was >>> gcc-4.8 when we used and verified create_gcov). If you need it, it is >>> welcomed to update create_gcov and add it to the respository." >>>>> >>>>> Does this mean that AutoFDO is currently dead in gcc? >>>> >>>> Hello. >>>> >>>> Yes. I know that even basic test cases have been broken for years in the >>> GCC. >>>> It's new to me that create_gcov was removed. >>>> >>>> I tend to send patch to GCC that will remove AutoFDO from GCC. >>>> I known Bin spent some time working on AutoFDO, has he came up to >>> something? >>> >>> The GCC side of auto-FDO is not that hard. We have most of >>> infrastructure in place, but stopping point for me was always difficulty >>> to get gcov-tool working. If some maintainer steps up, I think I can >>> fix GCC side. >>> >>> I am bit unsure how important feature it is - we have FDO that works >>> quite well for most users but I know there are some users of the LLVM >>> implementation and there is potential to tie this with other hardware >>> events to asist i.e. if conversion (where one wants to know how well CPU >>> predicts the jump rather than just the jump probability) which I always >>> found potentially interesting. >>> >>> Honza >>>> >>>> Martin >>>> >>>>> >>>>> Thanks, >>>>> >>>>> Eugene >>>>> >>>> >>>