From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from outbound.mail.eo.outlook.com (mail-oln040093008008.outbound.protection.outlook.com [40.93.8.8]) by sourceware.org (Postfix) with ESMTPS id 503573898004 for ; Thu, 24 Jun 2021 21:45:46 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 503573898004 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MI0FRneEL/AqWJN+H5xtaFPBxkcKm8lARsvvg56x3HkElxVVO5wfgP1+275834yo70MLzCsj40lxrFRiOoQ1AMPeVLiwuQXzbdmwluL3i9i5Qr2vCdjLzJOevubd8JOTGtKOeJvQGEs9KUu36PA8FxSVhuy9ZCSnaPqbEtfjhmbHr1jfVlq5pxjNXoc6aeqSYvOcjG82UnDfcTC7at4QHGkfaQx9ZhkyaT3qLaB1p7eKDHXFDlPSQyJOVm21tuoWiAz6nYCeFy6YPxzvSbiJtWIndf39k0cQVwqYDXkzm95b6y397ufMp+kVDb4VxwgpbeCcB3JcHwSY67314dEmWw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MEE1b++6wRv7ynqvgh3PkpAoKDGCw77yu/b0CvL+/QY=; b=VlhIeraZXizOkVwz03jSDAQ2nqqkAfJiUVOgSisu5UnrgCn9Sw0EMoZM9yQ+ScBmXLgRMEfRm3WkeWqrSM/SyFazm9i5hqmSR8lDqdXYDb4iwNM8evw1qJF+OPFcigIM3N+uinG9go6ZoTkvDos/38TZXBTRvtceZI97E1Wm9dlgxkHjN39XG7pQh2AO0Wle4hh7dNFO/kjiDIHOgix83G0HNDe10XCN6ktlyp/CJZ/29RkPcuFJdnjdVC6a6CG/3GJ/Z3NfiNXJRWM1jObsqBHjCFFQs22HhmIKg1UaFCySueeb6KgVN9uZfa1TyKLnNdbWRNV6g+LkKpTyh9ZnpQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none Received: from MWHPR21MB0798.namprd21.prod.outlook.com (2603:10b6:300:128::18) by MW2PR2101MB1115.namprd21.prod.outlook.com (2603:10b6:302:a::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.0; Thu, 24 Jun 2021 21:45:43 +0000 Received: from MWHPR21MB0798.namprd21.prod.outlook.com ([fe80::1d02:9a92:e9:c946]) by MWHPR21MB0798.namprd21.prod.outlook.com ([fe80::1d02:9a92:e9:c946%14]) with mapi id 15.20.4264.003; Thu, 24 Jun 2021 21:45:43 +0000 From: Eugene Rozenfeld To: Andi Kleen , Eugene Rozenfeld via Gcc CC: Xinliang David Li , Richard Biener , Jan Hubicka Subject: RE: [EXTERNAL] Re: State of AutoFDO in GCC Thread-Topic: [EXTERNAL] Re: State of AutoFDO in GCC Thread-Index: Adc3sdMagfKGeoXuQ46Crrlm/SEGvwAAp56AAASdhAAADAzWAAAFzmSAABQa3YABZB1KAAAGvYVZCs15N7A= Date: Thu, 24 Jun 2021 21:45:42 +0000 Message-ID: References: <62330f82-201d-af7d-d1ed-1c8c529cc0f7@suse.cz> <20210422222906.GB5803@kam.mff.cuni.cz> <871rar78fx.fsf@linux.intel.com> In-Reply-To: <871rar78fx.fsf@linux.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ActionId=6ad5cb1a-cc8c-4f06-a359-7b4802036306; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ContentBits=0; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=true; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Method=Standard; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=Internal; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2021-06-24T21:29:49Z; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 2f0a4f06-2eb4-4dc9-ba9d-08d937596ab2 x-ms-traffictypediagnostic: MW2PR2101MB1115: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: xpqHMHM/bUZ7gHqjigj1ep6VXuOUR1tHV0EK0amQSVGszeNp5CPayly3dgJeqoGjcjtQvGTPib+ipyJDNxamvfac2d+9rEu1LuEFCc+nmBP3BlhyC4tONJfH1gK53fQ4hlR3+wxPYRdH+oQj1MEqdtVRr6Sd2KnvmR2d7BFrsIElPuBwFGZ2TFJYBKKLbInLk0/ufnWZlqv5rNmlydc+yAl3DqTt+9oCCidqJqJjTF1mhA6Jqamety48qKu6LcImJwSCDy6aWGzEB37Y0vQ0ObMwR7e6LugnBfjk1F4aXrCPLGANFW74V4YWEqSaedB8Ocs7lpCKQHY8e8TmzG99JD972ei31FchPq4/EZZ+wZIxrxA+uBta0R36ND6t4MzJoJ9/6MXzTnxIlaLO1apkTi84w+rP9AhsKoD+63d373UpbJDo+g4FmeEgXjML6Pplkmahem1uUhxJtmSNAPH9Gr5+HxDRmEkOgeeuZKpiLXIV9C6FfWNXbYO4zYFmoBlJPtJXvjyqcuXsBH54Q5eMvqkmdhOVA2Kve+xRwebFqWGAb8tFg+633BkMzBcK9UBts13b6HC0LVMaP71WsWdIidL6Sa1mHbt3JJrmDUCVsu9Akwgg33WuKe2Tgx3e+qxOiY/WTi3HWARfa0rpCvxfNDNb+B9ha8FNXB6mM1M539Coh/ex6dTAR5ROImR5CoSByM0bYhFBvabAAjcdbmNXCQwFkYoCLjIwstk/Fu2ZKyQFYO36NXreeU8uGrgXATJxwcpdYj7sVlgevb9hWR9bOWZVNamCma3BWTSGN11S1HtW9Zl2gaJBS/5p89Uqu9n0 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MWHPR21MB0798.namprd21.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(66946007)(8936002)(122000001)(478600001)(966005)(71200400001)(66476007)(83380400001)(8676002)(7696005)(38100700002)(82950400001)(5660300002)(86362001)(6506007)(33656002)(53546011)(186003)(316002)(54906003)(9686003)(2906002)(4326008)(82960400001)(66446008)(110136005)(55016002)(10290500003)(76116006)(66556008)(64756008)(52536014)(8990500004); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?85DVYzhOx7qJWX2xGNiLYGdi5YeAbn0ZR8XIGEOySQl0O1bw2CFFY2UAtT+w?= =?us-ascii?Q?mUvasIvOTib76ufzI1DZABXUCytqMXZHqgHLbgKaEBfZTtZ+zxEpe3g9UnZN?= =?us-ascii?Q?9hILwESTrmKJO18qvkMOkAvb8ZHXxMsZlrEhPNI8RvH2NJMX8Smaq+jATLtS?= =?us-ascii?Q?s7Ix/gjw57Gv6a5SoTHnoWanzPFa5Vta+DFouY/UE2iV/8crizgxrb/4bSrU?= =?us-ascii?Q?2f4U+Qbj4jxJgcjpoofYVEpHQLh7spEgeZId5eOzJQYFpQ+WZ3Y7IULTicWc?= =?us-ascii?Q?KJl0ip0v6dP4JTisolNuvBg7Y5XUHg1veuIE6Nuil1/+5u/KA5s6yLZnoBbq?= =?us-ascii?Q?ApOBZcWt9wXodbRQY98bWy+iCUIad9R2D8aB0ZPnPA0LKST4zS+NaSnlPQmY?= =?us-ascii?Q?DLB6iAT3z941M1ur06iaHu8zMdI6ZrVs1a3m9m4EXURYFWFMSrOkyAe075iV?= =?us-ascii?Q?pkKCe/9kC4PedaelGF8glCSzEs2Jsjhn/aLiNgm+yxu1JH9Fdttv5SR/ndb8?= =?us-ascii?Q?tVQVgOgW3CUvzHHlBreJSgIl0I5HWRd8l/4kAXWRtzmAV1igRjnqVA73zOB1?= =?us-ascii?Q?N2sRPrff95HrnN3tB2nITtKRasNeJC0k3qf0gm0muNcbqzSZOkEmDv8W/DJs?= =?us-ascii?Q?C/LuH+9xpVMCkFRgTDtURRyIQrthLtWz4RM6GJ69q1IBiCfUzm3eM3mCjh6j?= =?us-ascii?Q?CzVH7xV5p4IK0OjH1MNY10VtmEuZ+Aee49EelIs+n8N5lCbGN16zGQ0n3rgL?= =?us-ascii?Q?z2GcZ2/2+vQVS2TI3BCnJceOYNa7W5pqpf14yeJhxxRg7gzV/GBHYPswKGAa?= =?us-ascii?Q?toKAQoOPrpiMpdQ4tjtBPAPiG3noQukzb2X9pdm1kN9bHYVLhrmN48sz54R7?= =?us-ascii?Q?m9gyON95PpOzKV+zZZERpZfJzvoPGi/8GzwO3xu0Vnx3Dw0nQ7RySUP0iS+X?= =?us-ascii?Q?7LPu5u/MA+RSTz37yZNF8RD94xsqWvYUw4wUkV2gkbvmH4pR1/kBrz5r7Hye?= =?us-ascii?Q?4C7vsyN7SP28MkUfvOB0gzGLFxIltTSCbQvkCqOT0fTD9W5z3WNQQckZWxTa?= =?us-ascii?Q?a/3ChEkQNuZz1/xZM32fRT8P7oM68MR4/UmKwO6RBjVtH3rQkjGGufqc8FPD?= =?us-ascii?Q?FFaicvyU/eFVp9rA0GVVCfBgY+Qn2KJ6lCj7UALjCJNsiI/WtLGD+EhPE119?= =?us-ascii?Q?0KePy90D3z6WXvOXUpRbOnq0OH2UjtaXIEFn0YWkuoFkgYPCIFW+adhCv3Pj?= =?us-ascii?Q?ZoQ6uKWYhHR+H/JNZeXr1R4+S9M/xgRfcV6+L93Q5ki62OMb/4oFp73HXI7A?= =?us-ascii?Q?rBO0VTXLM3bartmKG8yAyahZYTotBMfcardi0o3FDOFhhWgP+K5XU0ncF44D?= =?us-ascii?Q?8SZNpkzvCcIFLqV5TpdqjwWtKs3F?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MWHPR21MB0798.namprd21.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2f0a4f06-2eb4-4dc9-ba9d-08d937596ab2 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Jun 2021 21:45:42.9431 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: y2lKoUsVhkP4Ji1Ja7qc/VZafTov3FusWE4ihY53yOB7FwlUCCyBQ7Iy7/xZPiKlWEAAM9lYSNZFjKdhPxB23Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2PR2101MB1115 X-Spam-Status: No, score=-3.8 required=5.0 tests=BAYES_00, DKIMWL_WL_HIGH, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, RCVD_IN_MSPIKE_H2, SPF_PASS, TXREP, T_SPF_HELO_TEMPERROR autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: gcc@gcc.gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gcc mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Jun 2021 21:45:49 -0000 Hi Andy, I'm trying to revive autofdo testing. One of the issues I'm running into wi= th my setup is that PEBS doesn't work for with perf record even though PEBS= is enabled. I'm running Ubuntu 20.04 in a Hyper-V virtual machine; the processor is Ice= lake (GenuineIntel-6-7E). I did the following: 1. Enabled pmu, lbr, and pebs in my Hyper-V virtual machine as described in= https://docs.microsoft.com/en-us/windows-server/virtualization/hyper-v/man= age/performance-monitoring-hardware 2. Verified that pmu, lbr, and pebs are enabled in the vm by running=20 erozen@erozen-Virtual-Machine:~/objdir/gcc$ dmesg | egrep -i 'pmu' [ 0.266474] Performance Events: PEBS fmt4+, Icelake events, 32-deep LBR= , full-width counters, Intel PMU driver. 3. Ran erozen@erozen-Virtual-Machine:~/objdir/gcc$ perf record -e cpu/event=3D0xc= 4,umask=3D0x20/pu -b -m8 true -v Error: The sys_perf_event_open() syscall returned with 22 (Invalid argument) for = event (cpu/event=3D0xc4,umask=3D0x20/pu). /bin/dmesg | grep -i perf may provide additional information. Omitting /p works fine: erozen@erozen-Virtual-Machine:~/objdir/gcc$ perf record -e cpu/event=3D0xc= 4,umask=3D0x20/u -b -m8 true -v [ perf record: Woken up 0 times to write data ] [ perf record: Captured and wrote 0.007 MB perf.data (11 samples) ] Is there a way to get PEBS working with perf record in a vm? I would apprec= iate any pointers on how to investigate this. The version of perf I'm using is 5.8.18. Thanks, Eugene -----Original Message----- From: Andi Kleen =20 Sent: Friday, April 30, 2021 2:46 PM To: Eugene Rozenfeld via Gcc Cc: Xinliang David Li ; Richard Biener ; Eugene Rozenfeld ; Jan Hubick= a Subject: Re: [EXTERNAL] Re: State of AutoFDO in GCC Eugene Rozenfeld via Gcc writes: > Is the format produced by create_gcov and expected by GCC under=20 > -fauto-rpofile documented somewhere? How is it different from .gcda=20 > used in FDO, e.g., as described here: > https://nam06.safelinks.protection.outlook.com/?url=3Dhttp%3A%2F%2Fsrc.gn= u-darwin.org%2Fsrc%2Fcontrib%2Fgcc%2Fgcov-io.h.html&data=3D04%7C01%7CEu= gene.Rozenfeld%40microsoft.com%7C6c14ea3d93c44364845008d90c214cb6%7C72f988b= f86f141af91ab2d7cd011db47%7C1%7C0%7C637554159427749575%7CUnknown%7CTWFpbGZs= b3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C10= 00&sdata=3Dq9ROiOTma41UeQ%2FQG%2BUktEOrHAWonTTpcPRPmx%2Fgw0g%3D&res= erved=3D0? I believe it's very similar. > I would prefer that AutoFDO is not removed from GCC and it would be=20 > helpful if create_gcov were restored in google/autofdo. I checked out=20 > a revision before the recent merge and tried it on a simple example=20 > and it seems to work. > I'm also interested in contributing improvements for AutoFDO so will=20 > try to investigate=20 > https://nam06.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgcc. > gnu.org%2Fbugzilla%2Fshow_bug.cgi%3Fid%3D71672&data=3D04%7C01%7CEuge > ne.Rozenfeld%40microsoft.com%7C6c14ea3d93c44364845008d90c214cb6%7C72f9 > 88bf86f141af91ab2d7cd011db47%7C1%7C0%7C637554159427749575%7CUnknown%7C > TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC > I6Mn0%3D%7C1000&sdata=3D99Igueuxq7AoHU%2B20BZs4E4K5rgdPFCiR8eygKaJdK > E%3D&reserved=3D0 and=20 > https://nam06.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgcc. > gnu.org%2Fbugzilla%2Fshow_bug.cgi%3Fid%3D81379&data=3D04%7C01%7CEuge > ne.Rozenfeld%40microsoft.com%7C6c14ea3d93c44364845008d90c214cb6%7C72f9 > 88bf86f141af91ab2d7cd011db47%7C1%7C0%7C637554159427759566%7CUnknown%7C > TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC > I6Mn0%3D%7C1000&sdata=3DEs91Dtt5Wt6%2BJtPWxHhkHqdWBVwzCiF5PcuXoHjY%2 > Bzs%3D&reserved=3D0 That would be great. -Andi