From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by sourceware.org (Postfix) with ESMTPS id ADA60385C30B; Fri, 10 Jun 2022 15:54:18 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org ADA60385C30B Received: from pps.filterd (m0098404.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 25AFkDEJ021310; Fri, 10 Jun 2022 15:54:03 GMT Received: from ppma02dal.us.ibm.com (a.bd.3ea9.ip4.static.sl-reverse.com [169.62.189.10]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3gm8ksgfa2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 10 Jun 2022 15:54:03 +0000 Received: from pps.filterd (ppma02dal.us.ibm.com [127.0.0.1]) by ppma02dal.us.ibm.com (8.16.1.2/8.16.1.2) with SMTP id 25AFpTZE016565; Fri, 10 Jun 2022 15:54:02 GMT Received: from b03cxnp08026.gho.boulder.ibm.com (b03cxnp08026.gho.boulder.ibm.com [9.17.130.18]) by ppma02dal.us.ibm.com with ESMTP id 3gfy1bby3t-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 10 Jun 2022 15:54:02 +0000 Received: from b03ledav004.gho.boulder.ibm.com (b03ledav004.gho.boulder.ibm.com [9.17.130.235]) by b03cxnp08026.gho.boulder.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 25AFs16l24510964 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 10 Jun 2022 15:54:01 GMT Received: from b03ledav004.gho.boulder.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7CE487805E; Fri, 10 Jun 2022 15:54:01 +0000 (GMT) Received: from b03ledav004.gho.boulder.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 278157805C; Fri, 10 Jun 2022 15:54:01 +0000 (GMT) Received: from li-e362e14c-2378-11b2-a85c-87d605f3c641.ibm.com (unknown [9.211.124.91]) by b03ledav004.gho.boulder.ibm.com (Postfix) with ESMTP; Fri, 10 Jun 2022 15:54:01 +0000 (GMT) Message-ID: <4649417b632758c6822214b19f04ce70146c43cb.camel@us.ibm.com> From: Carl Love To: Luis Machado , Mark Wielaard , Will Schmidt Cc: gdb@sourceware.org, buildbot@sourceware.org Date: Fri, 10 Jun 2022 08:54:00 -0700 In-Reply-To: <85fa6e2d-caf5-8afe-a7ec-40cc62ff347a@arm.com> References: <20220608185138.675964-1-mark@klomp.org> <2281be8e-8920-7ba5-9e96-ffd713462b9c@arm.com> <8bfa7ec63758afc45bde1f10b0e4ab91e21e9d06.camel@klomp.org> <85fa6e2d-caf5-8afe-a7ec-40cc62ff347a@arm.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5 (3.28.5-18.el8) X-TM-AS-GCONF: 00 X-Proofpoint-GUID: zmrENE-8fGZJ07HmwTXUtImgP-sPPAu7 X-Proofpoint-ORIG-GUID: zmrENE-8fGZJ07HmwTXUtImgP-sPPAu7 Content-Transfer-Encoding: 7bit X-Proofpoint-UnRewURL: 2 URL's were un-rewritten MIME-Version: 1.0 Subject: RE: [builder] gdb_check_step: remove gdb.gdb/selftest.exp X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.874,Hydra:6.0.517,FMLib:17.11.64.514 definitions=2022-06-10_06,2022-06-09_02,2022-02-23_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 mlxscore=0 bulkscore=0 lowpriorityscore=0 phishscore=0 clxscore=1011 adultscore=0 impostorscore=0 spamscore=0 mlxlogscore=999 suspectscore=0 priorityscore=1501 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2204290000 definitions=main-2206100061 X-Spam-Status: No, score=-4.8 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_EF, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_NONE, TXREP, T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: gdb@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Gdb mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jun 2022 15:54:20 -0000 On Fri, 2022-06-10 at 11:58 +0100, Luis Machado wrote: > On 6/10/22 11:50, Mark Wielaard wrote: > > Hi, > > > > On Fri, 2022-06-10 at 01:21 +0200, Mark Wielaard wrote: > > > On Fri, Jun 10, 2022 at 01:09:19AM +0200, Mark Wielaard wrote: > > > > On Thu, Jun 09, 2022 at 10:37:58AM +0100, Luis Machado wrote: > > > > > I always use gdb.base/break.exp as a good smoke test. If that > > > > > one > > > > > fails, then things > > > > > are really broken. > > > > > > > > > > I think gdb.base/break*.exp should make a good smoke test > > > > > list. > > > > > We just need to exclude > > > > > gdb.base/break-interp.exp, which is problematic on some > > > > > targets. Trying to to understand how you are running the test. I think you are running these as remote tests, i.e. machine A requests that a remote machine B run the test via gdbserver, correct? I tried running the tests naitively, i.e. on a Power 10 RHEL 9 system I ran: make check RUNTESTFLAGS='GDB=/home/carll/bin/gdb gdb.base/break- interp.exp ' The gdb summary is: === gdb Summary === # of expected passes 702 # of expected failures 20 > > > > > > > > It never is just easy is it? :) You are right, I saw break- > > > > interp.exp > > > > fail... I tried to come up with a regexp but gave up given > > > > that it > > > > has to go throug python first and then we don't know whether > > > > the > > > > worker uses bash as /bin/sh so I just added them all (exclusing > > > > break-interp.exp) as a list. > > > > > > Sigh, sorry, looks like gdb.base/break-unload-file.exp also > > > sometimes > > > fails. > > > I have removed from the list. Hopefully the remaining list does > > > actually pass. I ran gdb.base/break-unload-file.exp on the same Power 10 RHEL 9 system. make check RUNTESTFLAGS='GDB=/home/carll/bin/gdb gdb.base/break-unload- file.exp ' The gdb summary is: === gdb Summary === # of expected passes 36 So it doesn't appear the tests are fundamentally broken. We have only played around with running the gdb testsuite remotely a little. Specifically, we were working on documenting how it is done. We see a number of additional issues running remotely versus natively but at this point have not had the time/bandwidth to dig into them > > > > And it didn't :{ > > > > Yeah. As expected, the GDB testsuite is a bit delicate when you start > dealing with > multiple architectures and modes. But I think this is good progress > already. > > > Both debian-ppc64 and fedora-ppc64le failed (UNRESOLVED) > > gdb.base/break-idempotent.exp under both native-gdbserver and > > native- > > extended-gdbserver Running that test natively, i.e. make check RUNTESTFLAGS='GDB=/home/carll/bin/gdb gdb.base/break- idempotent.exp ' generates a number of errors: ERROR: breakpoints not deleted ERROR: no fileid for ltcd97-lp2 ERROR: Couldn't send delete breakpoints to GDB. ERROR: can't read "gdb_spawn_id": no such variable while executing "expect { -i 1000 -timeout 100 -re ".*A problem internal to GDB has been detected" { fail "$message (GDB internal error)" gdb_internal_erro..." ("uplevel" body line 1) invoked from within "uplevel $body" TCL READ VARNAME can't read "gdb_spa The gdb summary is: === gdb Summary === # of expected passes 35 # of unresolved testcases 3 > > https://builder.sourceware.org/buildbot/#builders/76/builds/446 > > https://builder.sourceware.org/buildbot/#builders/85/builds/294 > > Those might be genuine issues. I'm cc-ing Carl and Will so they can > chime in. > Need to work on getting this one fixed for a native run before worrying about running it remotely. I will add this to the list of gdb issues that needs work. Carl