From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pg1-x52a.google.com (mail-pg1-x52a.google.com [IPv6:2607:f8b0:4864:20::52a]) by sourceware.org (Postfix) with ESMTPS id C5E573858D28 for ; Mon, 26 Feb 2024 12:44:38 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org C5E573858D28 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=linaro.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=linaro.org ARC-Filter: OpenARC Filter v1.0.0 sourceware.org C5E573858D28 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::52a ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1708951480; cv=none; b=j+nFTUWA2oz8y2ei+6j5H8LB0EX8Eb2ZpvYnCOgr5AgPTbipGJglWNOcG4uUZnZ6CcfvrFCHWFSHMyKORvH1aueL/XD5jCsQwo+TWkKQCFOG+vV1Rh43+k//m/yMVxnqtIL1H0LpKFIsP/Jzn9UOVV3n50Os35FYTCnt9RhYWP8= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1708951480; c=relaxed/simple; bh=NpMEgmrm47AQTK0P3kNyaKuZOmFNjWdMEafs74Vbs6w=; h=DKIM-Signature:Message-ID:Date:MIME-Version:Subject:To:From; b=EF76WDm56SaYD2fexv32OELhHIWiUO6OnwNzvtrZO0sEMXnHbWMy+T77+zKOHH09BQazL1MB+qg0t1b3Yq/sqah9pQz/Y3C2/tzM7LfIlK+9s4Lr5twzMZlKhgKJ+YiaYSkDGQD+K7uFORUzujDe7SLnblQSOgeRSJZe+XF3FL8= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-pg1-x52a.google.com with SMTP id 41be03b00d2f7-5d8b70b39efso3148379a12.0 for ; Mon, 26 Feb 2024 04:44:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1708951478; x=1709556278; darn=sourceware.org; h=content-transfer-encoding:in-reply-to:organization:from:references :cc:to:content-language:subject:user-agent:mime-version:date :message-id:from:to:cc:subject:date:message-id:reply-to; bh=bvdLt4OOsIBtk62xKxWaBOfLlgQjEvXujCcU61aDqwA=; b=t3R0UCUnL8sjQYKCoCEbExoy4LZI9iIvL+t4qnDofFz8xkSfPullpIDbDr/vuloABU CSH4AFDVkUJ2URB+BI+7XIU8RCGIfnoWPePY41nFaYLnRGyv+ps/8JeXBT2uRGonIXp2 eUhz7PYCKsr6IAOTyGKrkwTMs6IUXbqiEDh6nJdonS7E2fKzg7onpWRIDe++nT8Ggtkq jCq1TbagHiOvMnCQD5ES3qZpt1FHBjfyxMfJTmchnlLyEEDUWjqM4LfFQMgeyEognecu CMHaDyiQ2H0v9Ij70zg0XH8KsEfblCpoSjSrZyW6BSUtjAtQF5NtDrtrsMtH7ObZjzTd LJhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708951478; x=1709556278; h=content-transfer-encoding:in-reply-to:organization:from:references :cc:to:content-language:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=bvdLt4OOsIBtk62xKxWaBOfLlgQjEvXujCcU61aDqwA=; b=FPqXXOPbft3LzCHz85wcy4oovx7bBPLlWjzwIDODOakQeXTq3WpEyx/ftgMb4a+Bex n68me42wKhxjlEzMAR9EGQCmFxtQCH+tlW5No97UL//4Kd0kz0CYIBNb/FuY+IGqpSr9 sMte07ptOumuTnnxCgC2w/ziQGzyaXsggV5XnngAjMvBuiCQHA8qE9EDH59Nqwak9BOI mCrf3/n4Q6k/zs3aQdzan+igIJXlSMxxn6bsSWz019k+BLbc32zDeSER4aTGKp3a7qiq aaXj4CK8tGbK+mYOvnsrCPTAAIkLgFEQ60VYvBd3ifugwC/wfs0coe2ayXqjC27hwadf 7AjA== X-Gm-Message-State: AOJu0YwYVZN0cSrqBOWDywIEMdj9huG/opcCiPSym1MZKYm4Qe7uuaUa w8SpfaD1iIL6zn1MR0FGTJUMbJFTacq9JTjUt70Cdz2CJMltm9EKJ6RXGAm1Nq+mSol+ZpXEV1y v X-Google-Smtp-Source: AGHT+IEPaU5TyCgfEQ19A7nGe/5fiW0mlmA6KBmvLM/2bpTfiQlXCa94jDbFPpLiQYFZv+s+29vuqw== X-Received: by 2002:a05:6a20:d805:b0:1a0:e80f:109 with SMTP id iv5-20020a056a20d80500b001a0e80f0109mr6263785pzb.38.1708951477731; Mon, 26 Feb 2024 04:44:37 -0800 (PST) Received: from ?IPV6:2804:1b3:a7c1:3a1a:85c:fa51:944:f251? ([2804:1b3:a7c1:3a1a:85c:fa51:944:f251]) by smtp.gmail.com with ESMTPSA id f26-20020aa79d9a000000b006e4f0e2cc52sm3914214pfq.168.2024.02.26.04.44.36 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 26 Feb 2024 04:44:37 -0800 (PST) Message-ID: <3f8f578e-5b1f-4482-a2f5-84c0fb962b5d@linaro.org> Date: Mon, 26 Feb 2024 09:44:34 -0300 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: state of the ports Content-Language: en-US To: Mark Wielaard , "Andreas K. Huettel" Cc: libc-alpha@sourceware.org References: <4155299.iIbC2pHGDl@noumea> <20240225224742.GB15517@gnu.wildebeest.org> From: Adhemerval Zanella Netto Organization: Linaro In-Reply-To: <20240225224742.GB15517@gnu.wildebeest.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-5.2 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On 25/02/24 19:47, Mark Wielaard wrote: > Hi, > > On Fri, Feb 02, 2024 at 03:35:04AM +0100, Andreas K. Huettel wrote: >> So... after all the testing gone into the release I thought I'd >> summarize a bit for the list here - by sorting the glibc ports into >> "excellent", "good", "medium", "bad", and "nobody even tried". > > We have several buildbots at builder.sourceware.org for glibc which > probably should start sending build failure emails when things break. > https://builder.sourceware.org/buildbot/#/builders?tags=glibc It would be really helpful to proper document this instead of just throwing a comment on https://sourceware.org/glibc/wiki/Buildbot saying the current information is outdated. The wiki the main source of developer information and I don't think linking to a blog post if the best way to document it. And although the buildbot is a good improvement for glibc development, this does seems like disjoint initiative that did not get much feedback from glibc community and it is not really tied to current practice. On the weekly call [1], we focus most of patchwork [2] results, which has results for pre-commit buildbot setup by RedHat and extended by Linaro for ARM. And on each release and on the following weeks, we check and discuss the release wiki information to check for potential regressions and such. Joseph also keeps a buildbot using build-many-glibcs.py to keep track of build for all supported architectures [4]. So I personally think it would be more valuable to hook the buildbots on the pre-commit CI instead of doing pos-commit checks. [1] https://sourceware.org/glibc/wiki/PatchworkReviewMeetings [2] https://patchwork.sourceware.org/project/glibc/list/ [3] https://sourceware.org/glibc/wiki/Release/2.39 [4] https://sourceware.org/pipermail/libc-testresults/ > >> 1. EXCELLENT >> ============ >> >> aarch64 >> - tests pass nearly everywhere >> - on raspi, likely timeouts > > https://builder.sourceware.org/buildbot/#/builders/glibc-debian-arm64 > Used to have some tests time out, but since we are running with > TIMEOUTFACTOR=4 is all green: > > 4807 PASS > 22 UNSUPPORTED > 16 XFAIL > 2 XPASS > >> powerpc64 >> powerpc64le >> - tests pass > > https://builder.sourceware.org/buildbot/#/builders/glibc-debian-ppc64 > https://builder.sourceware.org/buildbot/#/builders/glibc-fedora-ppc64le > > We only do a make subdirs=elf check but those all pass: > > glibc-debian-ppc64: > 341 PASS > 5 UNSUPPORTED > 2 XPASS > > glibc-fedora-ppc64le: > 338 PASS > 2 UNSUPPORTED > 2 XPASS > >> s390x >> - tests pass > > https://builder.sourceware.org/buildbot/#/builders/glibc-fedora-s390x > Likewise, just subdirs=elf: > > 336 PASS > 2 UNSUPPORTED > 2 XPASS > > For ppc64, ppc64le and s390x we could run a different subset if that > is more useful. The issue really is the nptl subdir, which just takes > a very long time (because it doesn't run any test in parallel?) > >> x86-64 >> - tests pass > > Fully green on glibc-fedora-x86_64 > https://builder.sourceware.org/buildbot/#/builders/glibc-fedora-x86_64 > > 4945 PASS > 274 UNSUPPORTED > 16 XFAIL > 4 XPASS > > But on glibc-debian-testing-x86_64 and glibc-rawhide-x86_64 it > occassionally sees one FAIL: elf/tst-audit10 which times out even with > TIMEOUTFACTOR=4 > >> riscv64 >> - ~5 failures, but there may be timeouts among them > > https://builder.sourceware.org/buildbot/#/builders/glibc-ubuntu-riscv > > With TIMEOUTFACTOR=4 there are no (timeout) failures anymore. > > 4699 PASS > 24 UNSUPPORTED > 16 XFAIL > 2 XPASS > > This is the slowest of them all (takes 2 hours 15 minutes to 3 hours, > depending on how good the ccache is). But we have multiple riscv > boards now thanks to StarFive and one of them is dedicated to glibc. > >> sparc >> - ~5 failures (!) > > Seeing even more failures: > > 9 FAIL > 4725 PASS > 23 UNSUPPORTED > 17 XFAIL > 2 XPASS > > FAIL: elf/tst-audit18 > FAIL: elf/tst-pldd > FAIL: elf/tst-ptrguard1 > FAIL: math/test-float64x-float128-mul > FAIL: nptl/tst-mutex9 > FAIL: nptl/tst-oddstacklimit > FAIL: posix/tst-spawn7-pidfd > FAIL: socket/tst-socket-timestamp > FAIL: stdlib/tst-setcontext2 > >> x86 (32bit) >> - in general tests pass >> - there may be breakage on old hw (pentium2) > > Really a i386 VM on x86_64: > https://builder.sourceware.org/buildbot/#/builders/glibc-debian-i386 > > 4851 PASS > 40 UNSUPPORTED > 16 XFAIL > 6 XPASS > > Cheers, > > Mark