From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm1-f49.google.com (mail-wm1-f49.google.com [209.85.128.49]) by sourceware.org (Postfix) with ESMTPS id 0A87E385700A; Sat, 10 Apr 2021 12:38:35 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 0A87E385700A Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=debian.org Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=luca.boccassi@gmail.com Received: by mail-wm1-f49.google.com with SMTP id o20-20020a05600c4fd4b0290114265518afso4321665wmq.4; Sat, 10 Apr 2021 05:38:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:user-agent:mime-version; bh=juwN2Ju9Xvp5uSi0vlXRUj29iz/sHpFQoJxpeuAk1k8=; b=eYosDZ/Z/FASwnqWUQrNYXeqTvSo8EibHaPzJ8+sxq5SWCtiLpx/ajWc7JZb2Q/++z 1fJWEKxBsRnn/vM18EbpDADEFC09VnyHbQ3Q+jJV/7g2JyeedP+GkbOq8Y1fAT+iTksH GWBUhOI6e9XVKvgAyZvLwJixv3tAfIrQZHykfvnD93r0JU8ZpPlXKtYPu7nZw3kO95zt 6rs+aI4oujkmJTOpoAbNICV8eWcs4jnLl8tG0fGvBsI8ul9DSOLWrtb6LV1maWfvgs5N ruQp0tkrdMDKprwMfmyQPUY6LYQqrRlM6DfGtaHbxh+XsprGNcanEwsnBFb+QJqffyTZ iiGw== X-Gm-Message-State: AOAM532hDCLlusSlbJ1NJC1qaNtTswQ+SfeVGEclBZK+RITAD5Ny/pZb zNkpYsKmMIyOO818vLmCNAE= X-Google-Smtp-Source: ABdhPJw8C6QetpS6HB+G/a69FKzkvE52mY8MlagcKf2fmhuHIpmBFvVFvCJ2AEf5abWO+j2oT0FP1Q== X-Received: by 2002:a1c:3c05:: with SMTP id j5mr12715499wma.61.1618058314143; Sat, 10 Apr 2021 05:38:34 -0700 (PDT) Received: from localhost ([2a01:4b00:f419:6f00:7a8e:ed70:5c52:ea3]) by smtp.gmail.com with ESMTPSA id o14sm9004260wrh.88.2021.04.10.05.38.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 10 Apr 2021 05:38:33 -0700 (PDT) Message-ID: <2b91ec1654b6c07cca2b5c113df772c85c0dd22c.camel@debian.org> Subject: Re: Storing package metadata in ELF objects From: Luca Boccassi To: SystemD Devel , "elfutils-devel@sourceware.org" , binutils@sourceware.org, debhelper@packages.debian.org, debian-dpkg@lists.debian.org, devel@lists.fedoraproject.org Cc: Zbigniew =?UTF-8?Q?J=C4=99drzejewski-Szmek?= , Lennart Poettering Date: Sat, 10 Apr 2021 13:38:31 +0100 In-Reply-To: References: Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-/qEx39TPZq/AB1AtZwA3" User-Agent: Evolution 3.30.5-1.2 MIME-Version: 1.0 X-Spam-Status: No, score=-1.5 required=5.0 tests=BAYES_00, FREEMAIL_FORGED_FROMDOMAIN, FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS, KAM_DMARC_STATUS, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_NONE, SPF_PASS, TXREP autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: elfutils-devel@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Elfutils-devel mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Apr 2021 12:38:36 -0000 --=-/qEx39TPZq/AB1AtZwA3 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, 2021-04-10 at 13:29 +0100, Luca Boccassi wrote: > Hello, >=20 > Cross-posting to the mailing lists of a few relevant projects. >=20 > After an initial discussion [0], recently we have been working on a new > specification [0] to encode rich package-level metadata inside ELF > objects, so that it can be included automatically in generated coredump > files. The prototype to parse this in systemd-coredump and store the > information in systemd-journal is ready for testing and merged > upstream. We are now seeking further comments/opinions/suggestions, as > we have a few months before the next release and thus there's plenty of > time to make incompatible changes to the format and implementation, if > required. >=20 > A proposal to use this by default for all packages built in Fedora 35 > has been submitted [1]. >=20 > The Fedora Wiki and the systemd.io document have more details, but to > make a long story short, a new .notes.package section with a JSON > payload will be included in ELF objects, encoding various package- > build-time information like distro name&version, package name&version, > etc. >=20 > To summarize from the discussion, the main reasons why we believe this > is useful are as following: >=20 > 1) minimal containers: the rpm database is not installed in the > containers. The information about build-ids needs to be stored > externally, so package name information is not available immediately, > but only after offline processing. The new note doesn't depend on the > rpm db in any way. >=20 > 2) handling of a core from a container, where the container and host > have different distros >=20 > 3) self-built and external packages: unless a lot of care is taken to > keep access to the debuginfo packages, this information may be lost. > The new note is available even if the repository metadata gets lost. > Users can easily provide equivalent information in a format that makes > sense in their own environment. It should work even when rpms and debs > and other formats are mixed, e.g. during container image creation. >=20 > Other than in Fedora, we are already making the required code changes > at Microsoft to use the same format&specification for internally-built > binaries, and for tools that parse core files and logs. >=20 > Tools for RPM and DEB (debhelper) integration are also available [3]. Wrong Fedora list address - off to a great start already :-) (fixed now) --=20 Kind regards, Luca Boccassi --=-/qEx39TPZq/AB1AtZwA3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEErCSqx93EIPGOymuRKGv37813JB4FAmBxnEcACgkQKGv37813 JB5ZPw/+LpphKQfyxXx9MX4/pZaUAI16+fD7vEVgRUrf0U3iYTLYqApixiO9gSa0 kix48f8XSixkJbePEjeFCcqAPyK8E9wvn4CIB8OsHChamqp5LvnZa5oWuuB7rTEZ TumSLtyy/sR/r/Oc4EW44REhY5UQgWfWhbQqzBowxjy2IA94cqpdmXlHeN1dzatg nb1+gCwEf2URmpghIi176C7efONA/cxdvmIeiqpez3sw5+62cNrtN6Y2E4U2UdaP 7pPiDHW8jFlwtdyOp9Luu8NyvAC8fiyRARFdapp72hOZH+fmhZneb0iDRIPflspR o5bOcghRqnR+1hThPyBstR9mrCE/TYv7+EY/WKM6tFXmbRWlFxosX+bl9YGiw5bW 6e/XZ7iBd5AeeoVDdPbNrtQKohfdmyta3QJkZredk359+2zH1ovMV3r+ZifNkUyj JJ6v5isLzrN3dBHwb4rKxgodLkXb7THeNxaAAocvpYVTKS9Mqgmdi0oDaSCnV8qC 5HN3Yg2VXNsCIuglKkOSpO+jrhTmblfxq++wmf+a/pJKJQovHqQwkRGaVrYWzsWs Y3wyaWQawliOyk+Dc7TOQa721kAeXhsfWgUdzKUnSmEi5cDuXOsxcBjl4Sm7uvuR QWrwNzmgoqgKaZaX2SuZMyNE5P1khJOGvjfN/qDBuOgQskxD68A= =DIZN -----END PGP SIGNATURE----- --=-/qEx39TPZq/AB1AtZwA3--