From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-he1eur04on2101.outbound.protection.outlook.com [40.107.7.101]) by sourceware.org (Postfix) with ESMTPS id BAC243858D35 for ; Tue, 14 Nov 2023 00:11:17 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org BAC243858D35 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=aalto.fi Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=aalto.fi ARC-Filter: OpenARC Filter v1.0.0 sourceware.org BAC243858D35 Authentication-Results: server2.sourceware.org; arc=pass smtp.remote-ip=40.107.7.101 ARC-Seal: i=2; a=rsa-sha256; d=sourceware.org; s=key; t=1699920680; cv=pass; b=x/cp0B/xug5gKAVgRWXizTwjItff/bGGlRgdCWaP5O+2ITjqEp/Ul642YTqGqubvTAnJqz3Pu4xcrnTOL2rTjkMu4NFwBQoPhO5xdyZ0sSaqTee3l9Tl/3nBi7613Ls8v6CPPZQkygH7nbz54nPONn78cWp3BLkRj4AV+IOV9l4= ARC-Message-Signature: i=2; a=rsa-sha256; d=sourceware.org; s=key; t=1699920680; c=relaxed/simple; bh=+2jUIxFavHYrlvz0i/A4Z8F/D8qfpM2KNPdC6u0mLOE=; h=DKIM-Signature:From:To:Subject:Date:Message-ID:MIME-Version; b=JKD7MePHiKMyhh2mUxDAlAUHE0UOIA2oMizx+MBkexCG4rGxu9iQbOEGvD9WeeCu9xhQBQfHkYy/tkQz4cBtqiDjCRzys4lX88C/NdN2xgBWg6VO7gPL54FkA1YRNOp2nxi8A3pC8vS9SNfDBhDVpWHLehTUBJCs1odniQhwh1Q= ARC-Authentication-Results: i=2; server2.sourceware.org ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Yb1sREsADacuzbta9MBE6/kio0iwU1CKGG1tF8a1NIZri/w2uKBWMf7XeM2aWA/tAcaKaRK0f8CkSnmAN03TNCmMte2HoKQ9huQHL2Rf6qn9zLZ+hv9k1tHjhXDFBgyTrGShyHzyRi5CRkItC5jXF1UkSPdpi+g1cxjhpVCKzEo1EIb/uy71MFekkrEH2IaEjTpUwKUJ334tO+Rtuj3ZBZOcw5D2GzWkbErxQchrfhZSN9gh7dAjwJRtG9kqcUINzhdDRB2Et0IJISNodumhTws4l7z0i313A3yh7JOEgVCx7poQNLiMl9SdXlUzRKJSn+Sl9gFMO69VVnUxOA5eoA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=+2jUIxFavHYrlvz0i/A4Z8F/D8qfpM2KNPdC6u0mLOE=; b=CouZCkvTU3Hx1s94ummo95F1cBeT7m6aTMfd/vF1dFsiIwL1J8raUMHEFWDH54JL7QMIH+ttfvcVsET1G1/Q2v10dl8RGeMaZcSebRqcoIZVng0Ku5MPziZ4Te8BLYr7nFqfK3nbLypLu5G4WmtFRrbq6qWppZBBOE++YwkyZRzAKEUnTaz9rkarB2Y9YwHrLJV14DwLx3ZPDlccdd0lzdYi4qCuz+5+icHwUzSQl/DK6LypjUpnXuR3Hh4mN5yJ6hJvpyIiYV4/JaeDWOHpAZDS+n0a1pvng9QkRYUwak8rdFhEZI34YTZNJuPp5jZzE2Z1j7uo9X9wPcVd+tSHJA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=aalto.fi; dmarc=pass action=none header.from=aalto.fi; dkim=pass header.d=aalto.fi; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aalto.fi; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+2jUIxFavHYrlvz0i/A4Z8F/D8qfpM2KNPdC6u0mLOE=; b=TfsTfc9dSxR5+kJ3ctDzA5rNbKrw44xM89j8Fd5RFe/Omr2DKHcWwEcFNgp0IyWGMr86Nix2pLroYuix3cu6l1hMxVbmEVlk5pb4ShOikv9gRbHIpxcXAc6KORVAo3dzVcVEC0ci27GnwT7GOV5CZBz+JwajwNnZhbd+Pz0uI5Gk7G20BAKISIK/95JuT82N/7Et0M6NJQIlMYCjjpS6gY6sLXqQ2buTliDp5vJhaYgh0RgHdGTnl+fepQp/fNm8g3dKjBIiLU4p+CbwyTBeYhv1GynVZMqtv9vYjcAh2FqmOzdpLpxXtqa5+L3vu1MbG7YUeMPrsiy/4qHRu49KIw== Received: from AS8P192MB1191.EURP192.PROD.OUTLOOK.COM (2603:10a6:20b:3d0::11) by AM7P192MB0546.EURP192.PROD.OUTLOOK.COM (2603:10a6:20b:179::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6977.31; Tue, 14 Nov 2023 00:11:14 +0000 Received: from AS8P192MB1191.EURP192.PROD.OUTLOOK.COM ([fe80::134c:7e5c:8812:7c28]) by AS8P192MB1191.EURP192.PROD.OUTLOOK.COM ([fe80::134c:7e5c:8812:7c28%6]) with mapi id 15.20.6977.029; Tue, 14 Nov 2023 00:11:14 +0000 From: Kozlukov Sergei To: "libc-help@sourceware.org" Subject: A public interface for library search Thread-Topic: A public interface for library search Thread-Index: AQHaFor84Wo6Zlj2vUSXpUi/XwdskA== Date: Tue, 14 Nov 2023 00:11:14 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=aalto.fi; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: AS8P192MB1191:EE_|AM7P192MB0546:EE_ x-ms-office365-filtering-correlation-id: 2df7351c-7a69-4efb-3deb-08dbe4a63727 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: tEhJMA3WQDOfPKZdqDBChyx47W1KCAoG1ORSTkqEalE/wyhNQjaPFQCGw3PmwSnfCJ+gxSM42BLo+fLzaXKwFcfM7IdEdiZo17dNPUTtkgzjUxfP1FVK9vokoUGItDE614YFClSGzDJsyneLxCmrkFKTxh4YAYm0oqmPt7x7p/euOkawND6lfTMpZOzRjwm9mp5CmrjE4ykJDuboJ9dzlXOnPbXvQBU8//XufG8ekuA1a5of2ZrkS/MzKC9g1DBamLijNez3u/PThD6DZWmbQHI9g2XB/+AM0W7k9RWhzrAJmnfBySM3Qqj648nu57vSS6DkkLetJGkx41dnLzvTffR6E7NXi3/8axfI08pvX+RoBjo9vqIHclUeOS8TMT7kqPUcAg3bwrWy3ajkJU/Gg86Ucw4+QCpHnRBopgBJW0Tx/nAFsgl42XVhOYsNOOC7BFiDX8Cx2+dUbH7e0CuEBhzlbw8dfni4ywZ7rRR/Cf+yP0s9gGxUxNpbJHMwEzXHCMjtnyEZ4iAYcHnTVZ+UKwTOPg+qDhts2jE3mSodqwczzgypJmU/1CuWOtoER2R7LDz8Xg+FhDhgT90cPPvNSDTNOIKDhFgYMf7D/m7NP2m4xo5UCfwvtfHvAkeHvT9+k2QVf2ZFx7HHm6NzEMkMsg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS8P192MB1191.EURP192.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230031)(39850400004)(366004)(376002)(346002)(396003)(136003)(230922051799003)(1800799009)(451199024)(64100799003)(186009)(38070700009)(122000001)(83380400001)(91956017)(26005)(71200400001)(6506007)(55236004)(7696005)(478600001)(966005)(9686003)(5660300002)(86362001)(55016003)(52536014)(33656002)(41300700001)(2906002)(38100700002)(66446008)(64756008)(66476007)(316002)(6916009)(66556008)(66946007)(786003)(76116006)(8936002)(8676002);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?8mJIugA9ChVpyzfmF7i52Weady3qy4juyiZKWJVyvMZDHucpi2AZVikvj8?= =?iso-8859-1?Q?8KAj/YQ92x55CEKlSXqmhR9PdeJlV3lwXeTuh596KhjROVaRjC4SiJNUnf?= =?iso-8859-1?Q?jY/RB67S6eCDVu9/9aKcsc2FPM0jljbZF8vdmBJVm+bdC2GfK+MGTCJAp2?= =?iso-8859-1?Q?yuFOPoXEXLmzAQpwJtGNyjw/S8Xzb6WLSLD8OtOvLi52KrAHsiDl2mmkYj?= =?iso-8859-1?Q?qJsaTxzJ6apnvAuuqkxlEZxjL4kr2SmRE2fCFZ+5ysAxtEkejs3hFZmlDw?= =?iso-8859-1?Q?eHWm6t4xs7c49Vqm7aKbk8cl2e45VOlhUf6a9nKkGy7mQI445aFBviKaW5?= =?iso-8859-1?Q?6txbCaD4v5/pz81kFdimlF4atmvQEc7871wSJ2BfuDGbLUXyOIjzIFV7uR?= =?iso-8859-1?Q?eh3sBIhw3qpb6B1ceu2r0EVGVzL2n2lAYViyLJ8+hDG/oZX7PcRkxo6HpQ?= =?iso-8859-1?Q?wdCKopm260CuEKm2TfS2fmKmlnvhMta3FAuxs09iIblc89Y26B7Ur+GWHy?= =?iso-8859-1?Q?mumfgRRDN/yXU1Jh7pJHPFqbt3qA8GuqrDQTNIV7gPtN98LbzY5GlATdvD?= =?iso-8859-1?Q?GpKplkaI5/WaNZNCAqj5NmrDP8XVfN2GIzQxfkdTr3MAQZsc8gt8FHYPg6?= =?iso-8859-1?Q?/9qWNjMi8nI/+BX1xbcnCk+bBzmgQzJ52w6XPzvt0pzd/7Aje5uBc8biuG?= =?iso-8859-1?Q?4roNG3kbZcL9dxfu4Q3aOaYuW6jT97si1wx4n7XdiY2T4/Y4hjm0GYpl0f?= =?iso-8859-1?Q?tYzJQ6sv3OuBsDz+e+qx0Mpjt5L4+ZIozUkb95CHdJMrraYvI9wvxgPI4r?= =?iso-8859-1?Q?+nwUJXuq0dzPISl5M2G/uzJ5u0dOWi4hag2Pm1k8zK0VpZGCy4tXRGrzK8?= =?iso-8859-1?Q?+DPM7LqQITODPRwc3aYiDhVqbM8/iZR0OosoratfZonEz/XNZWkGefeA1n?= =?iso-8859-1?Q?zv24gakkX4lbemueTGOcvARcheIIjYLhBopoNBdbGLdL6we04Y0saMSN9c?= =?iso-8859-1?Q?t9Sc4If6KKGqnTROCLWWF+5YZGdVyYorpj8zYCDBDLgsdzhvmjQw8BSSXx?= =?iso-8859-1?Q?HYEotV9xHjXxgbnrCPNwlz9zmeBV2VavouTOCBpgOeZiQ7/4DdFSTKy8KL?= =?iso-8859-1?Q?pdfhglCSQURWyqsygHDUgXJDSewqUuXDxIo2htWlzozlN50bDaxWL40ceq?= =?iso-8859-1?Q?dDTe266ktDwqrtm47QGA8zWJ9xyG9WrcP51P6PW8jU1S9+zHwjcNahtk++?= =?iso-8859-1?Q?JiugeU8RT23YTl3S5lIJ1PtQkXA9sUGBZxXKhQJLXW7i3yoDzHI48X3xhE?= =?iso-8859-1?Q?bulgy67F1auP2tffv8KTeMALL0Zbe5g25a3vGlGjUkazDriv8JDUpVNiOm?= =?iso-8859-1?Q?Ax3IB0za/HtAgCezgnffRrRuUSGdImXs+urBUIwYDjfZUvVeUfLEQhUwq2?= =?iso-8859-1?Q?dyV+qlg7fTsATGf7cJcgvJBR/8tSWJ7vyw7Z9UxOSyi44xpx6GH/wb8uc1?= =?iso-8859-1?Q?3IEgyeh7W1/WpjlSEQQL0mXo8ko3bznESQ1Byh0mO6Q8su0/3J9kGFc+VV?= =?iso-8859-1?Q?ls8pYk3T40aKyUFbXf1jCC3XWF61xHYl5zsRESYXUnhmina9/cnHpy/+AY?= =?iso-8859-1?Q?GJP0ir0jXSumQV1kVlucbaeSUKYBzJgycD?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: aalto.fi X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: AS8P192MB1191.EURP192.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 2df7351c-7a69-4efb-3deb-08dbe4a63727 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Nov 2023 00:11:14.3758 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: ae1a7724-4041-4462-a6dc-538cb199707e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: S4dc4X04d3BesysiNjsZ5qg/NxOJ12Vv9zn7iactL576RKE4exb2ivarYWudZK51Al4SAt80Aa5UxLx2NNjewN4P5vyYbMzs9uQ9HBFxVmA= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM7P192MB0546 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: Hi! I wasn't sure if this was worth a ticket on BugZilla yet, I hope libc-h= elp will be an appropriate venue.=0A= =0A= I'm trying to assess if there's such a thing as an agreeable interface for = locating the host platform's shared libraries. Specifically, if there's a "= conventional" way of predicting, given a soname, what specific file the `dl= open()` would have loaded, but without actually loading it.=0A= =0A= This task is, I think, precisely what certain container-related projects tr= y to accomplish by peeking into the /etc/ld.so.cache, with the purpose of l= ocating the userspace drivers that need to be mounted into the container (t= hink mesa or, most realistically, libcuda.so):=0A= =0A= - https://github.com/NVIDIA/libnvidia-container/blob/1eb5a30a6ad0415550a9df= 632ac8832bf7e2bbba/src/nvc_ldcache.c#L370=0A= - https://github.com/NVIDIA/nvidia-container-toolkit/blob/da0755769fee3ab07= 1aaa3b9fac6fe085da7071d/internal/ldcache/ldcache.go#L36=0A= =0A= These tools are then used by many downstream projects, e.g. apptainer/sylab= s-singularity, docker, etc.=0A= =0A= As far as I can tell, /etc/ld.so.cache is glibc internals and isn't meant t= o be used as a public interface. In particular, NixOS does not populate tha= t file, and the nixpkgs simply patch all software that refers to it.=0A= =0A= I think this behaviour has to change upstream, in those projects, and for t= hat we need an interface that could be considered "conventional", "maintstr= eam", and "supported".=0A= =0A= The combination of `dlopen` and `RTLD_DI_ORIGIN` are almost perfect for the= task: they respect LD_LIBRARY_PATH, LD_PRELOAD, and even the inquiring pro= cess's RUNPATH. Unfortunately, that comes with the side-effect of executing= the loaded libraries' constructors. I understand that this shouldn't be a = security concern, at least in the specific case of nvidia's container-toolk= it and from glibc's perspective. However, there's no good reason to actuall= y "load" the libraries being searched for, so I expect that this solution w= ould be, generally, hard to sell.=0A= =0A= Thanks!=