From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ot1-x336.google.com (mail-ot1-x336.google.com [IPv6:2607:f8b0:4864:20::336]) by sourceware.org (Postfix) with ESMTPS id EE5853858C52 for ; Thu, 21 Dec 2023 12:16:52 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org EE5853858C52 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=gmail.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org EE5853858C52 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=2607:f8b0:4864:20::336 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1703161014; cv=none; b=IWxyEKYCnZzkA++fNjDQ/SOJpaWyHbXbmy5wQiJtbllmpa+CkF1lEMBo6NGfAC1SGPi50FzSndIc87BdyrCH5xGcmWLRsl958nGzj4HcSUiJAwPn2biTlKCHw6hjTvhtE38oG0LA4X/DdyEANW67sAkbG2lKKvxEFYibow/e/CE= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1703161014; c=relaxed/simple; bh=eiZGT6D/zDj/BoGvTXRCZjgyfsC+vSH7ZOs8f5Ir44k=; h=DKIM-Signature:MIME-Version:From:Date:Message-ID:Subject:To; b=HwEgYJd/2PFS+3BJQJkG1105z9N6nBoyUy3FdKTOSbR+g6eVoNuKBH0ZfcU5A0J25lWfoVC3mCbDwgzGJnEtSKPsoOUQiR1cd5QxJLq9i2TYIalNljfJ07vAmq37tsrnHdUb2ONKV6Ji3zNjj70KJobllFcOWQk1bTxRk9PnllE= ARC-Authentication-Results: i=1; server2.sourceware.org Received: by mail-ot1-x336.google.com with SMTP id 46e09a7af769-6dbbc637df7so146183a34.2 for ; Thu, 21 Dec 2023 04:16:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1703161012; x=1703765812; darn=cygwin.com; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=eiZGT6D/zDj/BoGvTXRCZjgyfsC+vSH7ZOs8f5Ir44k=; b=JDwdXFXrbUvbPkxeS6GLAI59zroJMp5o4zjyMgtYL8v/rPJyQbSmutNGQOn9t4mpcV br/vaVpsme1T9mUBx3+0eALpMEc0GO3hqK8yOBq+0LaB75bSQWeIP9QvBWrzqSYqnHtl Hwf2h8ZjnSSbDCbDlFnXj5EuXrQUZ4J7V5eFNkbW50RdHWBsHycvvghVVlFekEYzKYen DszuwuBeIvD1DDg2H4qfWmp/LE0yJ3fbJ++moztuWvZ6uoRGji+bRo/RGYmNkp+rxCX0 k9jzFLp4rKvzp1nmzlv0BNZV1cbwb6D8/3CBv3bolHZuWPjj9X3gqOXukjhhg/ndz17+ VtJg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1703161012; x=1703765812; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=eiZGT6D/zDj/BoGvTXRCZjgyfsC+vSH7ZOs8f5Ir44k=; b=EoLeQZokh4gcA9FrtoVTQHd1DKQf6kj9h+UBhIo0hFsmIZ4Jl0hkLN6CmQqsLrhISn 068DtNr8ed9ZuCx7xyy08Jh4Rhbew3/WA3sf/aKaq822VhNWL3etgM2Pal3EG6FDZCVx 2GBzzm16SiGjn6Iz4b+oqGXU+qzdg0s+Njes1a9D0CYnKraSLzWAkvJW32A4hgzvIGqW YepWWAKkryXTN+DPRqWv4QRCS6zOCpU0vHlGGqb13YTBLX3JLLsj0CehXO4g0RuCi8Z9 WsQROLv/IouMAUnSiXQ54k3okzXsOHcJPyBYtev6Z3HwLDe1pxENT0ujd9kVf2w3t/AW /v4w== X-Gm-Message-State: AOJu0YzF10/Oe+JEOkTfoS35CrJt/amLU8KIGH6ytiNq2D7mMFzf5qcu aaq/bdZ9t5BETrE+737viqD0MteWmjAodRfq6qbLg6xX X-Google-Smtp-Source: AGHT+IEmka6NzfC+YxIF0+8nJh0FwDxtVafqtJmGkEBN4lhs8W5awHncmYMDgwcApcujbLU7BRZWJTBXiXGum21j4Qk= X-Received: by 2002:a05:6870:d38e:b0:204:1acf:6f2 with SMTP id k14-20020a056870d38e00b002041acf06f2mr1515658oag.77.1703161012072; Thu, 21 Dec 2023 04:16:52 -0800 (PST) MIME-Version: 1.0 References: <07c7379e983c9f436ebf86e3818ca843@kylheku.com> In-Reply-To: <07c7379e983c9f436ebf86e3818ca843@kylheku.com> From: Martin Wege Date: Thu, 21 Dec 2023 13:16:40 +0100 Message-ID: Subject: rfe: CYGWIN fslinktypes option? Re: Catastrophic Cygwin find . -ls, grep performance on samba share compared to WSL&Linux To: cygwin@cygwin.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-0.4 required=5.0 tests=BAYES_00,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP,T_SCC_BODY_TEXT_LINE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: On Wed, Dec 20, 2023 at 6:21=E2=80=AFPM Kaz Kylheku via Cygwin wrote: > > On 2023-12-17 22:22, Dan Shelton via Cygwin wrote: > > It would be nice if someone from the Cygwin authors could assist me in > > figuring out why this happens. > > Cygwin is famously slow; this is nothing new. We are grateful > for Cygwin because it makes stuff work at all; if it were blazing > fast that would be a bonus. > > E.g. git operations (clone, rebase, ...); ./configure scripts; ...: all > run like molasses. > > The following is just my fast and loose opinion, shot from the hip, > and possibly off or wrong, but it likely has to do with the layering. > Cygwin's core API is based on a C library called Newlib. Cygwin bolts > Newlib to Windows by means of an additional shim below Newlib that > is based on C++ objects, where there is path munging going on and such, > and that's where the Win32 calls get made. It's an additional abstraction= . I disagree with that. Ok, part of that is that the layering causes more memory allocations and copies, but this is not the root cause. The root cause is IMO the extra Win32 syscalls (>=3D 3 per file lookup, compared to 1 on Linux) to lookup the *.lnk and *.exe.lnk files on filesystems which have native link support (NTFS, ReFS, SMBFS, NFS). On SMBFS and NFS it hurts the most, because access latency is the highest for networked filesystems. So my proposal would be to add an option ('fslinktypes') to the CYGWIN environment variable to define which types of links are supported: default 'all'. which is an shortcut for 'native,lnk,lnkexe'. So in case people do not want 'lnk' link support they just add CYGWIN+=3D' fslinktypes:native' to env, to turn off support for lnk/lnk.exe style links, and be happy. @Corinna Vinschen Would that be acceptable? Thanks, Martin