From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM02-DM3-obe.outbound.protection.outlook.com (mail-dm3nam07on2126.outbound.protection.outlook.com [40.107.95.126]) by sourceware.org (Postfix) with ESMTPS id 33DCF3858417 for ; Mon, 30 Aug 2021 13:41:33 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 33DCF3858417 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=cornell.edu Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=cornell.edu ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=E+682oVOS4I6rD0axTFj4z5WRvh73ONMEqGrJZOHtpGem1WrfDPisZwBrRnSc4K/2llad/kwo5mFqZCUitDThfF4HFRHUR30Gx9aeyTO4DVD1+jKEdkrNPS8TDpllnDyoqMQEniBGVXwOHkClqnTkGkKVTja+2oJ3pAwXhi3vHTgCz9/T6YbTcK1jvd8lmHbcnHW0SeAq2+Tk61rGjBmE/ccg1e4g/9snR294cORRW8vp+spm7bXm+CASpEOYq+B5H3zYlhxuvbGfekw7WRZhQeMWVD+l0BzIGMgP/siKog+0IHd4hIcgeUhPe3Ea0n5VguEhwSA9GftuKSWX0n/dg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=RrhJq1YF5HRHhEdLgwhhoysO+CBi68aS8YyUHEkzVs8=; b=NiKD7QQQohxVR34NtTaT3k921VEWjDLC3ckNUEopBfPb1SehWodk+vtW3nrCfv0Om/6ATQQ08a80ttfhw0sID/lq8hlNdCKx7sWI/WujYCSp8lb0QsB2ulPP5Uf2a16jE1JQxIx2RPjufRx7aqrrxuHHZaB4EnZSrS3eX68gXrMkvVbFENuOdG7U5PGMPnuN09XaegcUvEU6+Qgl1ujm2Xq9XJeoGf87DYvHwWthif9WVVksCs3iS237RCrjKe8XGoPM2lqzEcUufI/uN9dAIvfrVvTjpSJ3OdbTGJKer5G+csJGFWYX9vdovzB0GsA2RE7JSxb40LDYllvQWULEnw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu; dkim=pass header.d=cornell.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cornell.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=RrhJq1YF5HRHhEdLgwhhoysO+CBi68aS8YyUHEkzVs8=; b=aZ88LuJwpEWWeZVQ1snycD73RWLfHxcGA+UsA1HgwBVuTT0B3dU6EE8MpJpI8NVOoPNIY2yW/MISdKebUHTJi3KLyMVt0NZNFVQI1NPEbfgul8X7+BTCebt30lWPbvHcs/tADLW3dxdRi6q1OjB50BEIoSQZtJZZqNuPc3N2I6I= Authentication-Results: cygwin.com; dkim=none (message not signed) header.d=none;cygwin.com; dmarc=none action=none header.from=cornell.edu; Received: from BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) by BN8PR04MB5715.namprd04.prod.outlook.com (2603:10b6:408:74::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4457.24; Mon, 30 Aug 2021 13:41:31 +0000 Received: from BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::38bd:b608:234f:9ec6]) by BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::38bd:b608:234f:9ec6%7]) with mapi id 15.20.4457.024; Mon, 30 Aug 2021 13:41:31 +0000 Subject: Re: cygrunsrv + sshd + rsync = 20 times too slow -- throttled? To: cygwin-developers@cygwin.com References: <3b560051-ab27-f392-ca4b-d1fd9b5733b0@cornell.edu> <20210827202440.47706fc2fc07c5e9a1bc0047@nifty.ne.jp> <4f2cb5f3-ce9c-c617-f65f-841a5eca096e@cornell.edu> <20210828022111.91ef5b4ff24f6da9fadb489e@nifty.ne.jp> <20210828184102.f2206a8a9e5fe5cf24bf5e45@nifty.ne.jp> <20210829180729.48b4e877f773cb3980c5766d@nifty.ne.jp> <789f056a-f164-d71d-1dc9-230f5a41846d@cornell.edu> From: Ken Brown Message-ID: <26109994-4ac6-3fbc-bcc7-34287ec9090f@cornell.edu> Date: Mon, 30 Aug 2021 09:41:30 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH0PR03CA0412.namprd03.prod.outlook.com (2603:10b6:610:11b::24) To BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [192.168.1.211] (74.69.128.111) by CH0PR03CA0412.namprd03.prod.outlook.com (2603:10b6:610:11b::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4457.17 via Frontend Transport; Mon, 30 Aug 2021 13:41:30 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: b0927d8c-8a19-47a3-8469-08d96bbbdfee X-MS-TrafficTypeDiagnostic: BN8PR04MB5715: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 2xtnKRTb1gfKxSSu0gYp3oDtf0QVb8PHssSuVGfG6r5yK69tDxN3HX3zDAlg5tVlL8hdfvr4xAE0IuJMQIwa99TnpHLmqEjK2KohQJQBDrFuqos0AI33ALzngJLRnDbq5sYIip577ODUyN0ZBjXQbqlCR00Z8z9WXmIkmDeT6vxVZw4/Z17g6wzgYDt3Uwd6XwrIsChc+bxUGPJ8uE0mJkuqYcA4CI818x86AvOQjToFE/FI1uPCw6b98v4tLXVATxXbY+ss7wRZo7yk/dkqKn9C7C4skFgwhrPdLNDw6BCxRC2+0jJAaQyXVOOTODKGyl3Uv12hB2IkwQHbnxvOkjnWNEgreGZXDbFs3yER+9CmOdYswvg4vnGD5COTUsOKwvI3eedanWeO5GAbc670sdpBdqWSEF36wUBHy37hOxt/rO/twTutEbh0P87xaIG6qfxZ0bocxf4UNZsOODtxeHDQqwpqlvwPGwBKmyHUc3cPDmzjrkgWHeGeE0JWU+kvHLQGNjsZ/5LejRJN7Pnbd9E2mlAZCaoMGNmuAApmcAeYN5u5xE+QuU5dLyERIirIqmc2qPzvAj4ypApp1O/xzL1bBWOxNy9g+5xQRB7DMbcZoR4TzFWzFGky4U2K1qK8CB5MeyTMElM2fiO/54UASzLIbB0EIEG+eZkk63gEIuYMJlEcEv0D339uuAfgSO48QMNkpDTl8O6Bm7ZO2lwIOW/cTjoh12aadJPxfCFmjWSschNHdiFp1WlsvYltigArqbgM6Yc0+xqF8a9jNfOZcjz8F0R40S+nei/3hcpxHfNnSa7jPDpuoJZLIJrpQbo1 X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(366004)(39860400002)(346002)(376002)(26005)(2616005)(36756003)(478600001)(66946007)(75432002)(66476007)(86362001)(956004)(6916009)(186003)(53546011)(5660300002)(966005)(66556008)(2906002)(31696002)(83380400001)(31686004)(16576012)(38100700002)(316002)(8676002)(786003)(8936002)(6486002)(45980500001)(43740500002); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?Windows-1252?Q?X55fN9brkDWsNxKWUSatIriNs9tsPqiqUGMZR8JjzoFvMsv2B5JYZ6Ov?= =?Windows-1252?Q?OKJf7hgLxwCRnHU753hy1KMXFGJIm2VMlo3f074Z7fA+BX9aNQFa8O/r?= =?Windows-1252?Q?ZAROzevM+rpSijisZXa85Pwg8sI12k2N+eeYsB6ge2C84nGBD0Y89NNf?= =?Windows-1252?Q?tYm8ly0BGZP8/QCYqzDlIjIR0CKmb3NuRyYIBb6FOLJK6xryIdDUBitz?= =?Windows-1252?Q?873VhsIsabxugqWsRPhdIZxNGYoE3mx65BNg6ylYPLSog9qA0Zyuemiu?= =?Windows-1252?Q?RvLs3OFuLLUZCplzAjEAL1kOh8pgY3d/ilnVo0E0+W4Up9MRWR/LwAWD?= =?Windows-1252?Q?rqTXLKzEX/oRgdsBikYp3N4KH+FAQnp+icWZ9QHFYjTtzgw4946a4Spz?= =?Windows-1252?Q?BZNDdKod8i3baz/pVXnAYVr7KJDh1EcInJyhD5PlGRDQD22L7iOn7N8g?= =?Windows-1252?Q?7GLZnEypTSCqGSG+C9AtUGc4crePmXvdZUnYBFdku0kyHBi/iDpqlWC2?= =?Windows-1252?Q?RszPisG4wgJ4H9RHFRcJdHkFL5LwTl+s64g2w6n6ffPj50TVFIMLaxDH?= =?Windows-1252?Q?I3pnWo7XUMaIOGYIqxum9r5baoE/hobrZ+qVpbpQhgVGYT/Dnv1olQ/9?= =?Windows-1252?Q?1kgRHL/0n0Hz02Atx3S3wFLPoBI6NfWNuRLRJOJAaNii8TCyz0d1jhey?= =?Windows-1252?Q?ADGSFmpTryWaikaApdiJWaXvUee2YBHs7ccJe8sP6M497q578YJMmol7?= =?Windows-1252?Q?GBnhMLJRwIWG266wWG75feYdowdVC2awMypnMMQTd/u6VM4CdIDlI2mE?= =?Windows-1252?Q?20vIiYFHe3KG1zlJnc9sVXB3Mai2NqZhflr9MoHontpXiJ/9plRAiLvE?= =?Windows-1252?Q?cRn3oFVOfd/JubxWRi7rLw/GDDuVsgLvfLNtALihAeko3t7prOA/ypWw?= =?Windows-1252?Q?gHCFWa6OA07rBbt5tyaP25vbK26Y6UYvJJYEnn6MOdDwvzxDFBA8xgmo?= =?Windows-1252?Q?nMBOSqNp+uFMsTB6GDb7VO/l5AafXkpdLKkfGdgMr7JZpmN/f8fFmgAg?= =?Windows-1252?Q?qUhwJUbhXGLBBH4PPrdAXs55ZBUqNaJ7miKbc0pgpMENWghcYYo8Rhsx?= =?Windows-1252?Q?W2KopwQlbi098lx5OALMMvNbSTbB8Tr+Hqj38XPQnBlTX/2KOYjCBgr6?= =?Windows-1252?Q?dyNq/JaOYyWIyE67iLylRm2tyS6qGQLAVSy2ufh/BV+SJexQobFVO4cL?= =?Windows-1252?Q?juwqW2d7hzeaATOSYFs2ELNcF5nmct2s2qd9MTFP7etGz/PJSpAT3r+v?= =?Windows-1252?Q?Nu0WJNGcUd/dbnCnLo/z7dz2URXmRGkDKkHz7rGVspivo2MGGGb6LDEz?= =?Windows-1252?Q?Gp1ADTXAiju7YB7dnuy3lwv7cadm75E+R3C5XETXZntbinJCuoG+Hvzy?= X-OriginatorOrg: cornell.edu X-MS-Exchange-CrossTenant-Network-Message-Id: b0927d8c-8a19-47a3-8469-08d96bbbdfee X-MS-Exchange-CrossTenant-AuthSource: BN7PR04MB4388.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Aug 2021 13:41:31.0972 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5d7e4366-1b9b-45cf-8e79-b14b27df46e1 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: l2MPTgmFWuMYgk7Q4X+AR5vRF8aIUIUaEr+5CeKGv+BH6tVBpyKccRNSFYso4j/q0ydu9h3GOiVtv4/36bUfGQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR04MB5715 X-Spam-Status: No, score=-3.8 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, MSGID_FROM_MTA_HEADER, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_PASS, TXREP, T_SPF_HELO_TEMPERROR autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: cygwin-developers@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin core component developers mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Aug 2021 13:41:43 -0000 On 8/30/2021 9:20 AM, Corinna Vinschen wrote: > On Aug 30 15:00, Corinna Vinschen wrote: >> On Aug 30 10:27, Corinna Vinschen wrote: >>> [Moving discussion to cygwin-developers] >>> >>> On Aug 29 11:57, Ken Brown via Cygwin wrote: >>>> Corinna, do you still see any benefit to switching to PIPE_NOWAIT? AFAICT, >>>> it wouldn't decrease the code size at this point, so the only question is >>>> whether it might improve performance. >>> >>> Pipes are already using PIPE_NOWAIT aka FILE_PIPE_COMPLETE_OPERATION >>> mode, see set_pipe_non_blocking. The problem is that it's not used for >>> blocking pipes. Rather, blocking pipes use overlapped IO. Overlapped >>> IO is conceptually upside-down from the POSIX concept of non-blocking. >>> Also, the information returned in FilePipeLocalInformation is historically >>> borderline. For kicks, see >>> https://cygwin.com/pipermail/cygwin-patches/2004q4/005002.html >>> >>> So my suggestion is to try switching to non-blocking Windows pipes >>> entirely, even for blocking pipes on the user level. It works nicely >>> for sockets. >> >> On second thought, I'm not so sure how to block on non-blocking pipes >> on writing. Assuming a write fails because the buffer is full, we >> don't have a waitable object to wait on. Unless the pipe handle is >> signalled if writing is allowed, but that would be a first in Windows. >> So in theory this would still require overlapped IO. Does that still >> work as desired if the pipe mode is non-blocking? I don't think I ever >> tried that... > > That probably doesn't make sense. If WriteFile returns without writing > something, what should overlapped io be waiting on? The approach I've taken on the topic/pipe branch is to stop using overlapped I/O and to always keep the blocking mode of the Windows pipe in sync with the blocking mode of the fhandler. This seems to work pretty well so far, although problems could certainly show up after further testing. Ken