From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM04-MW2-obe.outbound.protection.outlook.com (mail-mw2nam08on2125.outbound.protection.outlook.com [40.107.101.125]) by sourceware.org (Postfix) with ESMTPS id 3DCFF3858C60 for ; Mon, 13 Sep 2021 12:51:43 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 3DCFF3858C60 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=cornell.edu Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=cornell.edu ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XpAJoT67IpssTK4LNGu9qnYq5KbW2A6Qq68FO5zhTTuDAPfFM8LeIz+zBO4iS/5otyKjPMYXq1s2DuhGWajsr5pagPdVxgEhqJWTTIVIDdfNJygFYBrpwO5ETdWMt+L2HaVyaGcHGpoQMwkuysxzTzQiVDfOcqINCcLjiryinJqO6T+eOt8c0yGvWzVpPTe1gLsIUZ9r1YcEB1xpCtjigdubq8DXznxpo117B7ibjnemS2YZAfWdm5fP2T4S6mPULSyj431f4TAw3DdLG/YWgfJoPHp9HAJIVi/LSTvjCNYa66ASkkZ4in7zONAxJg3uaYg/3sYjJp/TVRxnurSFAA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=pLLzshdAutjtP4SOLWA61iwmsAUgsF7iT5fSpLPEirA=; b=hWWrdWwZv+CypZk5iYRin9RIkXgc46fFc+xoaphJ5rfmgXlCSFyvDVZxL4sGBLmGtQNdJnU/jDEVfecWuqJiKUWx6fvpjhtKoWonJ9zzS5oftvkRxj3HojQwHnqy15BlUr4+cTmnLGHKAE19a8H27UW6V6dv58FfquFya8d0gLowfbDtKAA9I9IbjtJCcplGTwjJ0qm2cj8VX1pM3+vrMdbznHeInXnBSYUqpzE0Zde+cxEgmEQ7SPoZxx7nSPYBy9fPOJELkszz98DZCTRXWtjLXXpSwIVKjfIHh50FAd+I6kcSV8K1Xpiu/7/NOpELiXLCB+ytoDWC4JFRn8CLyQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu; dkim=pass header.d=cornell.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cornell.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pLLzshdAutjtP4SOLWA61iwmsAUgsF7iT5fSpLPEirA=; b=SqJdydyvFGYbXoCapj20PoPhLZMcUY+nbjzPOm1NBocuzRV9adsBgpafK63RH2X86V5VywSFb/ZU9CZCsjg6guN93qTpL1LgO4Xo/EKerRJK8W6+P0ZXoVNccFR4c1gTj4oIaNcJAejdXHFctDeDVVAEySVnwxtfNJrIW1HiHxA= Authentication-Results: cygwin.com; dkim=none (message not signed) header.d=none;cygwin.com; dmarc=none action=none header.from=cornell.edu; Received: from BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) by BN8PR04MB6065.namprd04.prod.outlook.com (2603:10b6:408:55::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.14; Mon, 13 Sep 2021 12:51:40 +0000 Received: from BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::5113:e84a:b38a:7a66]) by BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::5113:e84a:b38a:7a66%6]) with mapi id 15.20.4500.019; Mon, 13 Sep 2021 12:51:40 +0000 Subject: Re: cygrunsrv + sshd + rsync = 20 times too slow -- throttled? To: cygwin-developers@cygwin.com References: <41A583E1-C8E7-42AB-9F24-EEC33A41EC60@house.org> <20210907122631.65452be8d021ec72259431d5@nifty.ne.jp> <20210909124115.555c6be15d675500617d284a@nifty.ne.jp> <20210909170549.506cc3c1f6029d904fece6dd@nifty.ne.jp> <20210909211940.51ef391e27d43f0421962cb8@nifty.ne.jp> <20210909214246.cd1ff1a3062fea27e51ad4ae@nifty.ne.jp> <33386baf-3b2d-d57f-2ad3-1bd328ed7935@cornell.edu> <20210911075734.aaf37697ba7db2ad14d911a3@nifty.ne.jp> <20210911113517.f74fc3ac1971bbf04c7a9bd1@nifty.ne.jp> <695ce1f4-4f7d-f3f3-6dd3-087467d67b28@cornell.edu> <20210912174849.3d38107568065a95aeb19c7c@nifty.ne.jp> <20210912200423.667e40eb1adc52461bbefa20@nifty.ne.jp> <20210913085431.8b13feaba276699fc3920a7b@nifty.ne.jp> <20210913174027.c0b7a03cf09e6c59752ed735@nifty.ne.jp> From: Ken Brown Message-ID: Date: Mon, 13 Sep 2021 08:51:38 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 In-Reply-To: <20210913174027.c0b7a03cf09e6c59752ed735@nifty.ne.jp> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-ClientProxiedBy: CH2PR14CA0041.namprd14.prod.outlook.com (2603:10b6:610:56::21) To BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) MIME-Version: 1.0 Received: from [192.168.1.211] (74.69.128.111) by CH2PR14CA0041.namprd14.prod.outlook.com (2603:10b6:610:56::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.14 via Frontend Transport; Mon, 13 Sep 2021 12:51:39 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 36842c93-a797-449f-824f-08d976b53ada X-MS-TrafficTypeDiagnostic: BN8PR04MB6065: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:5236; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 3bVK12RIJlLaGRTgBfgvaXLNeTLQiNE+Ww7mt0MDusznw493Q1lbLaDAV33DAkdHcHA3UvZbxHS1UBOEceWM16JcaekCFaednQ5DuxBrIs0yt6Y/0O8mozicF3HN4YUS4SfMEgb4ai7yKgKdhCmOEHJCh00TrBQT8wWte1yNZfKctduWoRitajXX7Kn2wgTBfSP+8ysSG3h85IhXGjESJSjQlraVjtNrJNBJZ2bbrX5StkdIXfpg7szS/AtYubAz+v/Qg2a1XrjyLaya4ewE+xRvpupN4cVDRMruagKE/Pl0qLSuB4Xu+NO6KZB2EfJX9dJzak1R3yMvNfZ60WqdkHZSeevl9l3mrBmf7rEoAGNocxvcs8b3+bFOk7FbXT11UPHXpUX153UX32/a0Vgv9P0IWo2nsOwsj4qrcsqTkEVR1qVds7uRhYdOv8e9lxmQi4w72dwt3pf4GUMKAy1FA00cbuUDN0rXzBsAhBp9KvbSid0sYzRMOrWOzrxVkTqzeu+JEfP1xbsN3muKgDKeUA+cyK8XUP840kRxpE7XVhv/2shNPLrl1G2wVX3FUjgMPckicReuB5/dYDbwY238Qs2T6par/lNo7+DYEOgSAthOe/RZCCeNHsQ0EKE2PvnB5sLX93nb4PDMsj5zVBVAiborCL6pwozuzsTnbgOSk3N9b0Dlx31L2hG45TIwK7BUCfru+5HmovWaGjFwuSGuxj6t17gczH4TQfDnkFgF7XgCwn5Uzg3qILY9IiT15jRc X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(346002)(396003)(39860400002)(136003)(376002)(366004)(53546011)(2906002)(5660300002)(66556008)(8936002)(66476007)(2616005)(6486002)(31686004)(6916009)(8676002)(31696002)(478600001)(16576012)(186003)(956004)(316002)(83380400001)(26005)(86362001)(75432002)(38100700002)(66946007)(36756003)(43740500002)(45980500001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?Windows-1252?Q?2y1W3QTisB+922UBCx3LBOjw0JTPwJKF1h0zz7DDja/C8Z9Jg2oTST3z?= =?Windows-1252?Q?/fOYjkX2QUrqYJFAA0AFBSTPs8sC1LaOrnojEIBiUS/6rUwe6SCWZj8Q?= =?Windows-1252?Q?pfNwnjCPfamJrC95TQ+i4c6o/o27P0373+YbdGIhctskU4zoX88kTo2N?= =?Windows-1252?Q?lpXkB5gGHPX+tAzYTREWfvTI4tNroNqQAFJK2hipcYKHbFijfvXKqfU6?= =?Windows-1252?Q?v0naRC08jV1tILlc1pJ5KPqouQXmF+Tb+zn5Gf0Es5b+KqG5mKjUTWPs?= =?Windows-1252?Q?7YsbcRGI4NaN1WjNMXt76gOutNCIJXDAROplkXlTz6BReeghU05PTKk9?= =?Windows-1252?Q?k+BUcScEPeCgwgDtE+5MWNJ8B6wg5sTdEJxSoKy8XahSf6piogloZfsM?= =?Windows-1252?Q?KH1xmnQ/c3bQKv+JllTQ4HE6rqUdNxuQkPaLuPJfSvok6LioUXBLN1px?= =?Windows-1252?Q?TCDHiMahr9UBf/mTnReZ9brBdh8QyF9E36GA3wBZ6ob48oxeO30rMkxG?= =?Windows-1252?Q?AfGt5LgRlqBVYxZ0P/W1Hw0TTaNc2nsuzyKzzQbK4XETvOZbU0rRZeYb?= =?Windows-1252?Q?29xazZIybPd/XaTEsf2lRw7RyxdHAgzIRgQltjcpzjCUUxovmzMVbW5X?= =?Windows-1252?Q?YBOFezgN/J6pLfYoJoP4GVHACTNr/Qry119nEzUo5+SovIbLqdONG5KE?= =?Windows-1252?Q?CPPYHq7lRG52XwAa1npHFCOLt+k9Pu+mFY8cr3PKk+tMKzx3gRLoo+Kn?= =?Windows-1252?Q?s1AMDyS/vaL15+gbDGxVhtTakM9LWoKUTWy+0yKkMXRhIYSRJ6ymz0MH?= =?Windows-1252?Q?5NkSJPMYl1oiXE4TYEQJOGwl63g704c2nds90PZuwW1MCJTM9GcdnE9/?= =?Windows-1252?Q?oTT2hEI4QCi1w3igfNs177v1O/sRpKB9luw/qyWXj2jLm6qnvvYNGWAP?= =?Windows-1252?Q?YRsENsfahU4pcdryKwwd/eD2VOj4pk8fVl28paOjRU40BRZ/k96GUm2b?= =?Windows-1252?Q?XyAzSSUxDkXy/vRZ0/ETzKM6AQ8UymDZd6SGrawq9X+0WGYPM/+ZSPnn?= =?Windows-1252?Q?4So1dj+p8de8y1iLTJtJxRKh8v/iE84iTuWqyOlX7D/4riu3EmomlQxC?= =?Windows-1252?Q?QcJoE/Rzxy6kTW+2CKQhV5mWK/5O18Db6j7iituRSL83VWZXxNuSkZ1I?= =?Windows-1252?Q?g1Uplpt7wRASBVfMgo+Di76nsNrQQdPl/SMRRPUU89N9uZ2c0CZTYrkS?= =?Windows-1252?Q?LFwJ+Z9qQqJQIyPZWnF6d0mX1Ju4J9yWjYDF/+r3KcOKaFXMfYsxhZAW?= =?Windows-1252?Q?pl8k9U+eIPEodIjreJCyQpZ4MRgB8xwHEsslKP9HmH0Ycv/JUFXPd+RS?= =?Windows-1252?Q?G/wWBAac2tgEuw7t3JM0jxdnO21HsvpFpmW4wsE+Z7sGn894/H3YQrRs?= X-OriginatorOrg: cornell.edu X-MS-Exchange-CrossTenant-Network-Message-Id: 36842c93-a797-449f-824f-08d976b53ada X-MS-Exchange-CrossTenant-AuthSource: BN7PR04MB4388.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Sep 2021 12:51:39.9761 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5d7e4366-1b9b-45cf-8e79-b14b27df46e1 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 5DkkRMMV+C29guDUBJGnqZ0rizZ8F8PScJZ/JpaYH9m7USnIdjMYkuN/jqen5W+ObhSRtX+8+YclqmO7ZFlZpw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR04MB6065 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00, DKIM_INVALID, DKIM_SIGNED, KAM_DMARC_STATUS, MSGID_FROM_MTA_HEADER, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: cygwin-developers@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin core component developers mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Sep 2021 12:51:48 -0000 On 9/13/2021 4:40 AM, Takashi Yano wrote: > On Mon, 13 Sep 2021 08:54:31 +0900 > Takashi Yano wrote: >> On Sun, 12 Sep 2021 17:46:47 -0400 >> Ken Brown wrote: >>> On 9/12/2021 11:10 AM, Ken Brown wrote: >>>> I don't see how this solves the problem.  In the case we were worried about >>>> where we have a non-Cygwin reader, the writer has no query_hdl, and you're just >>>> always reporting write ready, aren't you?  Or am I missing something? >>> >>> BTW, we could just decide that always reporting write ready in this corner case >>> is acceptable. But then we could just do that without going back to query_hdl. >> >> The various combination of cygwin and non-cygwin cases resuts in: >> >> W P R: current, query_hdl >> c c c: OK , OK >> c c n: NG , OK >> c n c: OK , OK >> c n n: NG , select() always report write ready > > Sorry, this was not correct. In fact, > W P R: current, query_hdl > c c c: OK , OK > c c n: NG , OK > c n c: OK , select() always report write ready > c n n: NG , select() always report write ready What if you use query_hdl to fix the ccn case, but also keep the current code in raw_read that serializes the reads and avoids a large blocking read? Would that avoid breaking the cnc case? Ken