From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM04-BN8-obe.outbound.protection.outlook.com (mail-bn8nam08on2129.outbound.protection.outlook.com [40.107.100.129]) by sourceware.org (Postfix) with ESMTPS id C63B0385783A for ; Mon, 13 Sep 2021 13:03:07 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org C63B0385783A Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=cornell.edu Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=cornell.edu ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SLd8sjN7TxqgE35HUwvVrkVtxwnLT8Iol325s7IeDqUjNGnedWcgOs+YWeHyr0lAmpn7q3JEfxc1p6nGJj6n2lPK5gw3XAsuv6yyzfrOP0lJpcLYSDjmY/36RPu1eW6cmt8J6WzqjGGQH8BFdeoHMxpDIK/3qnNilxgRIMAOYJ77F++ZfOomh9OSO4NElY1jqRR9X9vmfzS1fdGbM2G3eDa694XgtqBmDagcY7YK5ywGCtz2Mlmaq8+1UR5pE0Px25UZkDEbxUPM6/W6idpjQEF3nMpASx0KTMVacl8U2gC9n6keVJ5ubaPKsZpqUFN1c7ES3+t4YcJsMZSBUL74nA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=BhZMUxnec86VeOio+cPyEInk2vz06vp6Q2Jg4vfbMeA=; b=SXOTlPz/WiCu1DuOEHr7I7tM8yNoI/MQB+fuepo2h3uFU0MJZJkaKvEuEiTnjbeiPnp+yVQffCxtDzXtnbcIK121r8tJSaZNEkUOGZfdYn2d5/TIWc60O2MUPWqDKO8imS887GFcW/YvqjALRG8XD4HJlSu+z9yBiOBRuTf6r4DeLXXKD8WvYkTcpMsZ1klp1MGwBVwRB89gfiqUEnoUDlNmNwG74e2MK3igqc0Er0cr0d5W39oVOxpXrHbxVoTrK1CTFDEpxl9gYI99ykmqn9R+ba+YdcAIFGsj2OuP1B59obiqhak7vYL/yaAnvsgCdsOhOIU8hJ9V3uMzIBG3Yw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu; dkim=pass header.d=cornell.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cornell.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=BhZMUxnec86VeOio+cPyEInk2vz06vp6Q2Jg4vfbMeA=; b=W8/RLp1cTu4cj8AorY/W+3UwtMHu2tzRtB70PNc92hbB0aYw6BcUiHVi/9m5pbAjlA+fbpQJ3aF6Jf68+l797HiLJeaM6r5r19H81b3igwnROgxibcfrAJ8sD4pyMW+Ti4dR6C3GZrlF8MwTHl8vKf6fTka73FNAVjDuOSsBPaY= Authentication-Results: cygwin.com; dkim=none (message not signed) header.d=none;cygwin.com; dmarc=none action=none header.from=cornell.edu; Received: from BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) by BN6PR04MB0901.namprd04.prod.outlook.com (2603:10b6:405:45::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.16; Mon, 13 Sep 2021 13:03:06 +0000 Received: from BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::5113:e84a:b38a:7a66]) by BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::5113:e84a:b38a:7a66%6]) with mapi id 15.20.4500.019; Mon, 13 Sep 2021 13:03:06 +0000 Subject: Re: cygrunsrv + sshd + rsync = 20 times too slow -- throttled? To: cygwin-developers@cygwin.com References: <33386baf-3b2d-d57f-2ad3-1bd328ed7935@cornell.edu> <20210911075734.aaf37697ba7db2ad14d911a3@nifty.ne.jp> <20210911113517.f74fc3ac1971bbf04c7a9bd1@nifty.ne.jp> <695ce1f4-4f7d-f3f3-6dd3-087467d67b28@cornell.edu> <20210912174849.3d38107568065a95aeb19c7c@nifty.ne.jp> <20210912200423.667e40eb1adc52461bbefa20@nifty.ne.jp> From: Ken Brown Message-ID: <8c5a6140-1082-f429-efe3-e968e3bc4dba@cornell.edu> Date: Mon, 13 Sep 2021 09:03:04 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH2PR04CA0026.namprd04.prod.outlook.com (2603:10b6:610:52::36) To BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) MIME-Version: 1.0 Received: from [192.168.1.211] (74.69.128.111) by CH2PR04CA0026.namprd04.prod.outlook.com (2603:10b6:610:52::36) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4500.14 via Frontend Transport; Mon, 13 Sep 2021 13:03:06 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: b028b8c9-044f-42c3-1f7a-08d976b6d401 X-MS-TrafficTypeDiagnostic: BN6PR04MB0901: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:7691; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: xOK6tgR/fyQvNR0FOgx7IHNI4q7zUf1Ggzg/UnMsMZM1mEoDoYM8b54fyKRpfFndTlsA+sk5bOUQtZsedw1f7DcvY3+B6HChVmiY9BM7QzUbaLbvTgL4x0vuoGqg2nfYA80IF68r7vDvwOaX1NlEESA5dmtCU5X64SoCmtH+Zq0wJMJtQso8MTfLipxOra7W+3iPyfIVcT8msIGlg7oC4kbW5f9/0cgTNC8OVMMXOYlEHRJjiob/F4Xrvwa4WbqSZ+vcsjBr02UoqWASeo+dAcVEOU8trUlULA1CfqSl+P538w+1Z33CbPPPhvOVVDZbYFdNGYeU1fA57bBCIJ7TvRT1bTj7RdNk/XL49Zllr/oNo+jKqeTlFNrgQg2q+O0+kdxew59qnn1Wzp6qfL82O7OpXdJQgFCkD2NobRknqL6pkzE/99QsQ7z12Vo6R/DUokQMaFcS1GO7qOkkiTVU7py/eNFP+qv4E0SWQBViMWpSk26THAal6xm03H+Eoe5pvfLMbgxIT+8OrsqFY7Wh6RcfFEV1onYWydARIpYbCJ+8Cd8c1byj1BxJwGAhepdSpLR/WX7oTY7VmNHpA08Z8IqQ/sIw1jsP6hZrSO5k6MeIgbdPQE39kNB4vnRjCAFpxnVPNvsMnaM96sAXEsvBsyDGhZk1qyJeVmGQMA1OCcACWnv3fyaQEXwvGLS60skenOVFfuhkxu2yUGEutgYtM0v0TeIi3gnXnRbVMM5mYKrlz4mFawaQzR9MGKV0fPHo X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(136003)(376002)(346002)(396003)(39860400002)(6916009)(36756003)(478600001)(38100700002)(31696002)(316002)(5660300002)(31686004)(26005)(186003)(66946007)(53546011)(66556008)(66476007)(2906002)(6486002)(8676002)(2616005)(956004)(75432002)(8936002)(86362001)(16576012)(83380400001)(45980500001)(43740500002); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?Windows-1252?Q?YcCrxy1/ZFr0lDJl5KHX4t3m/sHwRAuSg2r0+o9ahKRFOHFXEBGFE4/v?= =?Windows-1252?Q?oEuHHrgAFv3owE5i9k9oPRMp1/LU41bKq1kyJzEKEWmADXfuzY7+hMwn?= =?Windows-1252?Q?GU7HENU0QZ+Fw7WzlHfLcxfAPI4hMJ3x5OTZF9bUzbViF5q29JmOG5dk?= =?Windows-1252?Q?9ofxNyfnINha4frT3PTSADh8Onk5JcIaL27YwBoHfJz1bD43G+wgWcq0?= =?Windows-1252?Q?ba5ibRdzFZaCYbmLYYbres42dVuzJwom6ZCrcFN3GrHI3hpcJe1Htfu4?= =?Windows-1252?Q?07JtbA/M6ImisSt3hVv3hmkex1Ej/C2MoITZZvcWC1kwIZWjTDXX552p?= =?Windows-1252?Q?lva7Upnh4SAMejmxIkgGUSDJoDMdT2iiNCMhl3vIGi5esh8621WMfNe3?= =?Windows-1252?Q?//BepJ4Xy78KcU4YVwd702JZLFUgB1YFRISdN//YxhbSK2rRlrr+korX?= =?Windows-1252?Q?G8y5yctg3RX8I5iSVaDvzZFecQ5Gi1h2C9COAYqehPiPbLLzF0JzkpPB?= =?Windows-1252?Q?vdCDjtJkODmGfkOTOroZnu6LZFd9Vwi0Jo79ZHtaCD+v1S+BSp9ZXVNm?= =?Windows-1252?Q?E1wujewNKP5VysvagjJaFO1+gAchB+xmeB0d7qSuNHPiGNb5peJ3s6Rt?= =?Windows-1252?Q?nQjMpqeG/Ud2LumEvIvS1LK/Tpiow1bwZ+60I8Ws1IvDg8U32eUEiBI9?= =?Windows-1252?Q?Ln4bP06m5WI1GaRozBSJAY4z10P/hMNSK0OzEPwHdYBFw7+vbMCGEyks?= =?Windows-1252?Q?o7dN6YczDksbVYbKNMrxF4YlkYGeccnGtonm8Afv0v98gdYbcPaGhA4u?= =?Windows-1252?Q?w2RQ/ekpRmwkOciAX9ImNY+ZL1bqMW5AKK3kLvf4pAVPbBcK+TZzeHok?= =?Windows-1252?Q?BNBQIoaGlq7UbkSPdQvKj+P/Y7rC+jvy8isv1e7R+wyLSd4zhWPDn1iK?= =?Windows-1252?Q?4/uLVVqrlqjsWKBP2rBUviSV0rL2qyE+zMeCi+CaRUgxzFOTEdnrMp0j?= =?Windows-1252?Q?pER6Jsnt6EJoDq+4HBWhcUG41b0p+S4dWqCANq8afbDTBaEOPX9Fqj+3?= =?Windows-1252?Q?XL6wdn9ghAxwB5YMvtkNfoBofnvkLjbJErRH4Sn7/Iqwo9y/qbJh+fEg?= =?Windows-1252?Q?29WvwKqIrvMGl3ekxPrqXl8Q4NAipeWlLmFiEPk3Mozl4XAtCy9KpyUv?= =?Windows-1252?Q?2r07gSX1hjBPJrRCOy2l6H26QMZaRDTP4s7eOC2RqAJmBZ2gprneOpB+?= =?Windows-1252?Q?UHgBJNDzY5e7PLKEdW+9C1Z8668RlzEN7Q1de7uLZQk0xaaZ9RdjeYy5?= =?Windows-1252?Q?qK9Jjf5fV4V/CM1aEiOz2nKT7bLRwWkw2txmV8wEHzWJSMk8MH6FdTCF?= =?Windows-1252?Q?y8ozZRDdHaq6JJ6AgMPST9reRlAVBPDA2cxs5LBL+54JzZOlD5hO4F1K?= X-OriginatorOrg: cornell.edu X-MS-Exchange-CrossTenant-Network-Message-Id: b028b8c9-044f-42c3-1f7a-08d976b6d401 X-MS-Exchange-CrossTenant-AuthSource: BN7PR04MB4388.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Sep 2021 13:03:06.4163 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5d7e4366-1b9b-45cf-8e79-b14b27df46e1 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: dvCSGKHI3MzlG5/R4MAiCIopsNfyyZKYPb6I4EyLxQINBjd7IySvbgANuDFfW+Mc/TDvtIwvPSZ/X7R4LEIz4w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR04MB0901 X-Spam-Status: No, score=-4.7 required=5.0 tests=BAYES_00, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, MSGID_FROM_MTA_HEADER, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on server2.sourceware.org X-BeenThere: cygwin-developers@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin core component developers mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Sep 2021 13:03:09 -0000 On 9/13/2021 5:42 AM, Corinna Vinschen wrote: > On Sep 12 17:46, Ken Brown wrote: >> BTW, we could just decide that always reporting write ready in this corner >> case is acceptable. But then we could just do that without going back to >> query_hdl. > > The problem with the corner case is, how to find out? You could have > arbitrarily complex process trees with the pipe inherited by grand > children, one of which is a non-Cygwin process. How does a Cygwin > process tree member learn about that fact, if it didn't start the > non-Cygwin process by itself? > > Looks like we have three choices: > > - Reintroducing query_hdl as in Takashi's patch. > > - select timeouts > > - always return "pipe writable" > > I think we might try Takashi's idea for as start, no? That sounds good to me, provided he can fix the "cnc" case I just asked him about -- Cygwin reader and writer on a pipe created by a non-Cygwin process. > Didn't we also have a problem with C# in terms of non-blocking pipes? > I wonder if we could just do the following: As soon as we spawn a > non-Cygwin process, just call set_pipe_non_blocking(false) for all > pipes. Blocking vs. nonblocking mode is a per-handle thingy anyway. > > What do you think? I don't remember exactly what the issue was with C# programs, so I'll defer to Takashi on this. Ken