From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2102.outbound.protection.outlook.com [40.107.223.102]) by sourceware.org (Postfix) with ESMTPS id 81774385481A for ; Wed, 17 Mar 2021 15:47:13 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 81774385481A ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=dQnHYzZnHdoFvrjjXS2a1dPzuw6rgE6S3HbWF9MEhoD0k1qCsvQlXx8I42q5X7IiiM9Qu+21UDCCSk7w1pE/H8ZSDzPhtqO2NOZU7Z/ZlDXeQY+6NISPIGHSIYPVPRLOQzx7eYbR/3etUJtsn2/GCWca7Xk9y3TFM+VIMzZjLiMBYac09g8AmuqU0Dy7ewoQflPqDJ5lAkMgvuZZqC+04vBmUNpdfJnpH+19ufAobnMuMklP5FSZ7BE8hu5vhYbm6mkaqsEtNFpx9Iyw3trJ8IEffAUWfBZkRs8e4ljHiNSNUFEmHJTyLFotU7x3jbiN2qW8f/WKzA2rmLlFcsFpbw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IcMeFE1doehwDx7gelmTkyZEvipoZ6OyBV3iOFXSiXY=; b=PF8G/kkYKOH+vTYycryB9/2oqATwcEKZAGQoKryUhE/XAs+Posvs0jsHEWwtQzbqtRNdhin1QIAsM9iZPKJf5mAar5nAY2mzAZTRfYHmhbGvRncgLFq6HCDSYaT9E/GH1lh87UmVO1m7lpfxwTOAb4dLaCeLPS9WBN/Ix0eLB+OaQjfXDuPPx3VVGuZNwtKZHNlHNP02T0ReosvWg4UPIbepPNoqS7uIUHcp3O06MMBumiqE/TXKDYHVxeRP8oW1aJdygYWWf2gsEN+2aFw30YiJs2UPRs2NbnKQeSYyAU4fuY7ysni3EC6WDL3lMm0CdLMokz2K/kEQ1ORtRJbjHw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cornell.edu; dmarc=pass action=none header.from=cornell.edu; dkim=pass header.d=cornell.edu; arc=none Received: from BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) by BN6PR04MB0707.namprd04.prod.outlook.com (2603:10b6:404:d2::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3933.32; Wed, 17 Mar 2021 15:47:12 +0000 Received: from BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::59f8:fcc4:f07e:9a89]) by BN7PR04MB4388.namprd04.prod.outlook.com ([fe80::59f8:fcc4:f07e:9a89%4]) with mapi id 15.20.3933.033; Wed, 17 Mar 2021 15:47:12 +0000 Subject: Re: Sv: Sv: Problems with native Unix domain sockets on Win 10/2019 To: sten.kristian.ivarsson@gmail.com, cygwin@cygwin.com References: <97d2b3af-224a-6873-fb4a-55a0ae9cd379@cornell.edu> <3e3cfe17-7fda-b063-4885-9114db9e748d@cornell.edu> <70b5577f-2cf1-0110-5d3b-cb2bd8ee6df2@cornell.edu> <69ad720c-8ea6-d3bb-b0a5-5556c4550091@oracle.com> <2d85550f-d753-4055-8b93-35e5287a9a93@oracle.com> <8ad29a66-fb4c-a587-eed3-eaa7e0389a77@cornell.edu> <20210201151056.GQ375565@calimero.vinschen.de> <7fb70a75-8557-6c95-27fa-697c92dcedce@cornell.edu> <000201d71a54$638c67c0$2aa53740$@gmail.com> <0cc7931c-6c07-755d-2d0c-1b62189fddd9@cornell.edu> <000501d71b2b$a1a5f2b0$e4f1d810$@gmail.com> From: Ken Brown Message-ID: <123280f6-cb2c-c55f-71c7-51fa5f54a94e@cornell.edu> Date: Wed, 17 Mar 2021 11:47:10 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.8.1 In-Reply-To: <000501d71b2b$a1a5f2b0$e4f1d810$@gmail.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Originating-IP: [2603:7081:7e41:6a00:959:c744:3f33:791b] X-ClientProxiedBy: BL0PR0102CA0064.prod.exchangelabs.com (2603:10b6:208:25::41) To BN7PR04MB4388.namprd04.prod.outlook.com (2603:10b6:406:f8::19) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [IPv6:2603:7081:7e41:6a00:959:c744:3f33:791b] (2603:7081:7e41:6a00:959:c744:3f33:791b) by BL0PR0102CA0064.prod.exchangelabs.com (2603:10b6:208:25::41) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3955.18 via Frontend Transport; Wed, 17 Mar 2021 15:47:11 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 43460305-dcb5-4e56-26b8-08d8e95bee0b X-MS-TrafficTypeDiagnostic: BN6PR04MB0707: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: cl8Ipwb76J92om4FM9MC3clvCurlj4w94Q71/I80PJxucJCyguBlwLOGFt1Uk+p0sAQDse5Or+8V8MUiWGpqJjzujo9pH/CV0JW/N+DulaFSCgLNs87sSL4NPrOpcyrBpgjfOCw19O5chN9MWpMEtfKHgwVB8NUpSvQ/d6eYzU/6I9ZS6vpYqYwZ6ESKcUVDXswxbI+vN8VxPVJPppmX8enuV/kdOPOgIbEyWjDGGkLC522kmbPSX3anxmq4NpclMCtL4TOBHZ/Poag1kYQPag7yxZ+oUcYODcpArdIgz0czVsz4DM0z4ErS9qGensqNROHkOLHH/A8hwDne7D+1dVHX3VxmlbnXr7zKI5PiqD7ipDCHqgSbLP+xmoT6o8yiZAPh1b/wdLfDkc3U3fwa02t33ibJdRtuPyihEDmO0C8HMLvv9VwEjEFMDPBUWGfpfYpgBf2BjPb8p+nbZaaqkHGzzX1oZtkY+NJfbDDcfAZQCZNh+R5CSHnLHjXKvT2C1v7kSoDZzUfR0Op5dgd/3ioC+f6WjbV6gTVGNFu7DBH9rgN22bVnakj/mEbuNrWdrKkZfzk2281eEM7BdNV9X3X0EEEdz+SO4JHcY99/t6BSs57hogr8Ux0qOPTJWFwI X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BN7PR04MB4388.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(136003)(346002)(376002)(39860400002)(396003)(366004)(16526019)(66556008)(6486002)(36756003)(186003)(66476007)(31696002)(53546011)(86362001)(8936002)(2616005)(2906002)(316002)(52116002)(75432002)(786003)(8676002)(83380400001)(31686004)(66946007)(5660300002)(478600001)(43740500002); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData: =?Windows-1252?Q?0pMfSlmpAHzARypFmDXikKAiP+nxaZvDSw/NouwCQYK+cxmzM6O8FvEf?= =?Windows-1252?Q?SeDLCzmPumpCU//lfmKPTDGxNamlm8VNsKo3TyP+ipQDC9M4JqkBHh7h?= =?Windows-1252?Q?adb/vjKOLeO7bjqxOhDafQ+lT3EMpDJ7hrQJ0Z0t2o8cZq7SY0dKR+55?= =?Windows-1252?Q?XvnxTu569EsetCQ6Wc7Iz6jn5PPBt43lPUqDnwbWZOw/cYCX2+dhZJv/?= =?Windows-1252?Q?qNXODLyWqeNBxkH7jB7FVbdndXkotwGc28GHG8wuvBBIoEkxX8in4wVo?= =?Windows-1252?Q?AGPjyYr7LTjH7+fuNCHNVXJum3wWVKPNr9DGLlvbEIY8SqUhSlmKwr0V?= =?Windows-1252?Q?3dhaYXqK5sl8itd1Z86Iny0gSKFsRHzUVCRYfCQ2g/ONykLznm7qE7cc?= =?Windows-1252?Q?FOeZYbVbrnAWxFeuc+wEcMmfYfxy0pfxr7Tj4x/OzCkwXywpsJLFNTeh?= =?Windows-1252?Q?vQxURukz4Gtz9Oz1x91pBJI0lz67aTXHUvojamyuGehtVnlA8QSeI8PQ?= =?Windows-1252?Q?J8du7ZaAaRxKIGInt1eImGhrrGRWdCpEr315zxpOVJbftKt/FZ78rnv5?= =?Windows-1252?Q?Q7N8MuqwlH+fpN9AGnka2bueSNqgfm2aqCC4/JdXIW7HvBsf4eFPxIR4?= =?Windows-1252?Q?49FnZweFt1CpcemVOysFxIQ4pQ+1jQnBOUrFZiTak+5pGy6c/B2jEFPq?= =?Windows-1252?Q?+JpaqVTC0xX8858x+Li6lieh/dLUJBtiaB1WORmUpBVvvwBFCIIKnHRP?= =?Windows-1252?Q?2dGiw8P/qcUR8f+P/oJKT4gYshdVyu9XpEu6//L4wLA4Cp8gugEO7ZvB?= =?Windows-1252?Q?T0lqZ3d46l0AD2gN8KgPKYda7nYBQ4CnYvcswu7XGfTReSJ6Zi52M4k4?= =?Windows-1252?Q?43nieYmGJRB3c+9BoGtcSIKEGnqqADxkEDqUd+TJ0bn2CPQ6SESgX52q?= =?Windows-1252?Q?OmRMwYnDC4Zeor/GPZ8BC0XvOzZNydrry5fjwdZJ1XYek9D6XSOiSOOB?= =?Windows-1252?Q?e1zqFWdxn/SR+B36KQp9kxV+RCu6/QQo2eVRdmF7zl+D765JvY5wVdSH?= =?Windows-1252?Q?a4MIT01WZggWveyHrSxiSpzDF9b2Cu6RFXA1vRhA0RhOL9pt2F9Hl14R?= =?Windows-1252?Q?v0sQKzN1fdPD3GRDjUaFaxPezwF02s28WWm7JZtFj6fJ4U/3hxbx0mco?= =?Windows-1252?Q?xviV3s6b3VBEJl+5pr3tdWGT83RJwbexBMHAIbUGN6noGV44INSKEhm5?= =?Windows-1252?Q?yBN4m3mT67mDsty+sHiBYDVDUvtmWrIBs0hKNBSbhYbVMB7UygEEyI/z?= =?Windows-1252?Q?n2XoVEOZtI/hoCvn1TAltmCh6RJkeitDmFyPSbZZF1IC8nWBoRqB99CT?= =?Windows-1252?Q?KLfSnVyrUEjMzTXWVUwcwUc3gvNjDKH3fxV4rr3x2GOo9QeMZNw2SMSA?= =?Windows-1252?Q?fKAeq8yIg4c4BGgWStiEttUYIeSnAk2DORDCn5/n4SS1/Qc/8y+/qdhJ?= =?Windows-1252?Q?H33lNG6M?= X-OriginatorOrg: cornell.edu X-MS-Exchange-CrossTenant-Network-Message-Id: 43460305-dcb5-4e56-26b8-08d8e95bee0b X-MS-Exchange-CrossTenant-AuthSource: BN7PR04MB4388.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Mar 2021 15:47:11.9917 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5d7e4366-1b9b-45cf-8e79-b14b27df46e1 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: zYA1fMolfhXKUnbdWm0a3mpTmw+eWVHf6NeP67heN7JCRDkv6DkLiKpFTigxoEhxjihzHrB45XkoS/li1oZaUQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR04MB0707 X-Spam-Status: No, score=0.1 required=5.0 tests=BAYES_00, DKIM_INVALID, DKIM_SIGNED, JMQ_SPF_NEUTRAL, KAM_DMARC_STATUS, MSGID_FROM_MTA_HEADER, NICE_REPLY_A, RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2, SPF_HELO_PASS, SPF_PASS, TXREP autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: cygwin@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: General Cygwin discussions and problem reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Mar 2021 15:47:16 -0000 On 3/17/2021 8:47 AM, sten.kristian.ivarsson@gmail.com wrote: > [Snip] >>>> Hi all >>>> >>>> Does anyone know the status of these fixes ? >>>> >>>> I saw an announcement for cygwin-3.2.0-0.1 that seemed to contain >>>> some AF_UNIX-related fixes but I fail to find out where that >>>> distribution exists (if it is supposed to be publicly accessible?), >>>> but I tried out the >>>> 2021-03-01 snapshot and perhaps they are similar ? >> >> You can install cygwin-3.2.0-0.1 in the usual way, through Cygwin's setup >> program. Since it's a test release, you'll have to explicitly select that >> release; setup won't just offer it to you. > > Ahh thanks, it took a while before I noticed that Text-checkbox ;-) > > See more below > >>>> We bumped into some AF_UNIX-related issues when trying the 2021-03-01 >>>> -snapshot though. It might be some flaws in our code base but the >>>> same code works in quite a few Linux-distros >>>> >>>> We're more than willing to help out with testing this and/or trying >>>> to narrow down any possible cygwin issues, but first we'd be glad if >>>> someone could give us some kind of status report of this (so no one >>>> is doing any unnecessary work) >>>> >>>> >>>> Best regards, >>>> Kristian >>>> >>>> p.s. >>>>     I tried to build the topic/af_unix -branch according to the FAQ, >>>> but there was some issues >> >> I'm still in the middle of some things on that branch, and I haven't had >> much time to work on it recently. I hope to get back to it very soon. In >> order to build it, you need to add -D__WITH_AF_UNIX to CXXFLAGS. > > Is this when building newlib-cygwin ? It's for building the topic/af_unix branch of the newlib-cygwin repo. If you try to build the master branch with that flag, it should still build, but the resulting DLL will be missing a lot of the AF_UNIX functionality. > I discovered now that I had wrong > MinGW installed and apparently other things are missing as well > > See more below > >> In order to test it, you need >> >> #undef AF_UNIX >> #define AF_UNIX 31 >> >> after including >> >> Ken > > > The issues we're experiencing is that messages are lost during heavy load. > We essentially do have one thread writing a bunch of messages with a fixed > buffer chunk size and one thread consuming and sometimes messages disappear > or at least end up in the wrong order. When playing around with the size of > the buffer (we sometimes get -1 but no errno) from write and/or receive > > Another observation is that for smaller number of, it is faster than named > pipes but the more messages that are written/consumed the performance > derogates a in the end throughput is getting exponentially slower > > Hopefully, this is a defect in our code base, but I will try to narrow it > down with and try to reproduce the behaviour and I will then possibly make > another issue at this mailing list A reproducible test case would be good. Thanks. Ken