From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from m0.truegem.net (m0.truegem.net [69.55.228.47]) by sourceware.org (Postfix) with ESMTPS id 3D6FC3857C75 for ; Sun, 11 Apr 2021 09:28:39 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.3.2 sourceware.org 3D6FC3857C75 Authentication-Results: sourceware.org; dmarc=none (p=none dis=none) header.from=maxrnd.com Authentication-Results: sourceware.org; spf=none smtp.mailfrom=mark@maxrnd.com Received: (from daemon@localhost) by m0.truegem.net (8.12.11/8.12.11) id 13B9SbvM075427 for ; Sun, 11 Apr 2021 02:28:37 -0700 (PDT) (envelope-from mark@maxrnd.com) Received: from 162-235-43-67.lightspeed.irvnca.sbcglobal.net(162.235.43.67), claiming to be "[192.168.1.100]" via SMTP by m0.truegem.net, id smtpdBFSzlJ; Sun Apr 11 02:28:28 2021 Subject: Re: Maybe consider rpmalloc To: cygwin-developers@cygwin.com References: <067987e2-e958-b56c-efea-25d827568453@maxrnd.com> <6f68b10b-7fe5-4378-afb9-9001de084edf@maxrnd.com> From: Mark Geisert Message-ID: <3adb36f3-8740-3ff7-5f8a-90cdf3dfb64d@maxrnd.com> Date: Sun, 11 Apr 2021 02:28:28 -0700 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.4 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-4.1 required=5.0 tests=BAYES_00, KAM_DMARC_STATUS, KAM_LAZY_DOMAIN_SECURITY, NICE_REPLY_A, SPF_HELO_NONE, SPF_NONE, TXREP autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on server2.sourceware.org X-BeenThere: cygwin-developers@cygwin.com X-Mailman-Version: 2.1.29 Precedence: list List-Id: Cygwin core component developers mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Apr 2021 09:28:44 -0000 Hi Teemu, Teemu Nätkinniemi via Cygwin-developers wrote: > Sorry, hurt my back yesterday and looks like I am not thinking clearly. Hope you are feeling better by this time. > ./bwa mem -t 10 bwa_reference/hs37d5.fa ERS4238880_1.fastq > test1.sam Thanks. It was my unfamiliarity with Google Drive which prevented my finding all the data files you had stored there. After a while I did find all I needed. I rebuilt bwa.exe alternately using the provided Makefile and Makefile.cygwin. When building with the latter I made sure your #ifdef patches were enabled so that rpmalloc was pulled in for the build. When building with the former I made sure your patches were disabled, so the Cygwin malloc would be used for this case. I had no difficulty running either version of bwa to completion. On one smallish test machine the rpmalloc version finished in a bit less elapsed time but with the same CPU time as the Cygwin malloc version. I also ran on a larger system; here both versions ran with similar elapsed and CPU times. I also ran the Cygwin malloc version with '-t 32' to add some stress but still your test case ran to successful completion. So I'm afraid I can't explain the results you were seeing. Is it possible that you might have given up too soon running the Cygwin malloc version, thinking you should be seeing output as quickly as you would on Linux? You won't, unfortunately. You might try backing out your changes, or I think, building again on your main branch, to see if waiting longer proves successful. If you have any other suggestions, please let us know. Thanks & Regards, ..mark P.S. Here's Cygwin malloc version's output from my smallish system (i5, 2.3GHz, 2C/4T)... ./bwa mem -t 10 bwa_reference/hs37d5.fa /tmp/ERS4238880_1.fastq > test1.sam [M::bwa_idx_load_from_disk] read 0 ALT contigs [M::process] read 1712342 sequences (100000087 bp)... [M::process] read 1103688 sequences (64503600 bp)... [M::mem_process_seqs] Processed 1712342 reads in 2157.077 CPU sec, 2214.871 real sec [M::mem_process_seqs] Processed 1103688 reads in 1541.766 CPU sec, 1591.704 real sec [main] Version: 0.7.17-r1198-dirty [main] CMD: ./bwa mem -t 10 bwa_reference/hs37d5.fa /tmp/ERS4238880_1.fastq [main] Real time: 3831.624 sec; CPU: 3713.937 sec