From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 96045 invoked by alias); 13 Feb 2016 12:15:17 -0000 Mailing-List: contact cygwin-help@cygwin.com; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: cygwin-owner@cygwin.com Mail-Followup-To: cygwin@cygwin.com Received: (qmail 96037 invoked by uid 89); 13 Feb 2016 12:15:16 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-0.4 required=5.0 tests=AWL,BAYES_50,RP_MATCHES_RCVD autolearn=ham version=3.3.2 spammy=H*F:U*cygwin, 1.4, Pictures, Hx-languages-length:3304 X-HELO: Ishtar.sc.tlinx.org Received: from ishtar.tlinx.org (HELO Ishtar.sc.tlinx.org) (173.164.175.65) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with (AES256-GCM-SHA384 encrypted) ESMTPS; Sat, 13 Feb 2016 12:15:15 +0000 Received: from [192.168.3.12] (Athenae [192.168.3.12]) by Ishtar.sc.tlinx.org (8.14.7/8.14.4/SuSE Linux 0.8) with ESMTP id u1DCF9M6063256 for ; Sat, 13 Feb 2016 04:15:12 -0800 Message-ID: <56BF1E4D.5000901@tlinx.org> Date: Sat, 13 Feb 2016 12:15:00 -0000 From: Linda Walsh User-Agent: Thunderbird MIME-Version: 1.0 To: cygwin@cygwin.com Subject: Re: locate and updatedb References: <56BC940F.6070109@zoho.com> <56BCD05C.2040409@gmail.com> <56BCD414.2010304@zoho.com> <56BD0D87.6030008@gmail.com> In-Reply-To: <56BD0D87.6030008@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-IsSubscribed: yes X-SW-Source: 2016-02/txt/msg00187.txt.bz2 Marco Atzeri wrote: > On 11/02/2016 19:33, Byron Boulton wrote: >> On 2/11/2016 1:18 PM, cyg Simple wrote: >>> On 2/11/2016 9:00 AM, Byron Boulton wrote: >>>> Does anyone here have success using `updatedb` and `locate` in >>>> cygwin? I >>>> use `locate` heavily on my Linux machines, but everytime I've tried to >>>> run `updatedb` on cygwin I've given up and killed the process >>>> because it >>>> is taking too long. --- There's a reason why on linux it is usually set to run when you are asleep. ;-) >>>> Is there something wrong with cygwin's >>>> implementation of `updatedb` making it not work at all or making it >>>> slower that on my Linux machines? Or are there others who have success >>>> using it on cygwin? But it might have to do with disk speed and memory. Laptop drives are usually among the slowest. I ran it just now (this is with MS's Home Essentials real-time protection turned on). law.Bliss/bin> time index_files.sh 670592 (process ID) old priority 0, new priority 19 44.21sec 15.06usr 28.30sys (98.09% cpu) > locate / >/tmp/all > wc /tmp/all 1479146 4014375 133322318 /tmp/all > df . Filesystem Size Used Avail Use% Mounted on C: 949G 585G 365G 62% / ---- So ~1.4 million files... Using the following exclusions: ---(index_files.sh)---- renice +19 $$ Local="/" if [[ -d /windows/sysnative/. ]]; then Local+=" /windows/sysnative/." fi Prunepaths='/.usr /proc /C /B /H /I /M /D /P /System[[:space:]]Volume[[:space:]]Information /Windows/CSC /pagefile.sys /Music /Pictures /Share /Media /home /Doc /$RECYCLE.BIN /cygdrive' /bin/updatedb --findoptions=-noleaf --localpaths="$Local" --prunepaths="$Prunepaths" --netpaths="$Net" ---- Most of those pruned files are pruned either due to redundancy or being on a local network server... That's fairly fast vs. the MS-Home Essentials, full malware scan I run once a week that takes ~ 8-16 hours (It scans a few of my network directories,as well). >>> >>> Processing every file on the drive will be slow just because it's >>> Windows. Initializing the database with updatedb will require a large >>> amount of time. There are processes such as AntiVirus intrusion >>> protection that might make it even slower. >>> >> Hmmm, the reason the slowness is particuarly strange to me is that in >> place of using `locate` from my cygwin terminal, I have to use a program >> called "Everything Search Engine" available at www.voidtools.com. The >> first time I install it, it takes maybe a few minutes to index the hard >> drive, then every once in a while when I open the program it takes a few >> seconds to update the index, but in general the performance for indexing >> and searching the index if comparable to `updatedb` and `locate` on a >> Linux machine, so it's possible to do on Windows. >> >> Byron >> > > the time taken from updatedb is mainly due to > the execution time of "find" on the disks. > > It takes ~ 70 minutes for my 500 GB of data, > and likely the AV is impacting the execution. > > I suspect voidtools is using MS disk indexing > to speed up the things for it. > > > Regards > Marco > > > > > -- > Problem reports: http://cygwin.com/problems.html > FAQ: http://cygwin.com/faq/ > Documentation: http://cygwin.com/docs.html > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > -- Problem reports: http://cygwin.com/problems.html FAQ: http://cygwin.com/faq/ Documentation: http://cygwin.com/docs.html Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple