From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by sourceware.org (Postfix, from userid 48) id 18F8D385803B; Wed, 26 May 2021 20:13:56 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 18F8D385803B From: "fche at redhat dot com" To: elfutils-devel@sourceware.org Subject: [Bug debuginfod/27918] New: add control file for triggered traversal Date: Wed, 26 May 2021 20:13:55 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: elfutils X-Bugzilla-Component: debuginfod X-Bugzilla-Version: unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: fche at redhat dot com X-Bugzilla-Status: NEW X-Bugzilla-Resolution: X-Bugzilla-Priority: P2 X-Bugzilla-Assigned-To: unassigned at sourceware dot org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status bug_severity priority component assigned_to reporter cc target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://sourceware.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: elfutils-devel@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Elfutils-devel mailing list List-Unsubscribe: , List-Archive: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 May 2021 20:13:56 -0000 https://sourceware.org/bugzilla/show_bug.cgi?id=3D27918 Bug ID: 27918 Summary: add control file for triggered traversal Product: elfutils Version: unspecified Status: NEW Severity: normal Priority: P2 Component: debuginfod Assignee: unassigned at sourceware dot org Reporter: fche at redhat dot com CC: elfutils-devel at sourceware dot org Target Milestone: --- On a large debuginfod installation, where a full traversal might take hours= but things hardly ever change, it would help to focus debuginfod's traversal to directories known to have changed. For example, an external monitor of a b= uild system could notify us that a new build XYZ exists, and map that to a likely subdirectory. More specifically, let debuginfod be run with a --traversal-trigger=3DFILEN= AME option. In the traversal thread that normally sleeps quite a while, let it check for the existence & nonemptiness of this file. If it exists & has content, the traversal thread should immediately begin a traversal/scan pro= cess for the named directories, as though they were given on command line, proba= bly into some sibling vector to source_paths[]. Then it should truncate the fi= le (if is still unmodified from the beginning of the read operation - so as to avoid losing data on a race). If a traversal is already in progress, so the traversal thread is sitting inside scan_source_paths()'s fts loop, there probably isn't a super simple = way of suspending that search, focusing on the new directories, then resuming .= .. so probably not worth accelerating this case. We could let the fts finish,= and then let the thread process the trigger file back out there. An external program could "echo /path/ >> FILENAME" whenever, and debugin= fod should have that content scanned rapidly. With that in place, such sites m= ight choose a very long -tNNN time for thorough full traversals. --=20 You are receiving this mail because: You are on the CC list for the bug.=