* [Bug debuginfod/27918] New: add control file for triggered traversal @ 2021-05-26 20:13 fche at redhat dot com 2021-06-08 14:12 ` [Bug debuginfod/27918] " dichen at redhat dot com ` (3 more replies) 0 siblings, 4 replies; 5+ messages in thread From: fche at redhat dot com @ 2021-05-26 20:13 UTC (permalink / raw) To: elfutils-devel https://sourceware.org/bugzilla/show_bug.cgi?id=27918 Bug ID: 27918 Summary: add control file for triggered traversal Product: elfutils Version: unspecified Status: NEW Severity: normal Priority: P2 Component: debuginfod Assignee: unassigned at sourceware dot org Reporter: fche at redhat dot com CC: elfutils-devel at sourceware dot org Target Milestone: --- On a large debuginfod installation, where a full traversal might take hours but things hardly ever change, it would help to focus debuginfod's traversal to directories known to have changed. For example, an external monitor of a build system could notify us that a new build XYZ exists, and map that to a likely subdirectory. More specifically, let debuginfod be run with a --traversal-trigger=FILENAME option. In the traversal thread that normally sleeps quite a while, let it check for the existence & nonemptiness of this file. If it exists & has content, the traversal thread should immediately begin a traversal/scan process for the named directories, as though they were given on command line, probably into some sibling vector to source_paths[]. Then it should truncate the file (if is still unmodified from the beginning of the read operation - so as to avoid losing data on a race). If a traversal is already in progress, so the traversal thread is sitting inside scan_source_paths()'s fts loop, there probably isn't a super simple way of suspending that search, focusing on the new directories, then resuming ... so probably not worth accelerating this case. We could let the fts finish, and then let the thread process the trigger file back out there. An external program could "echo /path/ >> FILENAME" whenever, and debuginfod should have that content scanned rapidly. With that in place, such sites might choose a very long -tNNN time for thorough full traversals. -- You are receiving this mail because: You are on the CC list for the bug. ^ permalink raw reply [flat|nested] 5+ messages in thread
* [Bug debuginfod/27918] add control file for triggered traversal 2021-05-26 20:13 [Bug debuginfod/27918] New: add control file for triggered traversal fche at redhat dot com @ 2021-06-08 14:12 ` dichen at redhat dot com 2021-06-08 14:13 ` dichen at redhat dot com ` (2 subsequent siblings) 3 siblings, 0 replies; 5+ messages in thread From: dichen at redhat dot com @ 2021-06-08 14:12 UTC (permalink / raw) To: elfutils-devel https://sourceware.org/bugzilla/show_bug.cgi?id=27918 Di Chen <dichen at redhat dot com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dichen at redhat dot com Assignee|unassigned at sourceware dot org |dichen at redhat dot com -- You are receiving this mail because: You are on the CC list for the bug. ^ permalink raw reply [flat|nested] 5+ messages in thread
* [Bug debuginfod/27918] add control file for triggered traversal 2021-05-26 20:13 [Bug debuginfod/27918] New: add control file for triggered traversal fche at redhat dot com 2021-06-08 14:12 ` [Bug debuginfod/27918] " dichen at redhat dot com @ 2021-06-08 14:13 ` dichen at redhat dot com 2022-07-14 16:30 ` nsanci at redhat dot com 2022-07-14 16:30 ` nsanci at redhat dot com 3 siblings, 0 replies; 5+ messages in thread From: dichen at redhat dot com @ 2021-06-08 14:13 UTC (permalink / raw) To: elfutils-devel https://sourceware.org/bugzilla/show_bug.cgi?id=27918 Di Chen <dichen at redhat dot com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|dichen at redhat dot com |unassigned at sourceware dot org -- You are receiving this mail because: You are on the CC list for the bug. ^ permalink raw reply [flat|nested] 5+ messages in thread
* [Bug debuginfod/27918] add control file for triggered traversal 2021-05-26 20:13 [Bug debuginfod/27918] New: add control file for triggered traversal fche at redhat dot com 2021-06-08 14:12 ` [Bug debuginfod/27918] " dichen at redhat dot com 2021-06-08 14:13 ` dichen at redhat dot com @ 2022-07-14 16:30 ` nsanci at redhat dot com 2022-07-14 16:30 ` nsanci at redhat dot com 3 siblings, 0 replies; 5+ messages in thread From: nsanci at redhat dot com @ 2022-07-14 16:30 UTC (permalink / raw) To: elfutils-devel https://sourceware.org/bugzilla/show_bug.cgi?id=27918 Noah Sanci <nsanci at redhat dot com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nsanci at redhat dot com Assignee|unassigned at sourceware dot org |nsanci at redhat dot com -- You are receiving this mail because: You are on the CC list for the bug. ^ permalink raw reply [flat|nested] 5+ messages in thread
* [Bug debuginfod/27918] add control file for triggered traversal 2021-05-26 20:13 [Bug debuginfod/27918] New: add control file for triggered traversal fche at redhat dot com ` (2 preceding siblings ...) 2022-07-14 16:30 ` nsanci at redhat dot com @ 2022-07-14 16:30 ` nsanci at redhat dot com 3 siblings, 0 replies; 5+ messages in thread From: nsanci at redhat dot com @ 2022-07-14 16:30 UTC (permalink / raw) To: elfutils-devel https://sourceware.org/bugzilla/show_bug.cgi?id=27918 Noah Sanci <nsanci at redhat dot com> changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|nsanci at redhat dot com |unassigned at sourceware dot org -- You are receiving this mail because: You are on the CC list for the bug. ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2022-07-14 16:30 UTC | newest] Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2021-05-26 20:13 [Bug debuginfod/27918] New: add control file for triggered traversal fche at redhat dot com 2021-06-08 14:12 ` [Bug debuginfod/27918] " dichen at redhat dot com 2021-06-08 14:13 ` dichen at redhat dot com 2022-07-14 16:30 ` nsanci at redhat dot com 2022-07-14 16:30 ` nsanci at redhat dot com
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).