From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from gnu.wildebeest.org (gnu.wildebeest.org [45.83.234.184]) by sourceware.org (Postfix) with ESMTPS id D7DD43858C2F for ; Mon, 15 Aug 2022 13:00:11 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org D7DD43858C2F Received: from reform (unknown [178.224.72.45]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gnu.wildebeest.org (Postfix) with ESMTPSA id 34227300070C; Mon, 15 Aug 2022 15:00:10 +0200 (CEST) Received: by reform (Postfix, from userid 1000) id 8668A2E801C1; Mon, 15 Aug 2022 15:00:08 +0200 (CEST) Date: Mon, 15 Aug 2022 15:00:08 +0200 From: Mark Wielaard To: Overseers mailing list Cc: Simon Marchi Subject: Re: inbox.sourceware.org experiment Message-ID: References: <20220813141403.GL5520@gnu.wildebeest.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="JB7VKtwEfrfwwlcp" Content-Disposition: inline In-Reply-To: <20220813141403.GL5520@gnu.wildebeest.org> X-Spam-Status: No, score=-1.5 required=5.0 tests=BAYES_50, JMQ_SPF_NEUTRAL, KAM_DMARC_STATUS, SPF_HELO_NONE, SPF_PASS, TXREP, T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org X-BeenThere: overseers@sourceware.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Overseers mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Aug 2022 13:00:14 -0000 --JB7VKtwEfrfwwlcp Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi, On Sat, Aug 13, 2022 at 04:14:03PM +0200, Mark Wielaard via Overseers wrote: > Looking at the mailman2inbox.sh script I have a few suggestions (I can > make them to the script myself, but don't know if you are currently > editing/running it): > > - public-inbox-init should probably use -V2 (see above). You can then > also use -j JOBS to speed up the import. > > - --indexlevel shuld be full to make the Xapian searching more useful > (this is the default, so you can also not set it). Note that this > also affects the incremental updating done by public-inbox-mda. > > - You want to kill public-inbox-httpd using -SIGHUP so it just reloads > the new config files. Yo also want to kill the other daemons, > public-inbox-imapd and public-inbox-nntpd > > - The --ng name should be based on the primary domain name (see > above). I don't know how to determine that easily though. Maybe > mailman knows, then we can also set the initial ADDRESS properly. And mailman does know, but you need to be in the mailman group to generate the lists. We support 3 virtual domains, sourceware.org, cygwin.com and gcc.gnu.org. Using /usr/lib/mailman/bin/list_lists we can generate lists per domain that only include advertised, public archived lists. There are 212 sourceware.org lists, 11 cygwin.com lists and 28 gcc.gnu.org lists. Attached is the output of: /usr/lib/mailman/bin/list_lists -b -a -p -V sourceware.org > sourceware.org.lists /usr/lib/mailman/bin/list_lists -b -a -p -V cygwin.com > cygwin.com.lists /usr/lib/mailman/bin/list_lists -b -a -p -V gcc.gnu.org > gcc.gnu.org.lists I placed the same in the inbox homedir under mailman.lists/ so it can be used as input to the import script. For sourceware.org lists @sourceware.cygnus.org and @sources.redhat.com should be alternate/historical names. For cygwin.com lists @cygwin.org should be an alternate name. Cheers, Mark --JB7VKtwEfrfwwlcp Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="sourceware.org.lists" anonymous archer archer-commits autobook-cvs autobook-webpages-cvs autoconf-cvs autoconf-webpages-cvs bfd binutils binutils-cvs binutils-webpages-cvs buildbot bunsen bzip2-cvs bzip2-devel bzip2-webpages-cvs c++-embedded c++-embedded-cvs c++-embedded-webpages-cvs catapult-cvs catapult-webpages-cvs cgen cgen-cvs cgen-prs cgen-webpages-cvs cluster-cvs cluster-webpages-cvs crossgcc debugedit dm-cvs dm-webpages-cvs docbook-tools-announce docbook-tools-cvs docbook-tools-discuss docbook-tools-hackers docbook-tools-webpages-cvs dominion-announce dominion-cvs dominion-discuss dominion-hackers dominion-webpages-cvs dwz eclipse ecos-announce ecos-bugs ecos-cvs ecos-devel ecos-discuss ecos-maintainers ecos-patches ecos-webpages-cvs elfutils-devel elix elix-announce elix-cvs elix-webpages-cvs frysk frysk-bugzilla frysk-cvs frysk-testresults frysk-webpages-cvs gas2 gdb gdb-announce gdb-cvs gdb-patches gdb-patches-prs gdb-prs gdb-testers gdb-testresults gdb-webpages-cvs gdbadmin gettext-alpha gettext-announce gettext-cvs gettext-webpages-cvs glibc-bugs glibc-bugs-regex glibc-cvs glibc-webpages-cvs global gnats-admin gnats-announce gnats-cvs gnats-devel gnats-prs gnats-webpages-cvs gnu-gabi gsl-announce gsl-cvs gsl-discuss gsl-webpages-cvs guile-cvs guile-emacs guile-emacs-cvs guile-gtk guile-prs guile-webpages-cvs infinity insight insight-announce insight-cvs insight-prs insight-webpages-cvs installshell installshell-cvs inti inti-cvs inti-webpages-cvs ip-over-scsi-cvs ip-over-scsi-webpages-cvs jffs2-cvs jffs2-webpages-cvs kawa kawa-cvs kawa-webpages-cvs libabigail libabigail-webpages-cvs libaio libaio-cvs libaio-webpages-cvs libc-alpha libc-alpha1 libc-announce libc-hacker libc-help libc-locales libc-ports libc-stable libc-testresults libffi-announce libffi-cvs libffi-discuss libffi-webpages-cvs lvm-cvs lvm-webpages-cvs lvm2-cvs lvm2-webpages-cvs mailer-daemon mauve-announce mauve-cvs mauve-discuss mauve-patches mauve-webpages-cvs mingw-cvs mingw-dvlpr netresolve newlib newlib-cvs newlib-webpages-cvs patchutils-cvs patchutils-list patchutils-webpages-cvs piranha-webpages-cvs prelink prelink-svn psim-cvs psim-webpages-cvs pthreads-win32 pthreads-win32-cvs pthreads-win32-webpages-cvs rda rhdb rhdb-admin rhdb-announce rhdb-cc rhdb-cvs rhdb-explain rhdb-installer rhdb-jdbc rhdb-utils rhdb-webpages-cvs rhl-cvs rhug-cvs rhug-rhats rpm2html rpm2html-cvs rpm2html-prs sharutils-alpha sharutils-announce sharutils-cvs sharutils-webpages-cvs sid sid-announce sid-cvs sid-webpages-cvs sourcenav sourcenav-announce sourcenav-cvs sourcenav-prs sourcenav-webpages-cvs sourceware-announce sourceware-cvs sourceware-cvs-sourceware sourceware-cvs-sourceware-webpages sourceware-infra-cvs sourceware-webpages-cvs springfield src-cvs systemtap systemtap-cvs systemtap-webpages-cvs testcvs-cvs testcvs-webpages-cvs webmaster win32-x11-cvs win32-x11-webpages-cvs xconq-announce xconq-cvs xconq-prs xconq-webpages-cvs xconq7 --JB7VKtwEfrfwwlcp Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="cygwin.com.lists" cygwin cygwin-announce cygwin-apps cygwin-apps-cvs cygwin-cvs cygwin-developers cygwin-licensing cygwin-patches cygwin-talk cygwin-webpages-cvs cygwin-xfree-cvs --JB7VKtwEfrfwwlcp Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="gcc.gnu.org.lists" fortran gcc gcc-announce gcc-bugs gcc-cvs gcc-cvs-testrun gcc-cvs-wwwdocs gcc-help gcc-maintainers gcc-patches gcc-ppc gcc-prs gcc-regression gcc-rust gcc-testlist gcc-testresults gccadmin gnutools-advocacy java java-announce java-cvs java-patches java-prs jit libstdc++ libstdc++-cvs libstdc++-prs libstdc++-webpages-cvs --JB7VKtwEfrfwwlcp--