Re: inbox.sourceware.org experiment

[Mark Wielaard <mark@klomp.org>]

[-- Attachment #1: Type: text/plain, Size: 1901 bytes --]

Hi,

On Sat, Aug 13, 2022 at 04:14:03PM +0200, Mark Wielaard via Overseers wrote:
> Looking at the mailman2inbox.sh script I have a few suggestions (I can
> make them to the script myself, but don't know if you are currently
> editing/running it):
> 
> - public-inbox-init should probably use -V2 (see above). You can then
>   also use -j JOBS to speed up the import.
> 
> - --indexlevel shuld be full to make the Xapian searching more useful
>   (this is the default, so you can also not set it). Note that this
>   also affects the incremental updating done by public-inbox-mda.
> 
> - You want to kill public-inbox-httpd using -SIGHUP so it just reloads
>   the new config files. Yo also want to kill the other daemons,
>   public-inbox-imapd and public-inbox-nntpd
> 
> - The --ng name should be based on the primary domain name (see
>   above). I don't know how to determine that easily though. Maybe
>   mailman knows, then we can also set the initial ADDRESS properly.

And mailman does know, but you need to be in the mailman group to
generate the lists. We support 3 virtual domains, sourceware.org,
cygwin.com and gcc.gnu.org. Using /usr/lib/mailman/bin/list_lists we
can generate lists per domain that only include advertised, public
archived lists. There are 212 sourceware.org lists, 11 cygwin.com
lists and 28 gcc.gnu.org lists.

Attached is the output of:

/usr/lib/mailman/bin/list_lists -b -a -p -V sourceware.org > sourceware.org.lists
/usr/lib/mailman/bin/list_lists -b -a -p -V cygwin.com > cygwin.com.lists
/usr/lib/mailman/bin/list_lists -b -a -p -V gcc.gnu.org > gcc.gnu.org.lists

I placed the same in the inbox homedir under mailman.lists/ so it can
be used as input to the import script.

For sourceware.org lists @sourceware.cygnus.org and
@sources.redhat.com should be alternate/historical names. For
cygwin.com lists @cygwin.org should be an alternate name.

Cheers,

Mark

[-- Attachment #2: sourceware.org.lists --]
[-- Type: text/plain, Size: 2931 bytes --]

anonymous
archer
archer-commits
autobook-cvs
autobook-webpages-cvs
autoconf-cvs
autoconf-webpages-cvs
bfd
binutils
binutils-cvs
binutils-webpages-cvs
buildbot
bunsen
bzip2-cvs
bzip2-devel
bzip2-webpages-cvs
c++-embedded
c++-embedded-cvs
c++-embedded-webpages-cvs
catapult-cvs
catapult-webpages-cvs
cgen
cgen-cvs
cgen-prs
cgen-webpages-cvs
cluster-cvs
cluster-webpages-cvs
crossgcc
debugedit
dm-cvs
dm-webpages-cvs
docbook-tools-announce
docbook-tools-cvs
docbook-tools-discuss
docbook-tools-hackers
docbook-tools-webpages-cvs
dominion-announce
dominion-cvs
dominion-discuss
dominion-hackers
dominion-webpages-cvs
dwz
eclipse
ecos-announce
ecos-bugs
ecos-cvs
ecos-devel
ecos-discuss
ecos-maintainers
ecos-patches
ecos-webpages-cvs
elfutils-devel
elix
elix-announce
elix-cvs
elix-webpages-cvs
frysk
frysk-bugzilla
frysk-cvs
frysk-testresults
frysk-webpages-cvs
gas2
gdb
gdb-announce
gdb-cvs
gdb-patches
gdb-patches-prs
gdb-prs
gdb-testers
gdb-testresults
gdb-webpages-cvs
gdbadmin
gettext-alpha
gettext-announce
gettext-cvs
gettext-webpages-cvs
glibc-bugs
glibc-bugs-regex
glibc-cvs
glibc-webpages-cvs
global
gnats-admin
gnats-announce
gnats-cvs
gnats-devel
gnats-prs
gnats-webpages-cvs
gnu-gabi
gsl-announce
gsl-cvs
gsl-discuss
gsl-webpages-cvs
guile-cvs
guile-emacs
guile-emacs-cvs
guile-gtk
guile-prs
guile-webpages-cvs
infinity
insight
insight-announce
insight-cvs
insight-prs
insight-webpages-cvs
installshell
installshell-cvs
inti
inti-cvs
inti-webpages-cvs
ip-over-scsi-cvs
ip-over-scsi-webpages-cvs
jffs2-cvs
jffs2-webpages-cvs
kawa
kawa-cvs
kawa-webpages-cvs
libabigail
libabigail-webpages-cvs
libaio
libaio-cvs
libaio-webpages-cvs
libc-alpha
libc-alpha1
libc-announce
libc-hacker
libc-help
libc-locales
libc-ports
libc-stable
libc-testresults
libffi-announce
libffi-cvs
libffi-discuss
libffi-webpages-cvs
lvm-cvs
lvm-webpages-cvs
lvm2-cvs
lvm2-webpages-cvs
mailer-daemon
mauve-announce
mauve-cvs
mauve-discuss
mauve-patches
mauve-webpages-cvs
mingw-cvs
mingw-dvlpr
netresolve
newlib
newlib-cvs
newlib-webpages-cvs
patchutils-cvs
patchutils-list
patchutils-webpages-cvs
piranha-webpages-cvs
prelink
prelink-svn
psim-cvs
psim-webpages-cvs
pthreads-win32
pthreads-win32-cvs
pthreads-win32-webpages-cvs
rda
rhdb
rhdb-admin
rhdb-announce
rhdb-cc
rhdb-cvs
rhdb-explain
rhdb-installer
rhdb-jdbc
rhdb-utils
rhdb-webpages-cvs
rhl-cvs
rhug-cvs
rhug-rhats
rpm2html
rpm2html-cvs
rpm2html-prs
sharutils-alpha
sharutils-announce
sharutils-cvs
sharutils-webpages-cvs
sid
sid-announce
sid-cvs
sid-webpages-cvs
sourcenav
sourcenav-announce
sourcenav-cvs
sourcenav-prs
sourcenav-webpages-cvs
sourceware-announce
sourceware-cvs
sourceware-cvs-sourceware
sourceware-cvs-sourceware-webpages
sourceware-infra-cvs
sourceware-webpages-cvs
springfield
src-cvs
systemtap
systemtap-cvs
systemtap-webpages-cvs
testcvs-cvs
testcvs-webpages-cvs
webmaster
win32-x11-cvs
win32-x11-webpages-cvs
xconq-announce
xconq-cvs
xconq-prs
xconq-webpages-cvs
xconq7

[-- Attachment #3: cygwin.com.lists --]
[-- Type: text/plain, Size: 161 bytes --]

cygwin
cygwin-announce
cygwin-apps
cygwin-apps-cvs
cygwin-cvs
cygwin-developers
cygwin-licensing
cygwin-patches
cygwin-talk
cygwin-webpages-cvs
cygwin-xfree-cvs

[-- Attachment #4: gcc.gnu.org.lists --]
[-- Type: text/plain, Size: 322 bytes --]

fortran
gcc
gcc-announce
gcc-bugs
gcc-cvs
gcc-cvs-testrun
gcc-cvs-wwwdocs
gcc-help
gcc-maintainers
gcc-patches
gcc-ppc
gcc-prs
gcc-regression
gcc-rust
gcc-testlist
gcc-testresults
gccadmin
gnutools-advocacy
java
java-announce
java-cvs
java-patches
java-prs
jit
libstdc++
libstdc++-cvs
libstdc++-prs
libstdc++-webpages-cvs