public inbox for gnats-devel@sourceware.org
 help / color / mirror / Atom feed
From: Chad Walstrom <chewie@wookimus.net>
To: help-gnats@gnu.org
Subject: Re: help required in installing gnat 4.0 version
Date: Thu, 22 Apr 2004 11:01:00 -0000	[thread overview]
Message-ID: <20040421161525.GE14502@wookimus.net> (raw)
In-Reply-To: <408666DF.20501@india.nsc.com>


[-- Attachment #1.1.1: Type: text/plain, Size: 2695 bytes --]

On Wed, Apr 21, 2004 at 05:49:43PM +0530, arunkurse wrote:
> I am Arun , working as system administrator . I  need to clarify
> certain doubts regarding gnats version 4.0 .
> 
> 1.  Is it possible to install gants4.0 on solaris 8???

I don't see why not.

> 2.  If possible what should be the mininum patch level on solaris 8??

Define "minimum patch level".

> 3.   How much space does it consume for installation and configuration 
>     of database ???

The programs are relatively small, especially if you compile them
dynamically linked.  The size of the database will be proportionate to
the number of reports you expect to receive.  Each problem report is
stored in a separate file on the filesystem in plain-text.  The format
of each report is a modified RFC822 Internet message, and is fully
compliant with that standard.  These PR's are not compressed, but can be
archived and aged.

Currently, we have just over 3000 problem reports in our database
directory.  All of these were received over email, and MIME attachments
were not removed (so a significant portion of the space used is a result
of spam and viruses).  The space consumption is currently around 21MB.
This could probably be reduced by at least one third if we
re-categoriezed many of the "pending" PR's to "spam" and removed them:

5.9M    pending
3.4M    spam
1.8M    email
1.6M    pc-sw
1.3M    server
1.3M    mac-sw
1.1M    gnats-adm
772K    website
736K    general
496K    pc-hw
488K    network
392K    windows
348K    macintosh
248K    mac-hw
228K    printer
192K    novell
124K    lists
108K    mmaker
68K     biosci
40K     projects
32K     web-cgi
16K     security
16K     gnats
8.0K    glycine
4.0K    gnats-queue
4.0K    mcb-xserve
108K    test

Taking a quick cursory glance over the vast majority of problem reports,
space consumption falls around the 4k mark, the typical block size for
most filesystems.  Space would be recovered here on a filesystem like
reiserfs, which specializes in storing many small files.

Some quick math would reveal that for every 1000 Problem Reports, on
average you should be consuming 4000 blocks or 4000KB of space.

Additional space savings could be realized through MIME
filtering/conversions of submitted emails through procmail filters.  We
already block emails larger than 50KB in size.  Some emails are sent
with both plain-text and HTML attachments, and some are HTML-only.

Our procmail filter is attached to give you some ideas on how to handle
such things.

-- 
Chad Walstrom <chewie@wookimus.net>           http://www.wookimus.net/
           assert(expired(knowledge)); /* core dump */

[-- Attachment #1.1.2: procmailrc-gnats --]
[-- Type: text/plain, Size: 3481 bytes --]

# $Id$
# GNATS procmail file
#
# - MH style mail folders
# - Use this instead of alias for "bugs" aliases instead of pipes so that we
# 	can preprocess emails first
# - First order of business, spam filtering.
# - Spam filtering is available on mail server, but we want local control
# - Add autoacks for queue submissions (Reply-to: nobody)
#
# Administrative email still should be aliased to "root"
#
# See also: procmail(8), procmailrc(5), procmailex(5), procmailsc(5),
#   formail(8), lynx(1), bzip2(1), gnats(7), queue-pr(8), mail-query
#
MAILDIR=$HOME/Mail
SHELL=/bin/bash
DEFAULT=inbox/.
COMSAT=no

MY_ADDR=gnats@BUGHOST.MYDOMAIN
MY_XLOOP=$MY_ADDR
YEAR_MONTH=`date +%Y-%m`
MAXSIZE=51200

LOGABSTRACT=yes
VERBOSE=no
LOGFILE=procmail-${YEAR_MONTH}.log

# Kill duplicates
:0 Wh: msgid.lock
| formail -D 8192 msgid.cache 

# Spam filtering before archiving
:0 fw
* ! ^X-Spam-Status: Yes
| /usr/bin/spamc -s $MAXSIZE -d SPAMASSASSIN-HOST.MYDOMAIN

# Attempt to archive and save to spam folder
:0
* $ < $MAXSIZE
* ^X-Spam-Status: Yes
{
	:0 wc
	| /usr/bin/bzip2 -9 >> spam-${YEAR_MONTH}.mbox.bz2

	:0
	spam/.
}

# Compressed Archive if not spam and not too large
:0 c
* $ < $MAXSIZE
* ! ^X-Spam-Status: Yes
{
	:0 w
	| /usr/bin/bzip2 -9 >> received-${YEAR_MONTH}.mbox.bz2

		:0 e
		backup/.
}

# Score Kill List -- positive score to kill
# Only matching headers so far
:0 H
* -99^0

# Basic mailer daemon filtering
* 100^0 ^FROM_DAEMON
* 100^0 ^From.*(postmaster|mailer-daemon|root)
* 100^0 ^Precedence:.*(bulk|junk)

# VIRUSES and BANNED files
* 100^0 ^From.*abuse@cbs\.umn\.edu
*  50^0 ^Subject:.*(VIRUS|BANNED)

# Spammers
* 100^0 ^From.*webadmin@coastal\.gov\.bb
* 100^0 ^From.*@bp\.com
* 100^0 ^From.*\(via the vacation program\)
* 100^0 ^From.*derek\.yikes@shaw\.ca
* 100^0 ^From.*wseas_ece@canada\.com

# Spam phrase matching
* 100^1 ^Subject:.*NPSAS Initiative
{
	:0
	* ^Message-Id:\/.*
	# Already archived. Log message id for reference.
	{ 
		LOG="Killed Message-ID: $MATCH
" 
	}

	# Kill it
	:0
	/dev/null
}

# Fix HTML-only email
:0
* ! ^Content-Type: multipart/
*   ^Content-Type: text/html
{
	# Change body with lynx and append footer
	:0 fbw
	| (lynx -dump -force-html -stdin; echo ""; \
		echo "-=-=[CONVERTED FROM HTML VIA LYNX]=-=-")

	# Prepend body header
	:0 Afbw
	| (echo "-=-=[CONVERTED FROM HTML VIA LYNX]=-=-"; cat -)

	# Change header content-type (preserve old)
	:0 Afhw
	| formail -i "Content-Type: text/plain"
}

# Route PR's to queuing program
PR_REGEX='(bugs|help|webmaster|request)'
:0 w
* $ ^TO$PR_REGEX
{ 
	# We've been getting very large files.  We would like to reject these
	# with a friendly note.  This is in bytes (50K).  There is no copy
	# here, because we want to quell this email (and it's already
	# archived).
	:0
	* $ > $MAXSIZE
	| ( formail -r ; cat toobig.txt ) | $SENDMAIL -oi -t

		# save to failed-queue
		:0 A
		failed-queue/.

	# Queue the problem
	:0
	| /usr/lib/gnats/queue-pr -q

		# Save if failed queue-pr
		:0 e
		failed-queue/.
}

# Route mail queries through the mail-query program
:0 w
* ^TOquery-pr
| /usr/lib/gnats/mail-query

	:0 e
	failed-query/.

# Bounce mail addressed to gnats and gnats-admin to root user
:0 fhw
* $ ! ^X-Loop: $MY_XLOOP
* ^TOgnats(-admin)?
| formail -I"X-Loop: $MY_XLOOP" 

	:0 a
	! -oi root@MYDOMAIN

# Default email box (inbox/.)

[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

[-- Attachment #2: Type: text/plain, Size: 139 bytes --]

_______________________________________________
Help-gnats mailing list
Help-gnats@gnu.org
http://mail.gnu.org/mailman/listinfo/help-gnats

      reply	other threads:[~2004-04-21 16:38 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-04-21 16:38 arunkurse
2004-04-22 11:01 ` Chad Walstrom [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20040421161525.GE14502@wookimus.net \
    --to=chewie@wookimus.net \
    --cc=help-gnats@gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).