From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <sourceware-bugzilla@sourceware.org>
Received: by sourceware.org (Postfix, from userid 48)
	id 055EA3858404; Mon, 25 Mar 2024 00:05:46 +0000 (GMT)
DKIM-Filter: OpenDKIM Filter v2.11.0 sourceware.org 055EA3858404
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sourceware.org;
	s=default; t=1711325147;
	bh=jpInHzz/vo5y8ZZ64FPMX/c+Pz95CP05ZwDzwEwVKzg=;
	h=From:To:Subject:Date:From;
	b=pZfavOUijRB5Xsb6sWMop1Q96+TSqPf09FTA7W+NSDFpEzDm61ZzkPZLNmIjDDaLI
	 6GvOQ9P19VpPBNLdwTwdm0g8NE4O4YuS8Igj3NnsrHcjp3ml54ZwgdAjuVfOMlLgqP
	 d+/3Q4RRQdFmFO6vBteolj745hurotRNgddhwRlM=
From: "mark at klomp dot org" <sourceware-bugzilla@sourceware.org>
To: overseers@sourceware.org
Subject: [Bug Infrastructure/31549] New: Sitemaps for patchwork
Date: Mon, 25 Mar 2024 00:05:46 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: sourceware
X-Bugzilla-Component: Infrastructure
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: normal
X-Bugzilla-Who: mark at klomp dot org
X-Bugzilla-Status: NEW
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: P2
X-Bugzilla-Assigned-To: overseers at sourceware dot org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: bug_id short_desc product version bug_status
 bug_severity priority component assigned_to reporter target_milestone
Message-ID: <bug-31549-14326@http.sourceware.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://sourceware.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
List-Id: <overseers.sourceware.org>

https://sourceware.org/bugzilla/show_bug.cgi?id=3D31549

            Bug ID: 31549
           Summary: Sitemaps for patchwork
           Product: sourceware
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Infrastructure
          Assignee: overseers at sourceware dot org
          Reporter: mark at klomp dot org
  Target Milestone: ---

Currently we try to keep spiders out by adding various lists to robots.txt:

Disallow: /project/*/list/?*order=3D
Disallow: /project/*/list/?*series=3D
Disallow: /project/*/list/?*submitter=3D
Disallow: /project/*/list/?*delegate=3D
Disallow: /project/*/list/?*param=3D

The idea is that we do like the patches to be indexed so they can be easily
found. But we don't like spiders going through the patches through all the
possible listing results.

With sitemaps we would have a list for search engines and can don't need
complicated robots.txt rules.

--=20
You are receiving this mail because:
You are the assignee for the bug.=