From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 19363 invoked by alias); 25 Nov 2019 00:37:07 -0000 Mailing-List: contact overseers-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: , Sender: overseers-owner@sourceware.org Received: (qmail 19351 invoked by uid 89); 25 Nov 2019 00:37:07 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-3.6 required=5.0 tests=AWL,BAYES_00,GIT_PATCH_1,SPF_HELO_PASS,SPF_PASS autolearn=ham version=3.3.1 spammy=HX-Languages-Length:1047, concurrency, overseers, our X-HELO: elastic.org Received: from li367-187.members.linode.com (HELO elastic.org) (96.126.110.187) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Mon, 25 Nov 2019 00:37:06 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=elastic.org ; s=default2; h=In-Reply-To:Content-Type:MIME-Version:References:Message-ID: Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=GYgY/rwo1CM48j9idMxjYBTB9fcrZ7FPACvmgn5bqyg=; b=Z3SsXnKsF0/OcylPPHCH2drBN1 lyx0PwL0IUjFMK7Zz9Inxm3YK/XPKLV5cG75RjQ9eUi4Vy3iJkFxqjBW9+vPax/dMOLMUXWTBAm1h g0y1W8FpBs+g0UGV9W8RXBLDC7eOG5RpyabvJYaqEXCL0/v0vPJByg5Kdgs6qqPMg5zZ1rdILVpY2 rEIUKHtp6xq29q0MBM/XsBSHv3JVYv76RPHMp2+CgcPeZjcV8F3fp0HS8bWrosThftQfsP5GuDeP5 smK+8jYdLa2FJeU5OFwov7hd7ach8JjXblYA8MjjQdvnWt+bwnYU2HrdBnkyum8KuSE7j4ZFvxyQF 5eKG9d9Q==; Received: from vpn-home.elastic.org ([10.0.0.2] helo=elastic.org) by elastic.org with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.92.3) (envelope-from ) id 1iZ2NB-0005fW-S5; Mon, 25 Nov 2019 00:37:01 +0000 Received: from very.elastic.org ([192.168.1.1]) by elastic.org with esmtp (Exim 4.92.3) (envelope-from ) id 1iZ2NB-000Arv-II; Sun, 24 Nov 2019 19:37:01 -0500 Received: from fche by very.elastic.org with local (Exim 4.92.3) (envelope-from ) id 1iZ2NB-005HSo-He; Sun, 24 Nov 2019 19:37:01 -0500 Date: Mon, 25 Nov 2019 00:37:00 -0000 From: "Frank Ch. Eigler" To: ASSI Cc: Jon Turney , overseers@sourceware.org Subject: Re: [Cygwin] package-grep on Sourceware Message-ID: <20191125003701.GB1093554@elastic.org> References: <24997709.IERGFR1AUN@gertrud> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <24997709.IERGFR1AUN@gertrud> User-Agent: Mutt/1.12.1 (2019-06-15) X-Sender-Verification: "" X-Sender-Verification: "" X-IsSubscribed: yes X-SW-Source: 2019-q4/txt/msg00042.txt.bz2 Hi - > you've made changes to the package-grep CGI script on sourceware > that pretty much remove its originally intended functionality. The > original was searching the index of the package _contents_ as it > would get installed on the disk, while the JSON file you search now > only has the metadata for the packages. That's not even > superficially the same thing. [...] OK. As you may be aware, this simplification was done because the previous code's workload was too high (grepping through 600MB+ of text per cgi call), and we at overseers@ weren't told otherwise. > I've looked into what could be done to do that in a more > server-friendly way, but it turns out that there either isn't > anything that's ready-made for this or I can't find it. [...] Thanks for looking into it. A few other possibilities to ameliorate the impact of restoring the previous version: - using xargs grep to use our extra cores, to reduce latency - to impose a mod_qos concurrency limit on package-grep.cgi - FChE