From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 12862 invoked by alias); 22 Jun 2011 13:53:04 -0000 Received: (qmail 12847 invoked by uid 22791); 22 Jun 2011 13:53:02 -0000 X-SWARE-Spam-Status: No, hits=-6.9 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI,SPF_HELO_PASS,T_RP_MATCHES_RCVD X-Spam-Check-By: sourceware.org Received: from mx1.redhat.com (HELO mx1.redhat.com) (209.132.183.28) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Wed, 22 Jun 2011 13:52:32 +0000 Received: from int-mx09.intmail.prod.int.phx2.redhat.com (int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p5MDqSi0029472 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Wed, 22 Jun 2011 09:52:28 -0400 Received: from ns3.rdu.redhat.com (ns3.rdu.redhat.com [10.11.255.199]) by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id p5MDqR4e018535; Wed, 22 Jun 2011 09:52:27 -0400 Received: from [10.3.113.6] ([10.3.113.6]) by ns3.rdu.redhat.com (8.13.8/8.13.8) with ESMTP id p5MDqOcU030116; Wed, 22 Jun 2011 09:52:24 -0400 Message-ID: <4E01F398.3060909@redhat.com> Date: Wed, 22 Jun 2011 13:55:00 -0000 From: Jeff Law User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.17) Gecko/20110428 Fedora/3.1.10-1.fc15 Lightning/1.0b3pre Thunderbird/3.1.10 MIME-Version: 1.0 To: Jakub Jelinek CC: Mike Stump , Rainer Orth , Jason Merrill , Nathan Froyd , gcc-patches@gcc.gnu.org, libstdc++@gcc.gnu.org Subject: Re: [PATCH] parallelize gcc, gfortran and libstdc++ testing some more References: <20110617174709.GA3443@nightcrawler> <4DFF4B18.1070101@redhat.com> <20110620135459.GD16443@tyan-ft48-01.lab.bos.redhat.com> <20110620210441.GG16443@tyan-ft48-01.lab.bos.redhat.com> In-Reply-To: <20110620210441.GG16443@tyan-ft48-01.lab.bos.redhat.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-IsSubscribed: yes Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org X-SW-Source: 2011-06/txt/msg01669.txt.bz2 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 06/20/11 15:04, Jakub Jelinek wrote: > On Mon, Jun 20, 2011 at 03:54:59PM +0200, Jakub Jelinek wrote: >> On Mon, Jun 20, 2011 at 09:28:56AM -0400, Jason Merrill wrote: >>> On 06/17/2011 08:20 PM, Mike Stump wrote: >>>> On Jun 17, 2011, at 10:47 AM, Nathan Froyd wrote: >>>>> I've done a lot of g++-only testsuite runs lately >>>> >>>> I think it is reasonable to have even more of them, say, if you have 16 cores and just test c++... I wonder what the scaling is like as we approach larger N. :-) >>> >>> In my test runs, one of the libstdc++ batches (normal3) takes longer >>> than any of the g++ batches, so breaking that up would be more >>> effective for me. :) >> >> Yeah, certainly, libstdc++ needs more parallelization most. >> But, as I wrote already to Rainer in Autumn, the methodology >> for splitting things up should be on a fast box look at >> the time spent in each of the parts as reported by dejagnu >> in the log files, and split it to make the jobs roughly even >> sized with not overcomplicated patterns. > > So, here is a patch that parallelizes the longest test chunks > on x86_64-linux some more. > > libstdc++ testing is now split into 10 jobs, roughly equally sized > (used to be 4), check-gcc testing is now split into 10 jobs too (used to > be 7, but the new division attempts to be more balanced, fastest > job takes for me 8 minutes and longest job takes 11), and check-gfortran > is now run in 7 jobs instead of 4. This should make these more comparable > e.g. to check-g++ chunks etc. > > Regtested on x86_64-linux, verified the merged *.sum files are identical. > Ok for trunk? > > 2011-06-20 Jakub Jelinek > > * Makefile.in (dg_target_exps): Set. > (check_gcc_parallelize): Parallelize gcc testing into 10 jobs > instead of 7, try to divide it more evenly. > > * Make-lang.in (check_gfortran_parallelize): Parallelize dg.exp > into 6 jobs instead of 3. > > * testsuite/Makefile.am (check_DEJAGNU_normal_targets): Add > check-DEJAGNUnormal[4-9]. > (check-DEJAGNU): Split into 10 jobs for parallel testing instead of 4. > * testsuite/Makefile.in: Regenerated. OK. jeff -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/ iQEcBAEBAgAGBQJOAfOYAAoJEBRtltQi2kC7fh4H/0ku6F+8rZEb0iy0zyr+KHUd 2qvA4BsXPcNs3xjwdqgrpvg9pM+6qXsEB8oEuaCBu7ndT8kCMPfnjaRP3otnl5ju Maceyf0rZMDOUVYiYXYEstLMH+gljpraBU/n6UrvrXLLtZzna5yU6ZLwmPs1ngt/ +QQXWe34gRraEsLo4A9y5pcU69WnsVMdmrVKsRn/EnsLqSxClvmyWSaFrX0i5X4C +NfQC3YQqiG0bjC6acCyfccHGJ+7tlyiafsyR0TDZPfGQLCwnRWNhm+A/GrTjYpY nHbwhZ7sJef3gz9pLRm4qJ0OyMKqZo6c07Z43KdYIaIMQdjsh0CA3xfnd/vHSYQ= =wO5+ -----END PGP SIGNATURE-----