From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 59190 invoked by alias); 21 Oct 2016 22:07:56 -0000 Mailing-List: contact libc-alpha-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: libc-alpha-owner@sourceware.org Received: (qmail 59068 invoked by uid 89); 21 Oct 2016 22:07:55 -0000 Authentication-Results: sourceware.org; auth=none X-Virus-Found: No X-Spam-SWARE-Status: No, score=-1.9 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_NONE,SPF_HELO_PASS autolearn=ham version=3.3.2 spammy=Leaving X-HELO: NAM03-DM3-obe.outbound.protection.outlook.com Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Steve.Ellcey@cavium.com; Message-ID: <1477087655.8523.37.camel@caviumnetworks.com> Subject: make check vs. make xcheck From: Steve Ellcey To: Date: Fri, 21 Oct 2016 22:07:00 -0000 Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-ClientProxiedBy: BY2PR04CA034.namprd04.prod.outlook.com (10.141.249.152) To SN2PR0701MB1072.namprd07.prod.outlook.com (10.160.59.18) X-MS-Office365-Filtering-Correlation-Id: 9797fc5c-4a5b-4e98-a322-08d3f9fead81 X-Microsoft-Exchange-Diagnostics: 1;SN2PR0701MB1072;2:g8dgk1bfdMbbzIUW45kiofT4JuDaomkDnGKxeudqCsWO0R5neasYh4Z+jJK6tYEDQgcwNqUx5TSI0aMhti3wx9OH1TuAnpO/sJTjTRc4ZFUtKWebfCdO7SvyIA+RGTwVxImqWY9X9LAA869bJoo/rGe5Y6sQtgKfAterXh3JrHlxYrwG8ku6OLjFIy0gT9DKWOyAlbTkqYKRQ/TOhPRQGA==;3:CckEZg327/X2Uk7ulPNkc0oxLJ0etJTBWsfI9dOm5cIZdc72nkCU7cgDahaouzbuFhLAs1aup8auTIRUXcYuTtU5+jU9qF02Wu3LwG2T/nZ70iL9cfW/7WDGn3zUICRlU+evKimKarX2PRJyTawM4Q==;25:JIvkVm/OCbgi1Azf5wLSynbh/FQv4SvFREkApI1jVY2HAy3HqxUq4DvxXPrLlKIQVszSHp1WD2xauQ1bAqlMhhEpTC57emNw5NOkqEOq8btq5V3jYep6g5enq8yAIYk7Ft8Yj3TRehdfpq2MVX3GxkvVleBfBcAqXldhdKGThzwLsDZqcThvMmG5rPifq9OkApTJAIqF6ZJcB7T/N33Miqn3MCsCVxugQT3H+PNbyh6lnEr4ZfYX69hUzYk9sPn+Zbn+gLGAS6xoW2ri2QiaXG7QGpSVKp1IqhNyZBFCFmvChfcHuZsw5mRpKPqbw4rEZk1st8YEo6luiFwNdV0ojvoAxWoRpSrGkJD7+hlf54PPnqlMs8xXm6HKXJ03Zyq0S0n0xfBd4n22XrOxeAi3jj2v80FbOBX9c6DtziCcI1+6iMsgghSl9WpaecMUCt3a X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:SN2PR0701MB1072; X-Microsoft-Exchange-Diagnostics: 1;SN2PR0701MB1072;31:nCt9uZoj45ge7NKiP3IfLJ7B5NsU+E8TX63fqrS6yC3vg857HNr+8eDKMvhM0bMhn7gsHTdd2y5XcjMN8rH21ck1loiBeB8vYszyYtSXHZ4oY+XvGDOfEhad6Z3p+bO2CFzvjhmwCXCaWJBxj/r5YSmjBeh+ssOOauBR9+5soRARoXrzJ/vr0OSKZrYSmP05kYlz1ip2n3rvkLhulJsst3p7p7BxcJK6UJ0+wQ1OD2L8ZC/Ws2UHwLDL/kzg2GK6;20:X6uuZ6qHDMLIVmZJuQaPi6AwqW3WpM6YPxmqFr3pcjOXbctb3O2v9vf4lk+8HIrcFZy8mYSbGdCc4kBxoAgBcikMwYAEMEd5ZZVkjpHnRjJ3tzezbQ3PreKGeNnv2SS0r9xk4iOOZcr7G/dYGkOqh7k+Mgo9LeIzS5SO7Uu++qVfZozgOxi2M1RXq/iptk+XpzwnhpxiouxVGzol+gCWm6zLklutXxP1snKaYHK1gB+9u4B220RxV953pg6nhIxoRN5AdHfgb1JRjt1HL6dRZhKjEnTsjxtBvhZu1LzokBO0titry/KfHQD0/k5yalCnOokBmwoHj+Cb7s7oPFrdhkd5XGQU6Uq3slZt2hwXMGu+eQD1syxpYQXFRBrC47esKLPhwlkVYEe7v/uvbXSI623OnzWYJDgjO6r44YwDSVHDYw7ZeNNOAynJiSskqV03Sl8NkDkffMKpseHUE1tz6Q3cB9CDUv6kPjDLJzgmcLzNRT7OpOYHj2asHGy4imk5BUZoOmy9RD+vpxil2rnf6ozon7eM7GMXLxra1eyR685RSirFGCIMdGgyxYz3YQmKe+Mtw1CC+afsoHKONaPuaqnIZoXcZEf8K6nL0LIu7hA= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046);SRVR:SN2PR0701MB1072;BCL:0;PCL:0;RULEID:;SRVR:SN2PR0701MB1072; X-Microsoft-Exchange-Diagnostics: 1;SN2PR0701MB1072;4:vDbRAf8kxhNicqjfGIR3SMkc0NC0gBo1UQU1GcVj4WLIkQ3vXARXr9mzO9q8LcQzzUaOtSng7PESAWEQ1hzOX+YgX5EiFnlGonOamBlKF+VSbpre9JpFBwHjAjSPCNASvVr21zXXNMuvJc6EL8DDm3eKYYFgTUfbvAk/UROmLpXW5fabRsncLrcblTPvshBqB8k7ifrwdJbIvacqPbw3j9wSZ0Jb0cDRw6ZpqPmh0XGjj5MPizkn7IrA3cX5VQ4W7C1x5O4+K+qcRXWhOwVXdXaoqKZK9kDEq3T9t89Oj3kpXJyrETyRGzhKcH8dBxe8necpz4vHZeLU5ryylUUF4fDYeCxAOiqhu7fCfGIc2h5zdUqWkUwU4CrUKuvVXVRHW3XAKA9TgH0NTke9kEkSww== X-Forefront-PRVS: 01026E1310 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(7916002)(199003)(189002)(5660300001)(50466002)(5820100001)(92566002)(47776003)(77096005)(110136003)(586003)(450100001)(103116003)(81156014)(81166006)(305945005)(7736002)(6666003)(2906002)(3846002)(7846002)(97736004)(107886002)(42882006)(6916009)(33646002)(8676002)(101416001)(36756003)(6116002)(50986999)(50226002)(66066001)(23676002)(53416004)(2351001)(189998001)(68736007)(42186005)(2870700001)(105586002)(69596002)(106356001)(229853001)(99106002);DIR:OUT;SFP:1101;SCL:1;SRVR:SN2PR0701MB1072;H:sellcey-lt.caveonetworks.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtTTjJQUjA3MDFNQjEwNzI7MjM6WElqdm9uZk10bjdaT21Idm43Y0s3alVT?= =?utf-8?B?bk4xdTR6TmNRQ28xSW5GcUR2bXExYjNlYURMMUNVcTg1NXNRcW1CU2d6Tm80?= =?utf-8?B?VTdPdTh2ZW1zaFRqcExFNVc5RXlKcGxYV1NpbExxTk9zWEo0bFRPRzBUOVVV?= =?utf-8?B?YzVKUC9uVXBhcnhaNWVWM25jTmhTUzFxNnpYanFmYU5hUTBuK25uNlJQbW5Z?= =?utf-8?B?T3REcmRFYTR2eWVTL042MHd1emlzWFhzK0VtY0taQlhaR1U0QzRrT29iajB6?= =?utf-8?B?bWowdUpNcEoxQXNsNDVpU1BDWkpBTDJTTlgxNjcva2lUeEt1dHNXRkxYMi91?= =?utf-8?B?bytFMU82dHgrN2xwd2lmd0VNeGNEaUZjK1VzZUEwTzhmUnRPYU1QRWcyMnBi?= =?utf-8?B?aTFXZmk0SjYySEN4bEp4V2FoWktnVTBFblpvV2tOSGgrTk9uZWJFU2NhZktL?= =?utf-8?B?NHQ0a0hyY2c2NjF6aXBJcU1HZ0RqL0pjdjBQcEpISDZ6Y0RzOTRLN1AyaGta?= =?utf-8?B?OTJsN3p5MkIvYXVVY0gwWEJWV2I4dzdJSnZoYTd2YWxqL2lKRndMV3JKTi8w?= =?utf-8?B?ZUFNVWNubGNaNTF5RTlLbHFjaWt6eWRWRVhnODRHamgza0l6ZGI0TUxyalhO?= =?utf-8?B?TFZ6c3JWMnROemlJQzM0a1NpUXZBMnZMV2R3Z3NhWjZOSVZWdTI4U2JPdXBP?= =?utf-8?B?VjRvUUxQdThtVy95eGRPemJkeEthUDBod1c4cnA5RzJlM291eUVyTjlsTVdT?= =?utf-8?B?WnhrV0xWcU02aXB3NFp2VFNHV29Ha3FWd3A4S0VxK0VaUVpJS0VUT05qSis3?= =?utf-8?B?NThQUmxzMlkxNERVbFM3TDBoNUptUHBKTElubituTzUxenlVUzMvUkNCVkI0?= =?utf-8?B?SkhTZXc2K2tyUEowdUtWV2kybzJpNkE5aFNqdTQ0RlVZNlFBUWgyY3FhK1I2?= =?utf-8?B?eWtqc0FZNm9URXBoRkgxK1RWZ2lFeWlnaFFCWmpYbHBkaEdRNWVVMVpMR1Ba?= =?utf-8?B?QXhFVFE2cUdZN1kyTjJXQWhhQzcra3JEVWY2aC91NENpazAzM1Q0QkRJV2Zy?= =?utf-8?B?ajVnWnBpRmhFU0ZiZEN3MWpUaVA4M1lYbXFENGxFbTdnek9rSDZMNExkSUxE?= =?utf-8?B?QU9KYnhNcnVYaEtUYkFoMXcxdGZCZHpNV1JHQ3VxUk5DNjVVdVFta2pFYW4r?= =?utf-8?B?eXk2ZllYcTF2eWNic1N4SUoxZ29SZk02TVlJR2Nyd1l4NzAzQlRsNzcvdzF6?= =?utf-8?B?Vi8vcEMvcXF3c3p3dmVCZVFIbGpEMUhRY3M2LytoWlFTdHhHRkpCWWVwZTY2?= =?utf-8?B?WGNsdUlmNityQ1pCZW9sbmxwbjlMcGk2OXdGRm0xWVVabFVjU0lZMUs5bmg5?= =?utf-8?B?NUdWODZTWXFLMGNmZmVWN1YyR3ZrNFNKeHUxeFAvV2pvQmJVOGFuRFFrQ2sr?= =?utf-8?B?R0gxS3RlYlM1RFF6U1g3T3p4Zm5uWGY3QnFuN0ltVEpVL0pRdDJLVVFndVhS?= =?utf-8?B?TFVTMkJrNFE1TDhKdk5qVENsQldRTWZJMWpkKytIL1B2WWRVNUZPcWVWVHNH?= =?utf-8?B?M1dxMzYwdVBvTU9jcmorZm45Y3BCZVNPZz09?= X-Microsoft-Exchange-Diagnostics: 1;SN2PR0701MB1072;6:r5jeQ9Ovmivol+jjyCHTL6lUn+seS25pKCREkk4sb7n+jkFlaT5lrnbm9REpEbica2O+X+eyWTBK06Vfyk20FVeqlKQSh4j5R3setf0cA+2U0pGohE+mg2p37wAnmKWwaTeyiCfol165dT8ScB2mXR47Ns6au6OysDLEaGU/igDcUwYx1OEbeRgd0q2h548c6Q3wWqKWA5pItxkyiK95OFqgVvItgc6q63vXrEGktw4aybcudST4DZ3guYG4zm0epX+e/getHtoIILh3gm4tImyj9kWl5Gx+MSCqnSwiiDfiQW5U4A1S/jQTeE2m4DR3;5:OkSyXluET8Rw5Xn1R3JGuUQChhJuJxerERBfZfBC5Gf5Sp7qkImYKB8UBxaqBuywSJS/3nFwEcuvyxAt5nL3j0LDN4WEmqmbQEDjAHVPqmIbvsOhP9xjEPNDTmQdPI4e/2DHMWSwTSyl+7HWwX2dCA==;24:qxB8jURXHsqrGAT5ia8U99TNojRAPpItAHrLZIig9cpJS0HygumJAbD78ZtT4bZOV6E8n0zxGMWWZloG9MFcgk/wkdMD8WxvZ1uZ9J2LLlQ=;7:k9STzXU4ZAwG9HA56l4FJE1FCoPdHqUjKTF36d+BdxoXTkxItdR8IgafKbDmy9G9WmeIA2178R3wCaBA993EbWaWDYNO6SeSZpzdV9ivZzw7MXGyVft+5SAbhngavQCX9O1ck5ZIqPEx+NnKiToCM1pHHP2qbI/b21hLpAgStYMFlW/kF/J9ABPwGXt+NSomhzc0EaWaWh849nX5AhhnIV/jillfpihPsODt2F//AgRyh5SD2GalygA+B1fhwWfebEE79wonHndYpskD2g/5QV7YaCw/occMi8N3Zs58/pfvaE4q8d3pTbXZs7TOQPK3C04DFDWW06mjqI/lxU5hmjGdyO6MzK71aG46H92DVRQ= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Oct 2016 22:07:41.6144 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN2PR0701MB1072 X-SW-Source: 2016-10/txt/msg00374.txt.bz2 I had such good luck with my last testing question I guess I will ask another.  The glibc wiki indicates that running 'make xcheck' is a superset of running 'make check', but when I run 'make xcheck' I get a summary showing only 16 tests run: FAIL: iconv/test-iconvconfig FAIL: nptl/tst-setuid2 Summary of test results for extra tests:       2 FAIL      14 PASS Makefile:361: recipe for target 'xtests' failed make[1]: *** [xtests] Error 1 make[1]: Leaving directory '/home/ubuntu/sellcey/glibc-std/src/glibc' Makefile:9: recipe for target 'xcheck' failed make: *** [xcheck] Error 2 Now based on the time taken to run, I believe all the tests in 'make check' did actually get run as part of 'make xcheck' and if I look in the object directory I see that there are PASS and FAIL results in various subdirectories but the results do not show up in the summary. When I ran 'make check' I got: (lots of linknamespace failures) FAIL: conform/XPG4/utime.h/linknamespace FAIL: conform/XPG4/utmpx.h/linknamespace FAIL: conform/XPG4/wordexp.h/linknamespace FAIL: debug/tst-backtrace5 FAIL: debug/tst-backtrace6 XPASS: elf/tst-protected1a XPASS: elf/tst-protected1b FAIL: math/test-double FAIL: math/test-double-finite UNSUPPORTED: math/test-fesetexcept-traps UNSUPPORTED: math/test-fexcept-traps FAIL: math/test-idouble UNSUPPORTED: math/test-nearbyint-except-2 FAIL: nptl/tst-stack4 FAIL: nptl/tst-thread_local1 Summary of test results:     432 FAIL    2087 PASS       3 UNSUPPORTED      43 XFAIL       2 XPASS Makefile:353: recipe for target 'tests' failed make[1]: *** [tests] Error 1 make[1]: Leaving directory '/home/ubuntu/sellcey/glibc-std/src/glibc' Makefile:9: recipe for target 'check' failed make: *** [check] Error 2 Any idea on why all the results don't show up in the summmary when running 'make xcheck'? Steve Ellcey