How to skip/disable individual test cases in glibc testsuite

How to skip/disable individual test cases in glibc testsuite

[Yash Shinde]

[-- Attachment #1: Type: text/plain, Size: 772 bytes --]

Hi,

After running glibc testsuite with remote host testing using qemu, some 
stale qemu processes are left behind without terminating as follows:

$ ps -el | grep qemu
1 S 23306 2592477       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc
1 S 23306 2592807       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc

The cause of this stale processes are found to be from test cases 
*tst-scm_rights.c and tst-scm_rights-time64.c files(present at 
sysdeps/unix/sysv/linux/).

*https://sourceware.org/glibc/wiki/Testing/Testsuite*
*I referred the above link for checking if the tests can be disabled but 
didn't find.

Is there any way to skip/disable individual test cases for glibc testsuite?
If yes, how to do so?

Thanks in advance.

Regards,
Yash

Re: How to skip/disable individual test cases in glibc testsuite

[Yash Shinde]

[-- Attachment #1: Type: text/plain, Size: 916 bytes --]

Hi,

Just a gentle reminder.
Any updates to this query?

On 14-03-2024 19:25, Yash Shinde wrote:
>
> Hi,
>
> After running glibc testsuite with remote host testing using qemu, 
> some stale qemu processes are left behind without terminating as follows:
>
> $ ps -el | grep qemu
> 1 S 23306 2592477       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc
> 1 S 23306 2592807       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc
>
> The cause of this stale processes are found to be from test cases 
> *tst-scm_rights.c and tst-scm_rights-time64.c files(present at 
> sysdeps/unix/sysv/linux/).
>
> *https://sourceware.org/glibc/wiki/Testing/Testsuite*
> *I referred the above link for checking if the tests can be disabled 
> but didn't find.
>
> Is there any way to skip/disable individual test cases for glibc 
> testsuite?
> If yes, how to do so?
>
> Thanks in advance.
>
> Regards,
> Yash
>

Re: How to skip/disable individual test cases in glibc testsuite

[Adhemerval Zanella Netto]

On 14/03/24 10:55, Yash Shinde wrote:
> Hi,
> 
> After running glibc testsuite with remote host testing using qemu, some stale qemu processes are left behind without terminating as follows:
> 
> $ ps -el | grep qemu
> 1 S 23306 2592477       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc
> 1 S 23306 2592807       1  0  80   0 - 1101979 sigsus ? 00:00:00 qemu-ppc
> 
> The cause of this stale processes are found to be from test cases *tst-scm_rights.c and tst-scm_rights-time64.c files(present at sysdeps/unix/sysv/linux/).
> 
> *https://sourceware.org/glibc/wiki/Testing/Testsuite*
> *I referred the above link for checking if the tests can be disabled but didn't find.
> 
> Is there any way to skip/disable individual test cases for glibc testsuite?
> If yes, how to do so?
> 
> Thanks in advance.

There is no straightforwards way to exclude the tests without changing
the sysdeps/unix/sysv/linux/Makefile.  Do you know why qemu-user is
stuck? All tests should have a watchdog one to trigger a kill for
the timeout case, it would be useful to know why this is not working
on this particular environment.

PS: for some reason your email went to my spam box, not sure why.

Re: How to skip/disable individual test cases in glibc testsuite

[Yash Shinde]

[-- Attachment #1: Type: text/plain, Size: 954 bytes --]


On 27-03-2024 19:36, Adhemerval Zanella Netto wrote:
> There is no straightforwards way to exclude the tests without changing
> the sysdeps/unix/sysv/linux/Makefile.  Do you know why qemu-user is
> stuck? All tests should have a watchdog one to trigger a kill for
> the timeout case, it would be useful to know why this is not working
> on this particular environment.
>
> PS: for some reason your email went to my spam box, not sure why.

Thanks for looking into it.
What changes should be done in "sysdeps/unix/sysv/linux/Makefile " to 
skip a test case?

I checked for why qemu-user is stucked and it was found that the test 
case "sysdeps/unix/sysv/linux/tst-scm_rights-time64.c" has some 
"recvmsg/sendmsg"  subprocess to the parent process.
I guess this processes do not terminate correctly and thus there are 
stale qemu processes.

How do I check if the watchdog works correctly and triggers a kill for 
timeout case(int this particular case)?

Re: How to skip/disable individual test cases in glibc testsuite

[Adhemerval Zanella Netto]

On 27/03/24 12:35, Yash Shinde wrote:
> 
> On 27-03-2024 19:36, Adhemerval Zanella Netto wrote:
>> There is no straightforwards way to exclude the tests without changing
>> the sysdeps/unix/sysv/linux/Makefile.  Do you know why qemu-user is
>> stuck? All tests should have a watchdog one to trigger a kill for
>> the timeout case, it would be useful to know why this is not working
>> on this particular environment.
>>
>> PS: for some reason your email went to my spam box, not sure why.
> 
> Thanks for looking into it.
> What changes should be done in "sysdeps/unix/sysv/linux/Makefile " to skip a test case?

You either remove or comment it out from 'tests' and/or 'tests-time64' rule.

> 
> I checked for why qemu-user is stucked and it was found that the test case "sysdeps/unix/sysv/linux/tst-scm_rights-time64.c" has some "recvmsg/sendmsg"  subprocess to the parent process.
> I guess this processes do not terminate correctly and thus there are stale qemu processes.
> 
> How do I check if the watchdog works correctly and triggers a kill for timeout case(int this particular case)?
> 

Mostly of testsuite (some old tests does not follow this unfortunately) fork
before actually executing the test, the parent process will be responsible
to watchdog the result and thus killing the process if the default timeout
expires.