* [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024
@ 2024-01-30 11:13 Cyril Hrubis
2024-02-03 23:57 ` [LTP] " Petr Vorel
0 siblings, 1 reply; 3+ messages in thread
From: Cyril Hrubis @ 2024-01-30 11:13 UTC (permalink / raw)
To: ltp, linux-kernel, libc-alpha; +Cc: lwn, akpm, torvalds
Good news everyone,
the Linux Test Project test suite stable release for *January 2024* has been
released.
Since the last release 315 patches by 34 authors were merged.
Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.
NOTABLE CHANGES
===============
* New tests
- splice07, accept03, readahead01:
Tests that feeds the syscall all kinds of invalid file descriptors and
checks that the syscall fails properly.
- proc_sched_rt01 a regression test for:
c1fc6484e1fb ("sched/rt: sysctl_sched_rr_timeslice show default timeslice after reset")
079be8fc6309 ("sched/rt: Disallow writing invalid values to sched_rt_period_us")
- ksm07 a test for KSM smart-scan.
- pathconf02 negative testcases for pathconf()
- pipe15 A regresson test for:
46c4c9d1beb7 ("pipe: increase minimum default pipe size to 2 pages")
- nft02 A regression test for:
515ad530795c ("netfilter: nf_tables: do not ignore genmask when looking up chain by id") aka CVE-2023-31248
- sched_setscheduler04 a test for SCHED_RESET_ON_FORK
- setsockopt10 2c02d41d71f9 ("net/ulp: prevent ULP without clone op from entering the LISTEN status") aka CVE-2023-0461
- gettid02 A basic gettid02 test.
- splice06 A test that splicing from a /proc files works.
* Increased coverage
- ioctl02 cover more modern termios ioctls() as well.
- fanotify13 More test coverage for overlayfs.
- input* test now check UI_GET_NAME ioctl() too.
* Removed tests
- fork12 Which was a naive fork bomb test, we do have other tests
(setrlimit01.c, ...) that better cover this scenario.
- mongo test framework
Which was test reiser, ext2 and jfs unmaintained for a decade.
- simple_tracer.c Tracing test from 2009 that does not compile anymore.
- runtest/fsx-linux This is consolidation of runtest files, since these test
duplicated in ltp-aiodio.part3.
- testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh
These were unmaintained and unused scripts.
- scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
compile cleanly for decades.
- load_stress_all_kernel_modules.sh Broken for quite some time.
* The LTP library now has a functions to iterate over different
file descriptors. That allows us to easily implement more comprehensive tests
that feed various syscalls all possible file descriptors and check that the
syscall fails properly with invalid combinations. Most notable use of this
library is the newly introduced splice07.c test.
* The minimal size of the device for a few filesystem tests was increased to
1GB because modern filesystems, most notably Btrfs does not work properly on
smaller devices.
* LTP now tests bcachefs if kernel support and bcache.mkfs is present
* 30 testcases were converted to the new test library
+ The usual amount of fixes and cleanups
NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel
The performance tests in net.features can be now skipped by setting
LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
executed on VMs on a overloaded host or if we are running tests with a
background load.
KIRK (previously RUNLTP-NG)
===========================
Kirk was updated to v1.2
This version brings the following updates:
- show both stdout and stderr when executing tests on host
- support for external commands on different SUTs
- warning message when SUT doesn't support parallel execution
- more stable epoll() communication with LTX
- minor fixes
- updated documentation
DOWNLOAD AND LINKS
==================
The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:
https://github.com/linux-test-project/ltp/releases/tag/20240129
The project pages as well as GIT repository are hosted on GitHub:
https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/
If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/C-Test-API
https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API
https://github.com/linux-test-project/ltp/wiki/Shell-Test-API
https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Build-System
Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@lists.linux.it.
CREDITS
=======
Many thanks to the people contributing to this release:
git shortlog -s -e -n 20230929..
147 Petr Vorel <pvorel@suse.cz>
25 Yang Xu <xuyang2018.jy@fujitsu.com>
21 Andrea Cervesato <andrea.cervesato@suse.com>
18 Martin Doucha <mdoucha@suse.cz>
12 Cyril Hrubis <chrubis@suse.cz>
11 Marius Kittler <mkittler@suse.de>
8 Wei Gao <wegao@suse.com>
7 Amir Goldstein <amir73il@gmail.com>
7 Richard Palethorpe <rpalethorpe@suse.com>
6 Avinesh Kumar <akumar@suse.de>
6 Edward Liaw <edliaw@google.com>
6 Jan Kara <jack@suse.cz>
5 Jan Stancek <jstancek@redhat.com>
4 Hongchen Zhang <zhanghongchen@loongson.cn>
4 Kevin Brodsky <kevin.brodsky@arm.com>
4 Xiao Yang <yangx.jy@fujitsu.com>
3 Shiyang Ruan <ruansy.fnst@fujitsu.com>
2 Li Wang <liwang@redhat.com>
2 Li Zhijian <lizhijian@fujitsu.com>
2 Pengfei Xu <pengfei.xu@intel.com>
2 Stefan Roesch <shr@devkernel.io>
1 Alexander Kanavin <alex@linutronix.de>
1 Brennan Ashton <bashton@brennanashton.com>
1 Korobeynikov Gleb <mathkgd@mail.ru>
1 Marcos Paulo de Souza <mpdesouza@suse.com>
1 Mengchi Cheng <mengcc@amazon.com>
1 Murphy Zhou <jencce.kernel@gmail.com>
1 Shizhao Chen <shichen@redhat.com>
1 Shoukui Zhang <zhangshoukui@xiaomi.com>
1 Subramanya Swamy <subramanya.swamy.linux@gmail.com>
1 haopengxiang <haopengxiang@xiaomi.com>
1 nietingting <nietingting@xiaomi.com>
1 wangxuewen <wangxuewen@kylinos.cn>
1 ybonatakis <ybonatakis@suse.com>
And also thanks to patch reviewers:
git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
111 Petr Vorel <pvorel@suse.cz>
70 Cyril Hrubis <chrubis@suse.cz>
47 Li Wang <liwang@redhat.com>
35 Richard Palethorpe <rpalethorpe@suse.com>
14 Martin Doucha <mdoucha@suse.cz>
8 Amir Goldstein <amir73il@gmail.com>
7 Xiao Yang <yangx.jy@fujitsu.com>
7 Marius Kittler <mkittler@suse.de>
6 Jan Kara <jack@suse.cz>
4 Avinesh Kumar <akumar@suse.de>
3 Andrea Cervesato <andrea.cervesato@suse.com>
3 Jan Stancek <jstancek@redhat.com>
2 Yang Xu <xuyang2018.jy@fujitsu.com>
1 Petr Vorel <petr.vorel@gmail.com>
1 Christian Brauner <brauner@kernel.org>
--
Cyril Hrubis
chrubis@suse.cz
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [LTP] [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024
2024-01-30 11:13 [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024 Cyril Hrubis
@ 2024-02-03 23:57 ` Petr Vorel
2024-02-05 11:04 ` Petr Vorel
0 siblings, 1 reply; 3+ messages in thread
From: Petr Vorel @ 2024-02-03 23:57 UTC (permalink / raw)
To: Cyril Hrubis; +Cc: ltp, linux-kernel, libc-alpha, lwn, automated-testing
Hi all,
> Good news everyone,
> the Linux Test Project test suite stable release for *January 2024* has been
> released.
> Since the last release 315 patches by 34 authors were merged.
> Patch review is what most of the projects struggle with and LTP is no
> different. If you can spare some effort helping with the patch review is more
> than welcomed.
> NOTABLE CHANGES
> ===============
FYI, there is missing removal of runtest/connectors [1], which can break some
tooling.
Kind regards,
Petr
[1] https://github.com/linux-test-project/ltp/commit/9b642d89c0bcf5885b051c2d5768fa94b61d86cb
> * New tests
> - splice07, accept03, readahead01:
> Tests that feeds the syscall all kinds of invalid file descriptors and
> checks that the syscall fails properly.
> - proc_sched_rt01 a regression test for:
> c1fc6484e1fb ("sched/rt: sysctl_sched_rr_timeslice show default timeslice after reset")
> 079be8fc6309 ("sched/rt: Disallow writing invalid values to sched_rt_period_us")
> - ksm07 a test for KSM smart-scan.
> - pathconf02 negative testcases for pathconf()
> - pipe15 A regresson test for:
> 46c4c9d1beb7 ("pipe: increase minimum default pipe size to 2 pages")
> - nft02 A regression test for:
> 515ad530795c ("netfilter: nf_tables: do not ignore genmask when looking up chain by id") aka CVE-2023-31248
> - sched_setscheduler04 a test for SCHED_RESET_ON_FORK
> - setsockopt10 2c02d41d71f9 ("net/ulp: prevent ULP without clone op from entering the LISTEN status") aka CVE-2023-0461
> - gettid02 A basic gettid02 test.
> - splice06 A test that splicing from a /proc files works.
> * Increased coverage
> - ioctl02 cover more modern termios ioctls() as well.
> - fanotify13 More test coverage for overlayfs.
> - input* test now check UI_GET_NAME ioctl() too.
> * Removed tests
> - fork12 Which was a naive fork bomb test, we do have other tests
> (setrlimit01.c, ...) that better cover this scenario.
> - mongo test framework
> Which was test reiser, ext2 and jfs unmaintained for a decade.
> - simple_tracer.c Tracing test from 2009 that does not compile anymore.
> - runtest/fsx-linux This is consolidation of runtest files, since these test
> duplicated in ltp-aiodio.part3.
> - testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
> testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh
> These were unmaintained and unused scripts.
> - scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
> compile cleanly for decades.
> - load_stress_all_kernel_modules.sh Broken for quite some time.
> * The LTP library now has a functions to iterate over different
> file descriptors. That allows us to easily implement more comprehensive tests
> that feed various syscalls all possible file descriptors and check that the
> syscall fails properly with invalid combinations. Most notable use of this
> library is the newly introduced splice07.c test.
> * The minimal size of the device for a few filesystem tests was increased to
> 1GB because modern filesystems, most notably Btrfs does not work properly on
> smaller devices.
> * LTP now tests bcachefs if kernel support and bcache.mkfs is present
> * 30 testcases were converted to the new test library
> + The usual amount of fixes and cleanups
> NOTABLE CHANGES IN NETWORK TESTS
> ================================
> brought to you by Petr Vorel
> The performance tests in net.features can be now skipped by setting
> LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
> executed on VMs on a overloaded host or if we are running tests with a
> background load.
> KIRK (previously RUNLTP-NG)
> ===========================
> Kirk was updated to v1.2
> This version brings the following updates:
> - show both stdout and stderr when executing tests on host
> - support for external commands on different SUTs
> - warning message when SUT doesn't support parallel execution
> - more stable epoll() communication with LTX
> - minor fixes
> - updated documentation
> DOWNLOAD AND LINKS
> ==================
> The latest version of the test-suite contains 3000+ tests for the Linux
> and can be downloaded at:
> https://github.com/linux-test-project/ltp/releases/tag/20240129
> The project pages as well as GIT repository are hosted on GitHub:
> https://github.com/linux-test-project/ltp
> http://linux-test-project.github.io/
> If you ever wondered how to write a LTP testcase, don't miss our developer
> documentation at:
> https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
> https://github.com/linux-test-project/ltp/wiki/C-Test-API
> https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API
> https://github.com/linux-test-project/ltp/wiki/Shell-Test-API
> https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
> https://github.com/linux-test-project/ltp/wiki/Build-System
> Patches, new tests, bugs, comments or questions should go to to our mailing
> list at ltp@lists.linux.it.
> CREDITS
> =======
> Many thanks to the people contributing to this release:
> git shortlog -s -e -n 20230929..
> 147 Petr Vorel <pvorel@suse.cz>
> 25 Yang Xu <xuyang2018.jy@fujitsu.com>
> 21 Andrea Cervesato <andrea.cervesato@suse.com>
> 18 Martin Doucha <mdoucha@suse.cz>
> 12 Cyril Hrubis <chrubis@suse.cz>
> 11 Marius Kittler <mkittler@suse.de>
> 8 Wei Gao <wegao@suse.com>
> 7 Amir Goldstein <amir73il@gmail.com>
> 7 Richard Palethorpe <rpalethorpe@suse.com>
> 6 Avinesh Kumar <akumar@suse.de>
> 6 Edward Liaw <edliaw@google.com>
> 6 Jan Kara <jack@suse.cz>
> 5 Jan Stancek <jstancek@redhat.com>
> 4 Hongchen Zhang <zhanghongchen@loongson.cn>
> 4 Kevin Brodsky <kevin.brodsky@arm.com>
> 4 Xiao Yang <yangx.jy@fujitsu.com>
> 3 Shiyang Ruan <ruansy.fnst@fujitsu.com>
> 2 Li Wang <liwang@redhat.com>
> 2 Li Zhijian <lizhijian@fujitsu.com>
> 2 Pengfei Xu <pengfei.xu@intel.com>
> 2 Stefan Roesch <shr@devkernel.io>
> 1 Alexander Kanavin <alex@linutronix.de>
> 1 Brennan Ashton <bashton@brennanashton.com>
> 1 Korobeynikov Gleb <mathkgd@mail.ru>
> 1 Marcos Paulo de Souza <mpdesouza@suse.com>
> 1 Mengchi Cheng <mengcc@amazon.com>
> 1 Murphy Zhou <jencce.kernel@gmail.com>
> 1 Shizhao Chen <shichen@redhat.com>
> 1 Shoukui Zhang <zhangshoukui@xiaomi.com>
> 1 Subramanya Swamy <subramanya.swamy.linux@gmail.com>
> 1 haopengxiang <haopengxiang@xiaomi.com>
> 1 nietingting <nietingting@xiaomi.com>
> 1 wangxuewen <wangxuewen@kylinos.cn>
> 1 ybonatakis <ybonatakis@suse.com>
> And also thanks to patch reviewers:
> git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
> 111 Petr Vorel <pvorel@suse.cz>
> 70 Cyril Hrubis <chrubis@suse.cz>
> 47 Li Wang <liwang@redhat.com>
> 35 Richard Palethorpe <rpalethorpe@suse.com>
> 14 Martin Doucha <mdoucha@suse.cz>
> 8 Amir Goldstein <amir73il@gmail.com>
> 7 Xiao Yang <yangx.jy@fujitsu.com>
> 7 Marius Kittler <mkittler@suse.de>
> 6 Jan Kara <jack@suse.cz>
> 4 Avinesh Kumar <akumar@suse.de>
> 3 Andrea Cervesato <andrea.cervesato@suse.com>
> 3 Jan Stancek <jstancek@redhat.com>
> 2 Yang Xu <xuyang2018.jy@fujitsu.com>
> 1 Petr Vorel <petr.vorel@gmail.com>
> 1 Christian Brauner <brauner@kernel.org>
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [LTP] [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024
2024-02-03 23:57 ` [LTP] " Petr Vorel
@ 2024-02-05 11:04 ` Petr Vorel
0 siblings, 0 replies; 3+ messages in thread
From: Petr Vorel @ 2024-02-05 11:04 UTC (permalink / raw)
To: Cyril Hrubis, ltp, linux-kernel, libc-alpha, lwn, automated-testing
Cc: Andrea Cervesato
Hi all,
> Hi all,
> > Good news everyone,
> > the Linux Test Project test suite stable release for *January 2024* has been
> > released.
> > Since the last release 315 patches by 34 authors were merged.
> > Patch review is what most of the projects struggle with and LTP is no
> > different. If you can spare some effort helping with the patch review is more
> > than welcomed.
> > NOTABLE CHANGES
> > ===============
> FYI, there is missing removal of runtest/connectors [1], which can break some
> tooling.
And we removed also runtest/fsx [2] in this release.
Kind regards,
Petr
> Kind regards,
> Petr
> [1] https://github.com/linux-test-project/ltp/commit/9b642d89c0bcf5885b051c2d5768fa94b61d86cb
[2] https://github.com/linux-test-project/ltp/commit/fb2b6a0b3c840aa80229acf4360b7bdc3ced5edb
...
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2024-02-05 11:04 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2024-01-30 11:13 [ANNOUNCE] The Linux Test Project has been released for JANUARY 2024 Cyril Hrubis
2024-02-03 23:57 ` [LTP] " Petr Vorel
2024-02-05 11:04 ` Petr Vorel
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).