From patchwork Thu Feb 3 08:18:15 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Palethorpe X-Patchwork-Id: 1587910 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=suse.com header.i=@suse.com header.a=rsa-sha256 header.s=susede1 header.b=uhL+IwTW; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=213.254.12.146; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Received: from picard.linux.it (picard.linux.it [213.254.12.146]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4JqBQv0zkgz9s8s for ; Thu, 3 Feb 2022 19:19:18 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id B127D3C98E4 for ; Thu, 3 Feb 2022 09:19:16 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-7.smtp.seeweb.it (in-7.smtp.seeweb.it [217.194.8.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id 71AD83C8F8A for ; Thu, 3 Feb 2022 09:19:14 +0100 (CET) Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-7.smtp.seeweb.it (Postfix) with ESMTPS id BF237200906 for ; Thu, 3 Feb 2022 09:19:13 +0100 (CET) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out1.suse.de (Postfix) with ESMTP id 259FC21111; Thu, 3 Feb 2022 08:19:13 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1643876353; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=CU37hbo2o5J4fj6vIv/MqGp+YElKsr4wEuMIDGj4Lu4=; b=uhL+IwTWkF4MzN+DpswAy9+ol31r+R7rbh0NJCCO6aCXH80Gef+4zo6q7uo8t7y5VGSxiK x09Z5UMY3lhCJhllnpST1cjFjCJ7FESq3olq9xqHcLxA8Oe+Ak91kGZ1f8WUH79QTzlFhv R7w8se45WY9Y3goazUYOJAPqYZ4xvgE= Received: from g78.suse.de (unknown [10.163.24.138]) by relay2.suse.de (Postfix) with ESMTP id E95E9A3B81; Thu, 3 Feb 2022 08:19:12 +0000 (UTC) To: ltp@lists.linux.it Date: Thu, 3 Feb 2022 08:18:15 +0000 Message-Id: <20220203081820.29521-2-rpalethorpe@suse.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220203081820.29521-1-rpalethorpe@suse.com> References: <20220203081820.29521-1-rpalethorpe@suse.com> MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-7.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-7.smtp.seeweb.it Subject: [LTP] [PATCH v2 1/5] memcontrol: Lift out some common definitions into a shared header X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Richard Palethorpe via ltp From: Richard Palethorpe Reply-To: Richard Palethorpe Cc: Richard Palethorpe Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" Some simple functions can be shared between tests. The original selftests share a bit more. However this doesn't make as much sense in LTP due to library differences. Signed-off-by: Richard Palethorpe Reviewed-by: Cyril Hrubis Reviewed-by: Li Wang --- .../kernel/controllers/memcg/memcontrol02.c | 32 +------------ .../controllers/memcg/memcontrol_common.h | 48 +++++++++++++++++++ 2 files changed, 49 insertions(+), 31 deletions(-) create mode 100644 testcases/kernel/controllers/memcg/memcontrol_common.h diff --git a/testcases/kernel/controllers/memcg/memcontrol02.c b/testcases/kernel/controllers/memcg/memcontrol02.c index 548f36829..d5a24cc0a 100644 --- a/testcases/kernel/controllers/memcg/memcontrol02.c +++ b/testcases/kernel/controllers/memcg/memcontrol02.c @@ -23,14 +23,7 @@ */ #define _GNU_SOURCE -#include -#include - -#include "tst_test.h" -#include "tst_cgroup.h" - -#define TMPDIR "mntdir" -#define MB(x) (x << 20) +#include "memcontrol_common.h" static size_t page_size; static const struct tst_cgroup_group *cg_test; @@ -38,20 +31,6 @@ static struct tst_cgroup_group *cg_child; static int fd; static int file_to_all_error = 10; -/* - * Checks if two given values differ by less than err% of their - * sum. An extra percent is added for every doubling of the page size - * to compensate for wastage in page sized allocations. - */ -static inline int values_close(const ssize_t a, - const ssize_t b, - const ssize_t err) -{ - const ssize_t page_adjusted_err = ffs(page_size >> 13) + err; - - return 100 * labs(a - b) <= (a + b) * page_adjusted_err; -} - static void alloc_anon_50M_check(void) { const ssize_t size = MB(50); @@ -78,15 +57,6 @@ static void alloc_anon_50M_check(void) current, anon); } -static void alloc_pagecache(const int fd, size_t size) -{ - char buf[BUFSIZ]; - size_t i; - - for (i = 0; i < size; i += sizeof(buf)) - SAFE_WRITE(1, fd, buf, sizeof(buf)); -} - static void alloc_pagecache_50M_check(void) { const size_t size = MB(50); diff --git a/testcases/kernel/controllers/memcg/memcontrol_common.h b/testcases/kernel/controllers/memcg/memcontrol_common.h new file mode 100644 index 000000000..67f3ca318 --- /dev/null +++ b/testcases/kernel/controllers/memcg/memcontrol_common.h @@ -0,0 +1,48 @@ +// SPDX-License-Identifier: GPL-2.0 + +#include +#include + +#include "tst_test.h" +#include "tst_cgroup.h" + +#define TMPDIR "mntdir" +#define MB(x) (x << 20) + +/* + * Checks if two given values differ by less than err% of their + * sum. An extra percent is added for every doubling of the page size + * to compensate for wastage in page sized allocations. + */ +static inline int values_close(const ssize_t a, + const ssize_t b, + const ssize_t err) +{ + const size_t page_size = SAFE_SYSCONF(_SC_PAGESIZE); + const ssize_t page_adjusted_err = ffs(page_size >> 13) + err; + + return 100 * labs(a - b) <= (a + b) * page_adjusted_err; +} + +static inline void alloc_pagecache(const int fd, size_t size) +{ + char buf[BUFSIZ]; + size_t i; + + SAFE_LSEEK(fd, 0, SEEK_END); + + for (i = 0; i < size; i += sizeof(buf)) + SAFE_WRITE(1, fd, buf, sizeof(buf)); +} + +static inline void alloc_anon(const size_t size) +{ + const size_t page_size = SAFE_SYSCONF(_SC_PAGESIZE); + char *const buf = SAFE_MALLOC(size); + size_t i; + + for (i = 0; i < size; i += page_size) + buf[i] = 0; + + free(buf); +} From patchwork Thu Feb 3 08:18:16 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Palethorpe X-Patchwork-Id: 1587916 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=suse.com header.i=@suse.com header.a=rsa-sha256 header.s=susede1 header.b=QzYTm/uM; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=2001:1418:10:5::2; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Received: from picard.linux.it (picard.linux.it [IPv6:2001:1418:10:5::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4JqBS15Qlgz9s8s for ; Thu, 3 Feb 2022 19:20:17 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id 331303C98FD for ; Thu, 3 Feb 2022 09:20:15 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-5.smtp.seeweb.it (in-5.smtp.seeweb.it [217.194.8.5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id D3A883C98DB for ; Thu, 3 Feb 2022 09:19:15 +0100 (CET) Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-5.smtp.seeweb.it (Postfix) with ESMTPS id 214C060092B for ; Thu, 3 Feb 2022 09:19:14 +0100 (CET) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out1.suse.de (Postfix) with ESMTP id B639821114; Thu, 3 Feb 2022 08:19:13 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1643876353; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w6PYiLijEmVV00nVBjIzQe0iw9UUyHU2Unorxtk7928=; b=QzYTm/uMnsemAHuirsvGeCi8FpTdJ61RfF6oaBzio7FYOz+6UYqYVXou3eqtSyX/9G/daO +NW59H0rhd5xqQkosVPyEOFSivSzDl64w1EzluBUqQ23RvO4vHpLlxmvqNQNIZSVEhrGrX 9weH2iM5meSAmlNEnLAjGKanknOs9D4= Received: from g78.suse.de (unknown [10.163.24.138]) by relay2.suse.de (Postfix) with ESMTP id 39C70A3B81; Thu, 3 Feb 2022 08:19:13 +0000 (UTC) To: ltp@lists.linux.it Date: Thu, 3 Feb 2022 08:18:16 +0000 Message-Id: <20220203081820.29521-3-rpalethorpe@suse.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220203081820.29521-1-rpalethorpe@suse.com> References: <20220203081820.29521-1-rpalethorpe@suse.com> MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-5.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-5.smtp.seeweb.it Subject: [LTP] [PATCH v2 2/5] API/cgroup: Declare required controllers and version in test struct X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Richard Palethorpe via ltp From: Richard Palethorpe Reply-To: Richard Palethorpe Cc: Richard Palethorpe Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" This allows the test author to declaratively specify the required CGroup controllers in struct tst_test. Also they can optionally specify the CGroup API version. In some cases this removes any need for a setup function. It also adds CGroup information to the meta-data. In theory its possible to require that only one controller is on a particular version while others are free to be on any. Currently this would still need to be handled by calling tst_cgroup_require() and checking the controller version. So far we do not have any tests which need to be run in such a hybrid scenario. Usually if V2 and V1 are mounted at once, V2 is empty. So this does not complicate the declaration by allowing the version to be specified on a per controller basis. Signed-off-by: Richard Palethorpe Reviewed-by: Cyril Hrubis --- doc/c-test-api.txt | 101 ++++++++---------- include/tst_cgroup.h | 33 +++--- include/tst_test.h | 14 +++ lib/newlib_tests/tst_cgroup01.c | 2 +- lib/newlib_tests/tst_cgroup02.c | 26 +++-- lib/tst_cgroup.c | 55 ++++++---- lib/tst_test.c | 22 ++++ .../kernel/controllers/memcg/memcontrol01.c | 19 +--- .../kernel/controllers/memcg/memcontrol02.c | 13 +-- testcases/kernel/mem/cpuset/cpuset01.c | 25 ++--- testcases/kernel/mem/ksm/ksm02.c | 19 ++-- testcases/kernel/mem/ksm/ksm03.c | 13 +-- testcases/kernel/mem/ksm/ksm04.c | 16 ++- testcases/kernel/mem/oom/oom03.c | 24 ++--- testcases/kernel/mem/oom/oom04.c | 15 +-- testcases/kernel/mem/oom/oom05.c | 34 +++--- .../sched/cfs-scheduler/cfs_bandwidth01.c | 10 +- testcases/kernel/syscalls/madvise/madvise06.c | 28 ++--- 18 files changed, 217 insertions(+), 252 deletions(-) diff --git a/doc/c-test-api.txt b/doc/c-test-api.txt index 6f4de3f80..5e1813eb1 100644 --- a/doc/c-test-api.txt +++ b/doc/c-test-api.txt @@ -2056,11 +2056,13 @@ the field value of file. 1.36 Using Control Group ~~~~~~~~~~~~~~~~~~~~~~~~ -Some LTP tests need specific Control Group configurations. tst_cgroup.h provides -APIs to discover and use CGroups. There are many differences between CGroups API -V1 and V2. We encapsulate the details of configuring CGroups in high-level -functions which follow the V2 kernel API. Allowing one to use CGroups without -caring too much about the current system's configuration. +Some LTP tests need specific Control Group configurations. 'tst_cgroup.h' +provides APIs to discover and use CGroups. There are many differences between +CGroups API V1 and V2. We encapsulate the details of configuring CGroups in +high-level functions which follow the V2 kernel API where possible. Allowing one +to write code that works on both V1 or V2. At least some of the time anyway; +often the behavioural differences between V1 and V2 are too great. In such cases +we revert to branching on the CGroup version. Also, the LTP library will automatically mount/umount and configure the CGroup hierarchies if that is required (e.g. if you run the tests from init with no @@ -2071,8 +2073,6 @@ system manager). #include "tst_test.h" #include "tst_cgroup.h" -static const struct tst_cgroup_group *cg; - static void run(void) { ... @@ -2082,34 +2082,24 @@ static void run(void) static void setup(void) { - tst_cgroup_require("memory", NULL); - cg = tst_cgroup_get_test_group(); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); - SAFE_CGROUP_PRINTF(cg, "memory.max", "%lu", MEMSIZE); - if (SAFE_CGROUP_HAS(cg, "memory.swap.max")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%zu", memsw); -} - -static void cleanup(void) -{ - tst_cgroup_cleanup(); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%lu", MEMSIZE); + if (SAFE_CGROUP_HAS(tst_cgroup, "memory.swap.max")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%zu", memsw); } struct tst_test test = { .setup = setup, .test_all = run, .cleanup = cleanup, + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, ... }; ------------------------------------------------------------------------------- Above, we first ensure the memory controller is available on the -test's CGroup with 'tst_cgroup_require'. We then get a structure, -'cg', which represents the test's CGroup. Note that -'tst_cgroup_get_test_group' should not be called many times, as it is -allocated in a guarded buffer (See section 2.2.31). Therefor it is -best to call it once in 'setup' and not 'run' because 'run' may be -repeated with the '-i' option. +test's CGroup with '.needs_cgroup_controllers'. This populates a structure, +'tst_cgroup', which represents the test's CGroup. We then write the current processes PID into 'cgroup.procs', which moves the current process into the test's CGroup. After which we set @@ -2129,8 +2119,6 @@ cleanup is also mostly hidden. However things can get much worse. [source,c] ------------------------------------------------------------------------------- -static const struct tst_cgroup_group *cg; -static const struct tst_cgroup_group *cg_drain; static struct tst_cgroup_group *cg_child; static void run(void) @@ -2138,19 +2126,21 @@ static void run(void) char buf[BUFSIZ]; size_t mem = 0; - cg_child = tst_cgroup_group_mk(cg, "child"); + cg_child = tst_cgroup_group_mk(tst_cgroup, "child"); SAFE_CGROUP_PRINTF(cg_child, "cgroup.procs", "%d", getpid()); - if (!TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINT(cg, "cgroup.subtree_control", "+memory"); - if (!TST_CGROUP_VER_IS_V1(cg, "cpuset")) - SAFE_CGROUP_PRINT(cg, "cgroup.subtree_control", "+cpuset"); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINT(tst_cgroup, "cgroup.subtree_control", "+memory"); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "cpuset")) + SAFE_CGROUP_PRINT(tst_cgroup, "cgroup.subtree_control", "+cpuset"); if (!SAFE_FORK()) { SAFE_CGROUP_PRINTF(cg_child, "cgroup.procs", "%d", getpid()); - if (SAFE_CGROUP_HAS(cg_child, "memory.swap")) - SAFE_CGROUP_SCANF(cg_child, "memory.swap.current", "%zu", &mem); + if (SAFE_CGROUP_HAS(cg_child, "memory.swap")) { + SAFE_CGROUP_SCANF(cg_child, + "memory.swap.current", "%zu", &mem); + } SAFE_CGROUP_READ(cg_child, "cpuset.mems", buf, sizeof(buf)); // Do something with cpuset.mems and memory.current values @@ -2160,44 +2150,42 @@ static void run(void) } tst_reap_children(); - SAFE_CGROUP_PRINTF(cg_drain, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup_drain, "cgroup.procs", "%d", getpid()); cg_child = tst_cgroup_group_rm(cg_child); } -static void setup(void) -{ - tst_cgroup_require("memory", NULL); - tst_cgroup_require("cpuset", NULL); - - cg = tst_cgroup_get_test_group(); - cg_drain = tst_cgroup_get_drain_group(); -} - static void cleanup(void) { if (cg_child) { - SAFE_CGROUP_PRINTF(cg_drain, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup_drain, "cgroup.procs", "%d", getpid()); cg_child = tst_cgroup_group_rm(cg_child); } - - tst_cgroup_cleanup(); } struct tst_test test = { .setup = setup, .test_all = run, - .cleanup = cleanup, + .needs_cgroup_controllers = (const char *const []){ + "cpuset", + "memory", + NULL + }, ... }; ------------------------------------------------------------------------------- -Starting with setup; we can see here that we also fetch the 'drain' +Starting with setup; we can see here that we fetch the 'drain' CGroup. This is a shared group (between parallel tests) which may -contain processes from other tests. It should have default settings and -these should not be changed by the test. It can be used to remove +contain processes from other tests. It should have default settings +and these should not be changed by the test. It can be used to remove processes from other CGroups incase the hierarchy root is not accessible. +Note that 'tst_cgroup_get_drain_group' should not be called many times, +as it is allocated in a guarded buffer (See section 2.2.31). Therefor +it is best to call it once in 'setup' and not 'run' because 'run' may +be repeated with the '-i' option. + In 'run', we first create a child CGroup with 'tst_cgroup_mk'. As we create this CGroup in 'run' we should also remove it at the end of run. We also need to check if it exists and remove it in cleanup as @@ -2229,22 +2217,23 @@ destroying the child CGroup. So there is no need to transfer the child to drain. However the parent process must be moved otherwise we will get 'EBUSY' when trying to remove the child CGroup. -Another example of an edge case is the following. +Another example of a behavioral difference between versions is shown below. [source,c] ------------------------------------------------------------------------------- - if (TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", ~0UL); + if (TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", ~0UL); else - SAFE_CGROUP_PRINT(cg, "memory.swap.max", "max"); + SAFE_CGROUP_PRINT(tst_cgroup, "memory.swap.max", "max"); ------------------------------------------------------------------------------- CGroups V2 introduced a feature where 'memory[.swap].max' could be set to "max". This does not appear to work on V1 'limit_in_bytes' however. For most tests, simply using a large number is sufficient and there is no need to use "max". Importantly though, one should be careful to read both the V1 and V2 -kernel docs. The LTP library can not handle all edge cases. It does the minimal -amount of work to make testing on both V1 and V2 feasible. +kernel docs. Presently the LTP library does not attempt to handle most +differences in semantics. It does the minimal amount of work to make testing on +both V1 and V2 feasible. 1.37 Require minimum numbers of CPU for a testcase ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ diff --git a/include/tst_cgroup.h b/include/tst_cgroup.h index 5190d8794..17adefd2b 100644 --- a/include/tst_cgroup.h +++ b/include/tst_cgroup.h @@ -83,26 +83,23 @@ #include -/* CGroups Kernel API version */ -enum tst_cgroup_ver { - TST_CGROUP_V1 = 1, - TST_CGROUP_V2 = 2, -}; - /* Used to specify CGroup hierarchy configuration options, allowing a * test to request a particular CGroup structure. */ struct tst_cgroup_opts { - /* Only try to mount V1 CGroup controllers. This will not - * prevent V2 from being used if it is already mounted, it - * only indicates that we should mount V1 controllers if - * nothing is present. By default we try to mount V2 first. */ - int only_mount_v1:1; + /* Call tst_brk with TCONF if the controller is not on this + * version. Defautls to zero to accept any version. + */ + enum tst_cgroup_ver needs_ver; }; /* A Control Group in LTP's aggregated hierarchy */ struct tst_cgroup_group; +/* Populated with a reference to this tests's CGroup */ +extern const struct tst_cgroup_group *const tst_cgroup; +extern const struct tst_cgroup_group *const tst_cgroup_drain; + /* Search the system for mounted cgroups and available * controllers. Called automatically by tst_cgroup_require. */ @@ -111,7 +108,9 @@ void tst_cgroup_scan(void); void tst_cgroup_print_config(void); /* Ensure the specified controller is available in the test's default - * CGroup, mounting/enabling it if necessary */ + * CGroup, mounting/enabling it if necessary. Usually this is not + * necesary use tst_test.needs_cgroup_controllers instead. + */ void tst_cgroup_require(const char *const ctrl_name, const struct tst_cgroup_opts *const options) __attribute__ ((nonnull (1))); @@ -119,14 +118,10 @@ void tst_cgroup_require(const char *const ctrl_name, /* Tear down any CGroups created by calls to tst_cgroup_require */ void tst_cgroup_cleanup(void); -/* Get the default CGroup for the test. It allocates memory (in a - * guarded buffer) so should always be called from setup +/* Call this in setup after you call tst_cgroup_require and want to + * initialize tst_cgroup and tst_cgroup_drain. See tst_cgroup_require. */ -const struct tst_cgroup_group *tst_cgroup_get_test_group(void) - __attribute__ ((warn_unused_result)); -/* Get the shared drain group. Also should be called from setup */ -const struct tst_cgroup_group *tst_cgroup_get_drain_group(void) - __attribute__ ((warn_unused_result)); +void tst_cgroup_init(void); /* Create a descendant CGroup */ struct tst_cgroup_group * diff --git a/include/tst_test.h b/include/tst_test.h index 450ddf086..62d3c7920 100644 --- a/include/tst_test.h +++ b/include/tst_test.h @@ -133,6 +133,14 @@ extern unsigned int tst_variant; #define TST_NO_HUGEPAGES ((unsigned long)-1) +/* CGroups Kernel API version */ +enum tst_cgroup_ver { + TST_CGROUP_V1 = 1, + TST_CGROUP_V2 = 2, +}; + +struct tst_cgroup_group; + struct tst_test { /* number of tests available in test() function */ unsigned int tcnt; @@ -280,6 +288,12 @@ struct tst_test { /* NULL terminated array of required commands */ const char *const *needs_cmds; + + /* Requires a particular CGroup API version. */ + const enum tst_cgroup_ver needs_cgroup_ver; + + /* {} terminated array of required CGroup controllers */ + const char *const *needs_cgroup_controllers; }; /* diff --git a/lib/newlib_tests/tst_cgroup01.c b/lib/newlib_tests/tst_cgroup01.c index 54a370362..62df9aab2 100644 --- a/lib/newlib_tests/tst_cgroup01.c +++ b/lib/newlib_tests/tst_cgroup01.c @@ -22,7 +22,7 @@ static void do_test(void) static void setup(void) { - cgopts.only_mount_v1 = !!only_mount_v1, + cgopts.needs_ver = !!only_mount_v1 ? TST_CGROUP_V1 : 0; tst_cgroup_scan(); tst_cgroup_print_config(); diff --git a/lib/newlib_tests/tst_cgroup02.c b/lib/newlib_tests/tst_cgroup02.c index 64b0a1e94..d048c720a 100644 --- a/lib/newlib_tests/tst_cgroup02.c +++ b/lib/newlib_tests/tst_cgroup02.c @@ -15,8 +15,6 @@ static struct tst_option opts[] = { {NULL, NULL, NULL}, }; static struct tst_cgroup_opts cgopts; -static const struct tst_cgroup_group *cg; -static const struct tst_cgroup_group *cg_drain; static struct tst_cgroup_group *cg_child; static void do_test(void) @@ -24,12 +22,12 @@ static void do_test(void) char buf[BUFSIZ]; size_t mem; - if (!TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINT(cg, "cgroup.subtree_control", "+memory"); - if (!TST_CGROUP_VER_IS_V1(cg, "cpuset")) - SAFE_CGROUP_PRINT(cg, "cgroup.subtree_control", "+cpuset"); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINT(tst_cgroup, "cgroup.subtree_control", "+memory"); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "cpuset")) + SAFE_CGROUP_PRINT(tst_cgroup, "cgroup.subtree_control", "+cpuset"); - cg_child = tst_cgroup_group_mk(cg, "child"); + cg_child = tst_cgroup_group_mk(tst_cgroup, "child"); if (!SAFE_FORK()) { SAFE_CGROUP_PRINTF(cg_child, "cgroup.procs", "%d", getpid()); @@ -47,19 +45,19 @@ static void do_test(void) exit(0); } - SAFE_CGROUP_PRINTF(cg, "memory.max", "%zu", (1UL << 24) - 1); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%zu", (1UL << 24) - 1); SAFE_CGROUP_PRINTF(cg_child, "cgroup.procs", "%d", getpid()); - SAFE_CGROUP_SCANF(cg, "memory.current", "%zu", &mem); + SAFE_CGROUP_SCANF(tst_cgroup, "memory.current", "%zu", &mem); tst_res(TPASS, "memory.current = %zu", mem); tst_reap_children(); - SAFE_CGROUP_PRINTF(cg_drain, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup_drain, "cgroup.procs", "%d", getpid()); cg_child = tst_cgroup_group_rm(cg_child); } static void setup(void) { - cgopts.only_mount_v1 = !!only_mount_v1, + cgopts.needs_ver = !!only_mount_v1 ? TST_CGROUP_V1 : 0; tst_cgroup_scan(); tst_cgroup_print_config(); @@ -67,14 +65,14 @@ static void setup(void) tst_cgroup_require("memory", &cgopts); tst_cgroup_require("cpuset", &cgopts); - cg = tst_cgroup_get_test_group(); - cg_drain = tst_cgroup_get_drain_group(); + tst_cgroup_init(); } static void cleanup(void) { if (cg_child) { - SAFE_CGROUP_PRINTF(cg_drain, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup_drain, + "cgroup.procs", "%d", getpid()); cg_child = tst_cgroup_group_rm(cg_child); } if (!no_cleanup) diff --git a/lib/tst_cgroup.c b/lib/tst_cgroup.c index 10b65364b..e694d353b 100644 --- a/lib/tst_cgroup.c +++ b/lib/tst_cgroup.c @@ -138,6 +138,14 @@ struct tst_cgroup_group { struct cgroup_dir *dirs[ROOTS_MAX + 1]; }; +/* If controllers are required via the tst_test struct then this is + * populated with the test's CGroup. + */ +static struct tst_cgroup_group test_group; +static struct tst_cgroup_group drain_group; +const struct tst_cgroup_group *const tst_cgroup = &test_group; +const struct tst_cgroup_group *const tst_cgroup_drain = &drain_group; + /* Always use first item for unified hierarchy */ static struct cgroup_root roots[ROOTS_MAX + 1]; @@ -196,7 +204,7 @@ static struct cgroup_ctrl controllers[] = { { } }; -static const struct tst_cgroup_opts default_opts = { 0 }; +static const struct tst_cgroup_opts default_opts; /* We should probably allow these to be set in environment * variables @@ -623,13 +631,14 @@ void tst_cgroup_require(const char *const ctrl_name, if (ctrl->ctrl_root) goto mkdirs; - if (!cgroup_v2_mounted() && !options->only_mount_v1) + if (!cgroup_v2_mounted() && options->needs_ver != TST_CGROUP_V1) cgroup_mount_v2(); if (ctrl->ctrl_root) goto mkdirs; - cgroup_mount_v1(ctrl); + if (options->needs_ver != TST_CGROUP_V2) + cgroup_mount_v1(ctrl); if (!ctrl->ctrl_root) { tst_brk(TCONF, @@ -642,6 +651,17 @@ mkdirs: root = ctrl->ctrl_root; add_ctrl(&root->mnt_dir.ctrl_field, ctrl); + if (cgroup_ctrl_on_v2(ctrl) && options->needs_ver == TST_CGROUP_V1) { + tst_brk(TCONF, + "V1 '%s' controller required, but it's mounted on V2", + ctrl->ctrl_name); + } + if (!cgroup_ctrl_on_v2(ctrl) && options->needs_ver == TST_CGROUP_V2) { + tst_brk(TCONF, + "V2 '%s' controller required, but it's mounted on V1", + ctrl->ctrl_name); + } + if (cgroup_ctrl_on_v2(ctrl)) { if (root->we_mounted_it) { SAFE_FILE_PRINTFAT(root->mnt_dir.dir_fd, @@ -1028,18 +1048,19 @@ int safe_cgroup_has(const char *const file, const int lineno, return 0; } -__attribute__ ((warn_unused_result)) -static struct tst_cgroup_group *cgroup_group_from_roots(const size_t tree_off) +static void group_from_roots(struct tst_cgroup_group *const cg) { struct cgroup_root *root; - struct cgroup_dir *dir; - struct tst_cgroup_group *cg; - cg = tst_alloc(sizeof(*cg)); - cgroup_group_init(cg, NULL); + if (cg->group_name[0]) { + tst_brk(TBROK, + "%s CGroup already initialized", + cg == &test_group ? "Test" : "Drain"); + } for_each_root(root) { - dir = (typeof(dir))(((char *)root) + tree_off); + struct cgroup_dir *dir = + cg == &test_group ? &root->test_dir : &root->drain_dir; if (dir->ctrl_field) cgroup_group_add_dir(NULL, cg, dir); @@ -1047,23 +1068,17 @@ static struct tst_cgroup_group *cgroup_group_from_roots(const size_t tree_off) if (cg->dirs[0]) { strncpy(cg->group_name, cg->dirs[0]->dir_name, NAME_MAX); - return cg; + return; } tst_brk(TBROK, "No CGroups found; maybe you forgot to call tst_cgroup_require?"); - - return cg; -} - -const struct tst_cgroup_group *tst_cgroup_get_test_group(void) -{ - return cgroup_group_from_roots(offsetof(struct cgroup_root, test_dir)); } -const struct tst_cgroup_group *tst_cgroup_get_drain_group(void) +void tst_cgroup_init(void) { - return cgroup_group_from_roots(offsetof(struct cgroup_root, drain_dir)); + group_from_roots(&test_group); + group_from_roots(&drain_group); } ssize_t safe_cgroup_read(const char *const file, const int lineno, diff --git a/lib/tst_test.c b/lib/tst_test.c index 844756fbd..7151d8182 100644 --- a/lib/tst_test.c +++ b/lib/tst_test.c @@ -30,6 +30,7 @@ #include "tst_sys_conf.h" #include "tst_kconfig.h" #include "tst_private.h" +#include "tst_cgroup.h" #include "old_resource.h" #include "old_device.h" #include "old_tmpdir.h" @@ -1013,6 +1014,19 @@ static void prepare_device(void) } } +static void do_cgroup_requires(void) +{ + const struct tst_cgroup_opts cg_opts = { + .needs_ver = tst_test->needs_cgroup_ver, + }; + const char *const *ctrl_names = tst_test->needs_cgroup_controllers; + + for (; *ctrl_names; ctrl_names++) + tst_cgroup_require(*ctrl_names, &cg_opts); + + tst_cgroup_init(); +} + static void do_setup(int argc, char *argv[]) { if (!tst_test) @@ -1165,6 +1179,11 @@ static void do_setup(int argc, char *argv[]) if (tst_test->taint_check) tst_taint_init(tst_test->taint_check); + + if (tst_test->needs_cgroup_controllers) + do_cgroup_requires(); + else if (tst_test->needs_cgroup_ver) + tst_brk(TBROK, "needs_cgroup_ver only works with needs_cgroup_controllers"); } static void do_test_setup(void) @@ -1198,6 +1217,9 @@ static void do_test_setup(void) static void do_cleanup(void) { + if (tst_test->needs_cgroup_controllers) + tst_cgroup_cleanup(); + if (ovl_mounted) SAFE_UMOUNT(OVL_MNT); diff --git a/testcases/kernel/controllers/memcg/memcontrol01.c b/testcases/kernel/controllers/memcg/memcontrol01.c index f3b45610e..b555242ce 100644 --- a/testcases/kernel/controllers/memcg/memcontrol01.c +++ b/testcases/kernel/controllers/memcg/memcontrol01.c @@ -18,15 +18,14 @@ #include "tst_test.h" #include "tst_cgroup.h" -static const struct tst_cgroup_group *cg_test; static struct tst_cgroup_group *parent, *child; static struct tst_cgroup_group *parent2, *child2; static void test_memcg_subtree_control(void) { - parent = tst_cgroup_group_mk(cg_test, "memcg_test_0"); + parent = tst_cgroup_group_mk(tst_cgroup, "memcg_test_0"); child = tst_cgroup_group_mk(parent, "memcg_test_1"); - parent2 = tst_cgroup_group_mk(cg_test, "memcg_test_2"); + parent2 = tst_cgroup_group_mk(tst_cgroup, "memcg_test_2"); child2 = tst_cgroup_group_mk(parent2, "memcg_test_3"); SAFE_CGROUP_PRINT(parent2, "cgroup.subtree_control", "-memory"); @@ -44,15 +43,6 @@ static void test_memcg_subtree_control(void) parent = tst_cgroup_group_rm(parent); } -static void setup(void) -{ - tst_cgroup_require("memory", NULL); - cg_test = tst_cgroup_get_test_group(); - - if (TST_CGROUP_VER_IS_V1(cg_test, "memory")) - tst_brk(TCONF, "V1 controllers do not have subtree control"); -} - static void cleanup(void) { if (child2) @@ -63,12 +53,11 @@ static void cleanup(void) child = tst_cgroup_group_rm(child); if (parent) parent = tst_cgroup_group_rm(parent); - - tst_cgroup_cleanup(); } static struct tst_test test = { - .setup = setup, .cleanup = cleanup, .test_all = test_memcg_subtree_control, + .needs_cgroup_ver = TST_CGROUP_V2, + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, }; diff --git a/testcases/kernel/controllers/memcg/memcontrol02.c b/testcases/kernel/controllers/memcg/memcontrol02.c index d5a24cc0a..4b704efc6 100644 --- a/testcases/kernel/controllers/memcg/memcontrol02.c +++ b/testcases/kernel/controllers/memcg/memcontrol02.c @@ -26,7 +26,6 @@ #include "memcontrol_common.h" static size_t page_size; -static const struct tst_cgroup_group *cg_test; static struct tst_cgroup_group *cg_child; static int fd; static int file_to_all_error = 10; @@ -37,7 +36,7 @@ static void alloc_anon_50M_check(void) char *buf, *ptr; ssize_t anon, current; const char *const anon_key_fmt = - TST_CGROUP_VER_IS_V1(cg_test, "memory") ? "rss %zd" : "anon %zd"; + TST_CGROUP_VER_IS_V1(tst_cgroup, "memory") ? "rss %zd" : "anon %zd"; buf = SAFE_MALLOC(size); for (ptr = buf; ptr < buf + size; ptr += page_size) @@ -62,7 +61,7 @@ static void alloc_pagecache_50M_check(void) const size_t size = MB(50); size_t current, file; const char *const file_key_fmt = - TST_CGROUP_VER_IS_V1(cg_test, "memory") ? "cache %zd" : "file %zd"; + TST_CGROUP_VER_IS_V1(tst_cgroup, "memory") ? "cache %zd" : "file %zd"; fd = SAFE_OPEN(TMPDIR"/tmpfile", O_RDWR | O_CREAT, 0600); @@ -89,7 +88,7 @@ static void test_memcg_current(unsigned int n) { size_t current; - cg_child = tst_cgroup_group_mk(cg_test, "child"); + cg_child = tst_cgroup_group_mk(tst_cgroup, "child"); SAFE_CGROUP_SCANF(cg_child, "memory.current", "%zu", ¤t); TST_EXP_EXPR(current == 0, "(current=%zu) == 0", current); @@ -114,9 +113,6 @@ static void setup(void) { page_size = SAFE_SYSCONF(_SC_PAGESIZE); - tst_cgroup_require("memory", NULL); - cg_test = tst_cgroup_get_test_group(); - switch (tst_fs_type(TMPDIR)) { case TST_VFAT_MAGIC: case TST_EXFAT_MAGIC: @@ -130,8 +126,6 @@ static void cleanup(void) { if (cg_child) cg_child = tst_cgroup_group_rm(cg_child); - - tst_cgroup_cleanup(); } static struct tst_test test = { @@ -145,4 +139,5 @@ static struct tst_test test = { .all_filesystems = 1, .forks_child = 1, .needs_root = 1, + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, }; diff --git a/testcases/kernel/mem/cpuset/cpuset01.c b/testcases/kernel/mem/cpuset/cpuset01.c index 66c18f6ab..bcd06e3ea 100644 --- a/testcases/kernel/mem/cpuset/cpuset01.c +++ b/testcases/kernel/mem/cpuset/cpuset01.c @@ -35,8 +35,6 @@ #ifdef HAVE_NUMA_V2 -static const struct tst_cgroup_group *cg; - volatile int end; static int *nodes; static int nnodes; @@ -53,10 +51,10 @@ static void test_cpuset(void) unsigned long nmask[MAXNODES / BITS_PER_LONG] = { 0 }; char buf[BUFSIZ]; - SAFE_CGROUP_READ(cg, "cpuset.cpus", buf, sizeof(buf)); - SAFE_CGROUP_PRINT(cg, "cpuset.cpus", buf); - SAFE_CGROUP_READ(cg, "cpuset.mems", buf, sizeof(buf)); - SAFE_CGROUP_PRINT(cg, "cpuset.mems", buf); + SAFE_CGROUP_READ(tst_cgroup, "cpuset.cpus", buf, sizeof(buf)); + SAFE_CGROUP_PRINT(tst_cgroup, "cpuset.cpus", buf); + SAFE_CGROUP_READ(tst_cgroup, "cpuset.mems", buf, sizeof(buf)); + SAFE_CGROUP_PRINT(tst_cgroup, "cpuset.mems", buf); child = SAFE_FORK(); if (child == 0) { @@ -70,8 +68,8 @@ static void test_cpuset(void) exit(mem_hog_cpuset(ncpus > 1 ? ncpus : 1)); } - SAFE_CGROUP_PRINTF(cg, "cpuset.mems", "%d", nodes[0]); - SAFE_CGROUP_PRINTF(cg, "cpuset.mems", "%d", nodes[1]); + SAFE_CGROUP_PRINTF(tst_cgroup, "cpuset.mems", "%d", nodes[0]); + SAFE_CGROUP_PRINTF(tst_cgroup, "cpuset.mems", "%d", nodes[1]); tst_reap_children(); @@ -80,20 +78,13 @@ static void test_cpuset(void) static void setup(void) { - tst_cgroup_require("cpuset", NULL); ncpus = count_cpu(); if (get_allowed_nodes_arr(NH_MEMS | NH_CPUS, &nnodes, &nodes) < 0) tst_brk(TBROK | TERRNO, "get_allowed_nodes_arr"); if (nnodes <= 1) tst_brk(TCONF, "requires a NUMA system."); - cg = tst_cgroup_get_test_group(); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); -} - -static void cleanup(void) -{ - tst_cgroup_cleanup(); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); } static void sighandler(int signo LTP_ATTRIBUTE_UNUSED) @@ -183,9 +174,9 @@ static struct tst_test test = { .needs_root = 1, .forks_child = 1, .setup = setup, - .cleanup = cleanup, .test_all = test_cpuset, .min_kver = "2.6.32", + .needs_cgroup_controllers = (const char *const []){ "cpuset", NULL }, }; #else diff --git a/testcases/kernel/mem/ksm/ksm02.c b/testcases/kernel/mem/ksm/ksm02.c index c578cfb7f..e0b55042a 100644 --- a/testcases/kernel/mem/ksm/ksm02.c +++ b/testcases/kernel/mem/ksm/ksm02.c @@ -59,9 +59,6 @@ #ifdef HAVE_NUMA_V2 #include -static const struct tst_cgroup_group *cg; -static const struct tst_cgroup_group *cg_drain; - static void verify_ksm(void) { unsigned long nmask[MAXNODES / BITS_PER_LONG] = { 0 }; @@ -79,19 +76,18 @@ static void verify_ksm(void) } create_same_memory(size, num, unit); - write_cpusets(cg, node); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + write_cpusets(tst_cgroup, node); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); create_same_memory(size, num, unit); - SAFE_CGROUP_PRINTF(cg_drain, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup_drain, "cgroup.procs", "%d", getpid()); } static void cleanup(void) { - if (access(PATH_KSM "merge_across_nodes", F_OK) == 0) + if (access(PATH_KSM "merge_across_nodes", F_OK) == 0) { FILE_PRINTF(PATH_KSM "merge_across_nodes", "%d", merge_across_nodes); - - tst_cgroup_cleanup(); + } } static void setup(void) @@ -106,10 +102,6 @@ static void setup(void) "%d", &merge_across_nodes); SAFE_FILE_PRINTF(PATH_KSM "merge_across_nodes", "1"); } - - tst_cgroup_require("cpuset", NULL); - cg = tst_cgroup_get_test_group(); - cg_drain = tst_cgroup_get_drain_group(); } static struct tst_test test = { @@ -129,6 +121,7 @@ static struct tst_test test = { }, .test_all = verify_ksm, .min_kver = "2.6.32", + .needs_cgroup_controllers = (const char *const []){ "cpuset", NULL }, }; #else diff --git a/testcases/kernel/mem/ksm/ksm03.c b/testcases/kernel/mem/ksm/ksm03.c index df847cf95..efdc514f7 100644 --- a/testcases/kernel/mem/ksm/ksm03.c +++ b/testcases/kernel/mem/ksm/ksm03.c @@ -59,8 +59,6 @@ #include "mem.h" #include "ksm_common.h" -static const struct tst_cgroup_group *cg; - static void verify_ksm(void) { create_same_memory(size, num, unit); @@ -79,18 +77,16 @@ static void setup(void) parse_ksm_options(opt_sizestr, &size, opt_numstr, &num, opt_unitstr, &unit); - tst_cgroup_require("memory", NULL); - cg = tst_cgroup_get_test_group(); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); - SAFE_CGROUP_PRINTF(cg, "memory.max", "%lu", TESTMEM); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%lu", TESTMEM); } static void cleanup(void) { - if (access(PATH_KSM "merge_across_nodes", F_OK) == 0) + if (access(PATH_KSM "merge_across_nodes", F_OK) == 0) { FILE_PRINTF(PATH_KSM "merge_across_nodes", "%d", merge_across_nodes); - tst_cgroup_cleanup(); + } } static struct tst_test test = { @@ -110,4 +106,5 @@ static struct tst_test test = { }, .test_all = verify_ksm, .min_kver = "2.6.32", + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, }; diff --git a/testcases/kernel/mem/ksm/ksm04.c b/testcases/kernel/mem/ksm/ksm04.c index e8bc1de85..e2585b67b 100644 --- a/testcases/kernel/mem/ksm/ksm04.c +++ b/testcases/kernel/mem/ksm/ksm04.c @@ -59,8 +59,6 @@ #ifdef HAVE_NUMA_V2 #include -static const struct tst_cgroup_group *cg; - static void verify_ksm(void) { unsigned long nmask[MAXNODES / BITS_PER_LONG] = { 0 }; @@ -69,7 +67,7 @@ static void verify_ksm(void) node = get_a_numa_node(); set_node(nmask, node); - SAFE_CGROUP_PRINTF(cg, "memory.max", "%lu", TESTMEM); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%lu", TESTMEM); if (set_mempolicy(MPOL_BIND, nmask, MAXNODES) == -1) { if (errno != ENOSYS) @@ -80,7 +78,7 @@ static void verify_ksm(void) } create_same_memory(size, num, unit); - write_cpusets(cg, node); + write_cpusets(tst_cgroup, node); create_same_memory(size, num, unit); } @@ -89,8 +87,6 @@ static void cleanup(void) if (access(PATH_KSM "merge_across_nodes", F_OK) == 0) FILE_PRINTF(PATH_KSM "merge_across_nodes", "%d", merge_across_nodes); - - tst_cgroup_cleanup(); } static void setup(void) @@ -106,10 +102,7 @@ static void setup(void) parse_ksm_options(opt_sizestr, &size, opt_numstr, &num, opt_unitstr, &unit); - tst_cgroup_require("memory", NULL); - tst_cgroup_require("cpuset", NULL); - cg = tst_cgroup_get_test_group(); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); } static struct tst_test test = { @@ -129,6 +122,9 @@ static struct tst_test test = { }, .test_all = verify_ksm, .min_kver = "2.6.32", + .needs_cgroup_controllers = (const char *const []){ + "memory", "cpuset", NULL + }, }; #else diff --git a/testcases/kernel/mem/oom/oom03.c b/testcases/kernel/mem/oom/oom03.c index 451119166..a98539a94 100644 --- a/testcases/kernel/mem/oom/oom03.c +++ b/testcases/kernel/mem/oom/oom03.c @@ -36,8 +36,6 @@ #ifdef HAVE_NUMA_V2 -static const struct tst_cgroup_group *cg; - static void verify_oom(void) { #ifdef TST_ABI32 @@ -45,7 +43,7 @@ static void verify_oom(void) #endif testoom(0, 0, ENOMEM, 1); - if (SAFE_CGROUP_HAS(cg, "memory.swap.max")) { + if (SAFE_CGROUP_HAS(tst_cgroup, "memory.swap.max")) { tst_res(TINFO, "OOM on MEMCG with special memswap limitation:"); /* * Cgroup v2 tracks memory and swap in separate, which splits @@ -57,17 +55,17 @@ static void verify_oom(void) * let's scale down the value of 'memory.swap.max' to only * 1MB for CGroup v2. */ - if (!TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", MB); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", MB); else - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", TESTMEM + MB); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", TESTMEM + MB); testoom(0, 1, ENOMEM, 1); - if (TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", ~0UL); + if (TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", ~0UL); else - SAFE_CGROUP_PRINT(cg, "memory.swap.max", "max"); + SAFE_CGROUP_PRINT(tst_cgroup, "memory.swap.max", "max"); } /* OOM for MEMCG with mempolicy */ @@ -84,17 +82,14 @@ static void setup(void) overcommit = get_sys_tune("overcommit_memory"); set_sys_tune("overcommit_memory", 1, 1); - tst_cgroup_require("memory", NULL); - cg = tst_cgroup_get_test_group(); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); - SAFE_CGROUP_PRINTF(cg, "memory.max", "%lu", TESTMEM); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%lu", TESTMEM); } static void cleanup(void) { if (overcommit != -1) set_sys_tune("overcommit_memory", overcommit, 0); - tst_cgroup_cleanup(); } static struct tst_test test = { @@ -104,6 +99,7 @@ static struct tst_test test = { .setup = setup, .cleanup = cleanup, .test_all = verify_oom, + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, }; #else diff --git a/testcases/kernel/mem/oom/oom04.c b/testcases/kernel/mem/oom/oom04.c index f84328f5b..920cf4caa 100644 --- a/testcases/kernel/mem/oom/oom04.c +++ b/testcases/kernel/mem/oom/oom04.c @@ -36,8 +36,6 @@ #ifdef HAVE_NUMA_V2 -static const struct tst_cgroup_group *cg; - static void verify_oom(void) { #ifdef TST_ABI32 @@ -47,13 +45,13 @@ static void verify_oom(void) testoom(0, 0, ENOMEM, 1); if (is_numa(NULL, NH_MEMS, 2) && - SAFE_CGROUP_HAS(cg, "cpuset.memory_migrate")) { + SAFE_CGROUP_HAS(tst_cgroup, "cpuset.memory_migrate")) { /* * Under NUMA system, the migration of cpuset's memory * is in charge of cpuset.memory_migrate, we can write * 1 to cpuset.memory_migrate to enable the migration. */ - SAFE_CGROUP_PRINT(cg, "cpuset.memory_migrate", "1"); + SAFE_CGROUP_PRINT(tst_cgroup, "cpuset.memory_migrate", "1"); tst_res(TINFO, "OOM on CPUSET with mem migrate:"); testoom(0, 0, ENOMEM, 1); @@ -70,9 +68,6 @@ static void setup(void) overcommit = get_sys_tune("overcommit_memory"); set_sys_tune("overcommit_memory", 1, 1); - tst_cgroup_require("cpuset", NULL); - cg = tst_cgroup_get_test_group(); - /* * Some nodes do not contain memory, so use * get_allowed_nodes(NH_MEMS) to get a memory @@ -83,15 +78,14 @@ static void setup(void) if (ret < 0) tst_brk(TBROK, "Failed to get a memory node " "using get_allowed_nodes()"); - write_cpusets(cg, memnode); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + write_cpusets(tst_cgroup, memnode); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); } static void cleanup(void) { if (overcommit != -1) set_sys_tune("overcommit_memory", overcommit, 0); - tst_cgroup_cleanup(); } static struct tst_test test = { @@ -101,6 +95,7 @@ static struct tst_test test = { .setup = setup, .cleanup = cleanup, .test_all = verify_oom, + .needs_cgroup_controllers = (const char *const []){ "cpuset", NULL }, }; #else diff --git a/testcases/kernel/mem/oom/oom05.c b/testcases/kernel/mem/oom/oom05.c index 06497261e..1fcfaa4d8 100644 --- a/testcases/kernel/mem/oom/oom05.c +++ b/testcases/kernel/mem/oom/oom05.c @@ -36,8 +36,6 @@ #ifdef HAVE_NUMA_V2 -static const struct tst_cgroup_group *cg; - static void verify_oom(void) { #ifdef TST_ABI32 @@ -53,29 +51,29 @@ static void verify_oom(void) * 1 to cpuset.memory_migrate to enable the migration. */ if (is_numa(NULL, NH_MEMS, 2) && - SAFE_CGROUP_HAS(cg, "cpuset.memory_migrate")) { - SAFE_CGROUP_PRINT(cg, "cpuset.memory_migrate", "1"); + SAFE_CGROUP_HAS(tst_cgroup, "cpuset.memory_migrate")) { + SAFE_CGROUP_PRINT(tst_cgroup, "cpuset.memory_migrate", "1"); tst_res(TINFO, "OOM on CPUSET & MEMCG with " "cpuset.memory_migrate=1"); testoom(0, 0, ENOMEM, 1); } - if (SAFE_CGROUP_HAS(cg, "memory.swap.max")) { + if (SAFE_CGROUP_HAS(tst_cgroup, "memory.swap.max")) { tst_res(TINFO, "OOM on CPUSET & MEMCG with " "special memswap limitation:"); - if (!TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", MB); + if (!TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", MB); else - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", TESTMEM + MB); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", TESTMEM + MB); testoom(0, 1, ENOMEM, 1); tst_res(TINFO, "OOM on CPUSET & MEMCG with " "disabled memswap limitation:"); - if (TST_CGROUP_VER_IS_V1(cg, "memory")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%lu", ~0UL); + if (TST_CGROUP_VER_IS_V1(tst_cgroup, "memory")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%lu", ~0UL); else - SAFE_CGROUP_PRINT(cg, "memory.swap.max", "max"); + SAFE_CGROUP_PRINT(tst_cgroup, "memory.swap.max", "max"); testoom(0, 0, ENOMEM, 1); } } @@ -90,10 +88,6 @@ void setup(void) overcommit = get_sys_tune("overcommit_memory"); set_sys_tune("overcommit_memory", 1, 1); - tst_cgroup_require("memory", NULL); - tst_cgroup_require("cpuset", NULL); - cg = tst_cgroup_get_test_group(); - /* * Some nodes do not contain memory, so use * get_allowed_nodes(NH_MEMS) to get a memory @@ -105,16 +99,15 @@ void setup(void) tst_brk(TBROK, "Failed to get a memory node " "using get_allowed_nodes()"); - write_cpusets(cg, memnode); - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); - SAFE_CGROUP_PRINTF(cg, "memory.max", "%lu", TESTMEM); + write_cpusets(tst_cgroup, memnode); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%lu", TESTMEM); } void cleanup(void) { if (overcommit != -1) set_sys_tune("overcommit_memory", overcommit, 0); - tst_cgroup_cleanup(); } static struct tst_test test = { @@ -124,6 +117,9 @@ static struct tst_test test = { .setup = setup, .cleanup = cleanup, .test_all = verify_oom, + .needs_cgroup_controllers = (const char *const []){ + "memory", "cpuset", NULL + }, }; #else diff --git a/testcases/kernel/sched/cfs-scheduler/cfs_bandwidth01.c b/testcases/kernel/sched/cfs-scheduler/cfs_bandwidth01.c index e3eb237da..a7b52b67e 100644 --- a/testcases/kernel/sched/cfs-scheduler/cfs_bandwidth01.c +++ b/testcases/kernel/sched/cfs-scheduler/cfs_bandwidth01.c @@ -32,7 +32,6 @@ #include "tst_cgroup.h" #include "tst_timer.h" -static const struct tst_cgroup_group *cg_test; static struct tst_cgroup_group *cg_level2, *cg_level3a, *cg_level3b; static struct tst_cgroup_group *cg_workers[3]; static int may_have_waiters = 0; @@ -132,11 +131,7 @@ static void do_test(void) static void setup(void) { - tst_cgroup_require("cpu", NULL); - - cg_test = tst_cgroup_get_test_group(); - - cg_level2 = tst_cgroup_group_mk(cg_test, "level2"); + cg_level2 = tst_cgroup_group_mk(tst_cgroup, "level2"); cg_level3a = tst_cgroup_group_mk(cg_level2, "level3a"); mk_cpu_cgroup(&cg_workers[0], cg_level3a, "worker1", 30); @@ -167,8 +162,6 @@ static void cleanup(void) cg_level3b = tst_cgroup_group_rm(cg_level3b); if (cg_level2) cg_level2 = tst_cgroup_group_rm(cg_level2); - - tst_cgroup_cleanup(); } static struct tst_test test = { @@ -182,6 +175,7 @@ static struct tst_test test = { "CONFIG_CFS_BANDWIDTH", NULL }, + .needs_cgroup_controllers = (const char *const []){"cpu", NULL}, .tags = (const struct tst_tag[]) { {"linux-git", "39f23ce07b93"}, {"linux-git", "b34cb07dde7c"}, diff --git a/testcases/kernel/syscalls/madvise/madvise06.c b/testcases/kernel/syscalls/madvise/madvise06.c index 263b8e78b..a3e07feaa 100644 --- a/testcases/kernel/syscalls/madvise/madvise06.c +++ b/testcases/kernel/syscalls/madvise/madvise06.c @@ -56,8 +56,6 @@ #define PASS_THRESHOLD (CHUNK_SZ / 4) #define PASS_THRESHOLD_KB (PASS_THRESHOLD / 1024) -static const struct tst_cgroup_group *cg; - static const char drop_caches_fname[] = "/proc/sys/vm/drop_caches"; static int pg_sz, stat_refresh_sup; @@ -73,10 +71,10 @@ static void print_cgmem(const char *name) { long ret; - if (!SAFE_CGROUP_HAS(cg, name)) + if (!SAFE_CGROUP_HAS(tst_cgroup, name)) return; - SAFE_CGROUP_SCANF(cg, name, "%ld", &ret); + SAFE_CGROUP_SCANF(tst_cgroup, name, "%ld", &ret); tst_res(TINFO, "\t%s: %ld Kb", name, ret / 1024); } @@ -121,21 +119,18 @@ static void setup(void) check_path("/proc/self/oom_score_adj"); SAFE_FILE_PRINTF("/proc/self/oom_score_adj", "%d", -1000); - tst_cgroup_require("memory", NULL); - cg = tst_cgroup_get_test_group(); - - SAFE_CGROUP_PRINTF(cg, "memory.max", "%ld", MEM_LIMIT); - if (SAFE_CGROUP_HAS(cg, "memory.swap.max")) - SAFE_CGROUP_PRINTF(cg, "memory.swap.max", "%ld", MEMSW_LIMIT); + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.max", "%ld", MEM_LIMIT); + if (SAFE_CGROUP_HAS(tst_cgroup, "memory.swap.max")) + SAFE_CGROUP_PRINTF(tst_cgroup, "memory.swap.max", "%ld", MEMSW_LIMIT); - if (SAFE_CGROUP_HAS(cg, "memory.swappiness")) { - SAFE_CGROUP_PRINT(cg, "memory.swappiness", "60"); + if (SAFE_CGROUP_HAS(tst_cgroup, "memory.swappiness")) { + SAFE_CGROUP_PRINT(tst_cgroup, "memory.swappiness", "60"); } else { check_path("/proc/sys/vm/swappiness"); SAFE_FILE_PRINTF("/proc/sys/vm/swappiness", "%d", 60); } - SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + SAFE_CGROUP_PRINTF(tst_cgroup, "cgroup.procs", "%d", getpid()); meminfo_diag("Initial meminfo, later values are relative to this (except memcg)"); init_swap = SAFE_READ_MEMINFO("SwapTotal:") - SAFE_READ_MEMINFO("SwapFree:"); @@ -149,11 +144,6 @@ static void setup(void) CHUNK_SZ / 1024, CHUNK_SZ / pg_sz, MEM_LIMIT / 1024, PASS_THRESHOLD_KB); } -static void cleanup(void) -{ - tst_cgroup_cleanup(); -} - static void dirty_pages(char *ptr, long size) { long i; @@ -237,7 +227,6 @@ static void test_advice_willneed(void) static struct tst_test test = { .test_all = test_advice_willneed, .setup = setup, - .cleanup = cleanup, .min_kver = "3.10.0", .needs_tmpdir = 1, .needs_root = 1, @@ -245,6 +234,7 @@ static struct tst_test test = { "?/proc/sys/vm/swappiness", NULL }, + .needs_cgroup_controllers = (const char *const []){ "memory", NULL }, .tags = (const struct tst_tag[]) { {"linux-git", "55231e5c898c"}, {"linux-git", "8de15e920dc8"}, From patchwork Thu Feb 3 08:18:17 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Palethorpe X-Patchwork-Id: 1587912 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=suse.com header.i=@suse.com header.a=rsa-sha256 header.s=susede1 header.b=JwVWvMgW; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=2001:1418:10:5::2; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Received: from picard.linux.it (picard.linux.it [IPv6:2001:1418:10:5::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4JqBRH5rW7z9s8s for ; Thu, 3 Feb 2022 19:19:39 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id 57CC53C98F7 for ; Thu, 3 Feb 2022 09:19:37 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-4.smtp.seeweb.it (in-4.smtp.seeweb.it [217.194.8.4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id 160F63C8F8A for ; Thu, 3 Feb 2022 09:19:14 +0100 (CET) Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.220.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-4.smtp.seeweb.it (Postfix) with ESMTPS id 930071000CE0 for ; Thu, 3 Feb 2022 09:19:14 +0100 (CET) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out2.suse.de (Postfix) with ESMTP id 0E7751F3A5; Thu, 3 Feb 2022 08:19:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1643876354; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8SAG8HBXpsbufWgzHVjZDhIxNLatnQJ2OJj3o9pL1uU=; b=JwVWvMgWIU6pijWCu5WAFK0RqqH72+80vt8c47K8dMM4dNiA2epHYBYCClnZWgSNxWXXmr dfPlaAQdjv2t3VjofaxKwcEpHbqmrVodY7h5WsvQqI80oFnZm1WgPSEUZSccNel8IKKdmt EIsl691kU2WxPm79x9ODMUCX1PNGwt8= Received: from g78.suse.de (unknown [10.163.24.138]) by relay2.suse.de (Postfix) with ESMTP id C8F96A3B81; Thu, 3 Feb 2022 08:19:13 +0000 (UTC) To: ltp@lists.linux.it Date: Thu, 3 Feb 2022 08:18:17 +0000 Message-Id: <20220203081820.29521-4-rpalethorpe@suse.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220203081820.29521-1-rpalethorpe@suse.com> References: <20220203081820.29521-1-rpalethorpe@suse.com> MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-4.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-4.smtp.seeweb.it Subject: [LTP] [PATCH v2 3/5] API/cgroup: Add memory.min X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Richard Palethorpe via ltp From: Richard Palethorpe Reply-To: Richard Palethorpe Cc: Richard Palethorpe Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" Signed-off-by: Richard Palethorpe --- lib/tst_cgroup.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/lib/tst_cgroup.c b/lib/tst_cgroup.c index e694d353b..d9cd6aa8e 100644 --- a/lib/tst_cgroup.c +++ b/lib/tst_cgroup.c @@ -160,6 +160,7 @@ static const struct cgroup_file cgroup_ctrl_files[] = { static const struct cgroup_file memory_ctrl_files[] = { { "memory.current", "memory.usage_in_bytes", CTRL_MEMORY }, + { "memory.min", NULL, CTRL_MEMORY }, { "memory.max", "memory.limit_in_bytes", CTRL_MEMORY }, { "memory.stat", "memory.stat", CTRL_MEMORY }, { "memory.swappiness", "memory.swappiness", CTRL_MEMORY }, @@ -896,7 +897,7 @@ tst_cgroup_group_mk(const struct tst_cgroup_group *const parent, for_each_dir(parent, 0, dir) { new_dir = SAFE_MALLOC(sizeof(*new_dir)); - cgroup_dir_mk(*dir, group_name, new_dir); + cgroup_dir_mk(*dir, cg->group_name, new_dir); cgroup_group_add_dir(parent, cg, new_dir); } From patchwork Thu Feb 3 08:18:18 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Palethorpe X-Patchwork-Id: 1587913 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=suse.com header.i=@suse.com header.a=rsa-sha256 header.s=susede1 header.b=V+/nGBIv; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=2001:1418:10:5::2; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Received: from picard.linux.it (picard.linux.it [IPv6:2001:1418:10:5::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4JqBRT6Nzzz9s8s for ; Thu, 3 Feb 2022 19:19:49 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id 17AA43C98EE for ; Thu, 3 Feb 2022 09:19:47 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-4.smtp.seeweb.it (in-4.smtp.seeweb.it [IPv6:2001:4b78:1:20::4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id 77B5C3C8F8A for ; Thu, 3 Feb 2022 09:19:15 +0100 (CET) Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.220.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-4.smtp.seeweb.it (Postfix) with ESMTPS id AD3391000CEA for ; Thu, 3 Feb 2022 09:19:14 +0100 (CET) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out2.suse.de (Postfix) with ESMTP id 52ECF1F43D; Thu, 3 Feb 2022 08:19:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1643876354; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=G5U+PGl4JiYRrKRiSwFGxTU6DZohMXpM7JgxF2LJlfI=; b=V+/nGBIvZVMwLqs5Nkaidgg0XTObIdpnTslDW4xxyGlXTVuAnR4GvA3t1CWQFhFsFxIN5b H+XB4thl9MxOeqf8R9OGqsRojiGUMotr9kaq1R5F8rHC48yTvyFNd4D3CN3imIwhJsvT64 /wqLwPO6XsC7tGntqfGtd+Qu65WDSts= Received: from g78.suse.de (unknown [10.163.24.138]) by relay2.suse.de (Postfix) with ESMTP id 20F4CA3B81; Thu, 3 Feb 2022 08:19:14 +0000 (UTC) To: ltp@lists.linux.it Date: Thu, 3 Feb 2022 08:18:18 +0000 Message-Id: <20220203081820.29521-5-rpalethorpe@suse.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220203081820.29521-1-rpalethorpe@suse.com> References: <20220203081820.29521-1-rpalethorpe@suse.com> MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-4.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-4.smtp.seeweb.it Subject: [LTP] [PATCH v2 4/5] API/cgroup: Allow formatting of new cg names X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Richard Palethorpe via ltp From: Richard Palethorpe Reply-To: Richard Palethorpe Cc: Richard Palethorpe Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" Signed-off-by: Richard Palethorpe --- include/tst_cgroup.h | 5 +++-- lib/tst_cgroup.c | 29 ++++++++++++----------------- 2 files changed, 15 insertions(+), 19 deletions(-) diff --git a/include/tst_cgroup.h b/include/tst_cgroup.h index 17adefd2b..d7a3433fa 100644 --- a/include/tst_cgroup.h +++ b/include/tst_cgroup.h @@ -126,8 +126,9 @@ void tst_cgroup_init(void); /* Create a descendant CGroup */ struct tst_cgroup_group * tst_cgroup_group_mk(const struct tst_cgroup_group *const parent, - const char *const group_name) - __attribute__ ((nonnull, warn_unused_result)); + const char *const group_name_fmt, ...) + __attribute__ ((nonnull, warn_unused_result, format (printf, 2, 3))); + const char * tst_cgroup_group_name(const struct tst_cgroup_group *const cg) __attribute__ ((nonnull, warn_unused_result)); diff --git a/lib/tst_cgroup.c b/lib/tst_cgroup.c index d9cd6aa8e..66f17575e 100644 --- a/lib/tst_cgroup.c +++ b/lib/tst_cgroup.c @@ -840,21 +840,6 @@ clear_data: memset(roots, 0, sizeof(roots)); } -__attribute__((nonnull(1))) -static void cgroup_group_init(struct tst_cgroup_group *const cg, - const char *const group_name) -{ - memset(cg, 0, sizeof(*cg)); - - if (!group_name) - return; - - if (strlen(group_name) > NAME_MAX) - tst_brk(TBROK, "Group name is too long"); - - strcpy(cg->group_name, group_name); -} - __attribute__((nonnull(2, 3))) static void cgroup_group_add_dir(const struct tst_cgroup_group *const parent, struct tst_cgroup_group *const cg, @@ -886,14 +871,24 @@ static void cgroup_group_add_dir(const struct tst_cgroup_group *const parent, struct tst_cgroup_group * tst_cgroup_group_mk(const struct tst_cgroup_group *const parent, - const char *const group_name) + const char *const group_name_fmt, ...) { struct tst_cgroup_group *cg; struct cgroup_dir *const *dir; struct cgroup_dir *new_dir; + va_list ap; + size_t name_len; cg = SAFE_MALLOC(sizeof(*cg)); - cgroup_group_init(cg, group_name); + memset(cg, 0, sizeof(*cg)); + + va_start(ap, group_name_fmt); + name_len = vsnprintf(cg->group_name, NAME_MAX, + group_name_fmt, ap); + va_end(ap); + + if (name_len >= NAME_MAX) + tst_brk(TBROK, "CGroup name is too long"); for_each_dir(parent, 0, dir) { new_dir = SAFE_MALLOC(sizeof(*new_dir)); From patchwork Thu Feb 3 08:18:20 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Richard Palethorpe X-Patchwork-Id: 1587915 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: bilbo.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=suse.com header.i=@suse.com header.a=rsa-sha256 header.s=susede1 header.b=TlSXIxVf; dkim-atps=neutral Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=lists.linux.it (client-ip=213.254.12.146; helo=picard.linux.it; envelope-from=ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it; receiver=) Received: from picard.linux.it (picard.linux.it [213.254.12.146]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by bilbo.ozlabs.org (Postfix) with ESMTPS id 4JqBRq07blz9s8s for ; Thu, 3 Feb 2022 19:20:06 +1100 (AEDT) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id 111A23C98F2 for ; Thu, 3 Feb 2022 09:20:05 +0100 (CET) X-Original-To: ltp@lists.linux.it Delivered-To: ltp@picard.linux.it Received: from in-2.smtp.seeweb.it (in-2.smtp.seeweb.it [IPv6:2001:4b78:1:20::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id D6B133C98DF for ; Thu, 3 Feb 2022 09:19:15 +0100 (CET) Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-2.smtp.seeweb.it (Postfix) with ESMTPS id 47785600BA7 for ; Thu, 3 Feb 2022 09:19:15 +0100 (CET) Received: from relay2.suse.de (relay2.suse.de [149.44.160.134]) by smtp-out1.suse.de (Postfix) with ESMTP id E992E21111; Thu, 3 Feb 2022 08:19:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1643876354; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iGYFGireD2X58lCkDzetpNtVJdpMOIcAJEcVXGfy1mw=; b=TlSXIxVfTS+sgy8VYr2eJ+a/gsEsqgjAchb4CTGn+tVJfuBTEcfJyjObJl/7fx1L5wjEEu G1OMjFJKxEczoLwutoxqnraMbv8pDX/Iz/KGU4iz7YB0yHZf/LlbWC4inDDxB7byc05LKo 4ySt13T4olp1/CnmyZIJdG0jUanP1sc= Received: from g78.suse.de (unknown [10.163.24.138]) by relay2.suse.de (Postfix) with ESMTP id B5CC0A3B83; Thu, 3 Feb 2022 08:19:14 +0000 (UTC) To: ltp@lists.linux.it Date: Thu, 3 Feb 2022 08:18:20 +0000 Message-Id: <20220203081820.29521-7-rpalethorpe@suse.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220203081820.29521-1-rpalethorpe@suse.com> References: <20220203081820.29521-1-rpalethorpe@suse.com> MIME-Version: 1.0 X-Virus-Scanned: clamav-milter 0.102.4 at in-2.smtp.seeweb.it X-Virus-Status: Clean X-Spam-Status: No, score=0.1 required=7.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,SPF_HELO_NONE,SPF_PASS, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on in-2.smtp.seeweb.it Subject: [LTP] [PATCH v2 5/5] memcontrol03: Copy from kselftest X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Patchwork-Original-From: Richard Palethorpe via ltp From: Richard Palethorpe Reply-To: Richard Palethorpe Cc: Richard Palethorpe Errors-To: ltp-bounces+incoming=patchwork.ozlabs.org@lists.linux.it Sender: "ltp" Note that the tolerances had to be increased slightly otherwise the test only passed on ext4 in upstream 5.16 on x86_64. In all cases it seems more memory is evicted from C than expected and not enough from D. This may indicate some tuning is possible, but does not look like a serious regression. Signed-off-by: Richard Palethorpe --- runtest/controllers | 1 + testcases/kernel/controllers/memcg/.gitignore | 1 + .../kernel/controllers/memcg/memcontrol03.c | 255 ++++++++++++++++++ 3 files changed, 257 insertions(+) create mode 100644 testcases/kernel/controllers/memcg/memcontrol03.c diff --git a/runtest/controllers b/runtest/controllers index 09e0107e4..4a6f919af 100644 --- a/runtest/controllers +++ b/runtest/controllers @@ -19,6 +19,7 @@ memcg_control memcg_control_test.sh # kselftest ports memcontrol01 memcontrol01 memcontrol02 memcontrol02 +memcontrol03 memcontrol03 cgroup_fj_function_debug cgroup_fj_function.sh debug cgroup_fj_function_cpuset cgroup_fj_function.sh cpuset diff --git a/testcases/kernel/controllers/memcg/.gitignore b/testcases/kernel/controllers/memcg/.gitignore index f7de40d53..49df1582c 100644 --- a/testcases/kernel/controllers/memcg/.gitignore +++ b/testcases/kernel/controllers/memcg/.gitignore @@ -7,3 +7,4 @@ /stress/memcg_process_stress memcontrol01 memcontrol02 +memcontrol03 diff --git a/testcases/kernel/controllers/memcg/memcontrol03.c b/testcases/kernel/controllers/memcg/memcontrol03.c new file mode 100644 index 000000000..8f1d7f8c1 --- /dev/null +++ b/testcases/kernel/controllers/memcg/memcontrol03.c @@ -0,0 +1,255 @@ +// SPDX-License-Identifier: GPL-2.0 +/*\ + * + * [Description] + * + * Conversion of the third kself test in cgroup/test_memcontrol.c. + * + * Original description: + * "First, this test creates the following hierarchy: + * A memory.min = 50M, memory.max = 200M + * A/B memory.min = 50M, memory.current = 50M + * A/B/C memory.min = 75M, memory.current = 50M + * A/B/D memory.min = 25M, memory.current = 50M + * A/B/E memory.min = 500M, memory.current = 0 + * A/B/F memory.min = 0, memory.current = 50M + * + * Usages are pagecache, but the test keeps a running + * process in every leaf cgroup. + * Then it creates A/G and creates a significant + * memory pressure in it. + * + * A/B memory.current ~= 50M + * A/B/C memory.current ~= 33M + * A/B/D memory.current ~= 17M + * A/B/E memory.current ~= 0 + * + * After that it tries to allocate more than there is unprotected + * memory in A available, and checks that memory.min protects + * pagecache even in this case." + * + * memory.min doesn't appear to exist on V1 so we only test on V2 like + * the selftest. We do test on more file systems, but not tempfs + * becaue it can't evict the page cache without swap. Also we avoid + * filesystems which allocate extra memory for buffer heads. + * + * The tolerances have been increased from the self tests. + */ + +#define _GNU_SOURCE + +#include + +#include "memcontrol_common.h" + +#define TMPDIR "mntdir" + +static struct tst_cgroup_group *trunk_cg[3]; +static struct tst_cgroup_group *leaf_cg[4]; +static int fd = -1; + +enum checkpoints { + CHILD_IDLE, + TEST_DONE, +}; + +enum trunk_cg { + A, + B, + G +}; + +enum leaf_cg { + C, + D, + E, + F +}; + +static void cleanup_sub_groups(void) +{ + size_t i; + + for (i = ARRAY_SIZE(leaf_cg); i > 0; i--) { + if (!leaf_cg[i - 1]) + continue; + + TST_CHECKPOINT_WAKE2(TEST_DONE, + ARRAY_SIZE(leaf_cg) - 1); + tst_reap_children(); + break; + } + + for (i = ARRAY_SIZE(leaf_cg); i > 0; i--) { + if (!leaf_cg[i - 1]) + continue; + + leaf_cg[i - 1] = tst_cgroup_group_rm(leaf_cg[i - 1]); + } + + for (i = ARRAY_SIZE(trunk_cg); i > 0; i--) { + if (!trunk_cg[i - 1]) + continue; + + trunk_cg[i - 1] = tst_cgroup_group_rm(trunk_cg[i - 1]); + } +} + +static void alloc_anon_in_child(const struct tst_cgroup_group *const cg, + const size_t size, const int expect_oom) +{ + int status; + const pid_t pid = SAFE_FORK(); + + if (!pid) { + SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + + tst_res(TINFO, "%d in %s: Allocating anon: %"PRIdPTR, + getpid(), tst_cgroup_group_name(cg), size); + alloc_anon(size); + exit(0); + } + + SAFE_WAITPID(pid, &status, 0); + + if (!expect_oom) { + if (WIFEXITED(status) && WEXITSTATUS(status) == 0) + return; + } else { + if (WIFSIGNALED(status) && WTERMSIG(status) == SIGKILL) + return; + } + + tst_res(TFAIL, + "Expected child %d to %s, but instead %s", + pid, + expect_oom ? "be killed" : "exit(0)", + tst_strstatus(status)); +} + +static void alloc_pagecache_in_child(const struct tst_cgroup_group *const cg, + const size_t size) +{ + const pid_t pid = SAFE_FORK(); + + if (pid) { + TST_CHECKPOINT_WAIT(CHILD_IDLE); + return; + } + + SAFE_CGROUP_PRINTF(cg, "cgroup.procs", "%d", getpid()); + + tst_res(TINFO, "PID %d in %s: Allocating pagecache: %"PRIdPTR, + getpid(), tst_cgroup_group_name(cg), size); + alloc_pagecache(fd, size); + + TST_CHECKPOINT_WAKE(CHILD_IDLE); + TST_CHECKPOINT_WAIT(TEST_DONE); + exit(0); +} + +static void test_memcg_min(void) +{ + long c[4]; + unsigned int i; + size_t attempts; + + fd = SAFE_OPEN(TMPDIR"/tmpfile", O_RDWR | O_CREAT, 0600); + trunk_cg[A] = tst_cgroup_group_mk(tst_cgroup, "trunk_A"); + + SAFE_CGROUP_SCANF(trunk_cg[A], "memory.min", "%ld", c); + if (c[0]) { + tst_brk(TCONF, + "memory.min already set to %ld on parent group", c[0]); + } + + if (!TST_CGROUP_VER_IS_V1(trunk_cg[A], "memory")) { + SAFE_CGROUP_PRINT(trunk_cg[A], "cgroup.subtree_control", + "+memory"); + } + SAFE_CGROUP_PRINT(trunk_cg[A], "memory.max", "200M"); + SAFE_CGROUP_PRINT(trunk_cg[A], "memory.swap.max", "0"); + + trunk_cg[B] = tst_cgroup_group_mk(trunk_cg[A], "trunk_B"); + if (!TST_CGROUP_VER_IS_V1(trunk_cg[A], "memory")) { + SAFE_CGROUP_PRINT(trunk_cg[B], "cgroup.subtree_control", + "+memory"); + } + + trunk_cg[G] = tst_cgroup_group_mk(trunk_cg[A], "trunk_G"); + + for (i = 0; i < ARRAY_SIZE(leaf_cg); i++) { + leaf_cg[i] = tst_cgroup_group_mk(trunk_cg[B], + "leaf_%c", 'C' + i); + + if (i == E) + continue; + + alloc_pagecache_in_child(leaf_cg[i], MB(50)); + } + + SAFE_CGROUP_PRINT(trunk_cg[A], "memory.min", "50M"); + SAFE_CGROUP_PRINT(trunk_cg[B], "memory.min", "50M"); + SAFE_CGROUP_PRINT(leaf_cg[C], "memory.min", "75M"); + SAFE_CGROUP_PRINT(leaf_cg[D], "memory.min", "25M"); + SAFE_CGROUP_PRINT(leaf_cg[E], "memory.min", "500M"); + SAFE_CGROUP_PRINT(leaf_cg[F], "memory.min", "0"); + + for (attempts = 0; attempts < 5; attempts++) { + SAFE_CGROUP_SCANF(trunk_cg[B], "memory.current", "%ld", c); + if (values_close(c[0], MB(150), 3)) + break; + + sleep(1); + } + + alloc_anon_in_child(trunk_cg[G], MB(148), 0); + + SAFE_CGROUP_SCANF(trunk_cg[B], "memory.current", "%ld", c); + TST_EXP_EXPR(values_close(c[0], MB(50), 5), + "(A/B memory.current=%ld) ~= %d", c[0], MB(50)); + + for (i = 0; i < ARRAY_SIZE(leaf_cg); i++) + SAFE_CGROUP_SCANF(leaf_cg[i], "memory.current", "%ld", c + i); + + TST_EXP_EXPR(values_close(c[0], MB(33), 20), + "(A/B/C memory.current=%ld) ~= %d", c[0], MB(33)); + TST_EXP_EXPR(values_close(c[1], MB(17), 20), + "(A/B/D memory.current=%ld) ~= %d", c[1], MB(17)); + TST_EXP_EXPR(values_close(c[2], 0, 1), + "(A/B/E memory.current=%ld) ~= 0", c[2]); + + alloc_anon_in_child(trunk_cg[G], MB(170), 1); + + SAFE_CGROUP_SCANF(trunk_cg[B], "memory.current", "%ld", c); + TST_EXP_EXPR(values_close(c[0], MB(50), 5), + "(A/B memory.current=%ld) ~= %d", c[0], MB(50)); + + cleanup_sub_groups(); + SAFE_CLOSE(fd); + SAFE_UNLINK(TMPDIR"/tmpfile"); +} + +static void cleanup(void) +{ + cleanup_sub_groups(); + if (fd > -1) + SAFE_CLOSE(fd); +} + +static struct tst_test test = { + .cleanup = cleanup, + .test_all = test_memcg_min, + .mount_device = 1, + .dev_min_size = 256, + .mntpoint = TMPDIR, + .all_filesystems = 1, + .skip_filesystems = (const char *const[]){ + "exfat", "vfat", "fuse", "ntfs", "tmpfs", NULL + }, + .forks_child = 1, + .needs_root = 1, + .needs_checkpoints = 1, + .needs_cgroup_ver = TST_CGROUP_V2, + .needs_cgroup_controllers = (const char *const[]){ "memory", NULL }, +};