diff mbox series

[2/2] .gitlab-ci.yml: do runtime tests only on explicit trigger

Message ID 20181021100303.18431-2-arnout@mind.be
State Accepted
Commit 96123c1c4f1ee45636a0b6d540d6dfc17889e622
Headers show
Series [1/2] Makefile: .gitlab-ci.yml: fail when listing tests fail | expand

Commit Message

Arnout Vandecappelle Oct. 21, 2018, 10:03 a.m. UTC
When the runtime tests were first introduced, they still ran pretty
quickly. Nowadays, however, there are a lot of runtime tests, and some
of them take a really long time. So running them on every push is
really too much.

Just like we do for the defconfigs, run them on explicit trigger only.

The explicit trigger is now done every week, but it can be increased
to e.g. twice or three times per week.

Signed-off-by: Arnout Vandecappelle (Essensium/Mind) <arnout@mind.be>
---
v2: properly regenerate .gitlab-ci.yml
---
 .gitlab-ci.yml    | 5 +++++
 .gitlab-ci.yml.in | 5 +++++
 2 files changed, 10 insertions(+)

Comments

Peter Korsgaard Oct. 21, 2018, 9:34 p.m. UTC | #1
>>>>> "Arnout" == Arnout Vandecappelle (Essensium/Mind) <arnout@mind.be> writes:

 > When the runtime tests were first introduced, they still ran pretty
 > quickly. Nowadays, however, there are a lot of runtime tests, and some
 > of them take a really long time. So running them on every push is
 > really too much.

 > Just like we do for the defconfigs, run them on explicit trigger only.

 > The explicit trigger is now done every week, but it can be increased
 > to e.g. twice or three times per week.

 > Signed-off-by: Arnout Vandecappelle (Essensium/Mind) <arnout@mind.be>
 > ---
 > v2: properly regenerate .gitlab-ci.yml


Committed, thanks.
diff mbox series

Patch

diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
index d6a2319ba0..d5e91042f1 100644
--- a/.gitlab-ci.yml
+++ b/.gitlab-ci.yml
@@ -62,6 +62,11 @@  check-package:
             - output/build/packages-file-list.txt
 
 .runtime_test: &runtime_test
+    # Running the runtime tests for every push is too much, so limit to
+    # explicit triggers through the API.
+    only:
+        - triggers
+        - tags
     # Keep build directories so the rootfs can be an artifact of the job. The
     # runner will clean up those files for us.
     # Multiply every emulator timeout by 10 to avoid sporadic failures in
diff --git a/.gitlab-ci.yml.in b/.gitlab-ci.yml.in
index 38e24c8d01..db526c4b5a 100644
--- a/.gitlab-ci.yml.in
+++ b/.gitlab-ci.yml.in
@@ -62,6 +62,11 @@  check-package:
             - output/build/packages-file-list.txt
 
 .runtime_test: &runtime_test
+    # Running the runtime tests for every push is too much, so limit to
+    # explicit triggers through the API.
+    only:
+        - triggers
+        - tags
     # Keep build directories so the rootfs can be an artifact of the job. The
     # runner will clean up those files for us.
     # Multiply every emulator timeout by 10 to avoid sporadic failures in