mbox

[PULL,0/9] Integration testing patches for 2021-11-08

Message ID 20211108161739.1371503-1-philmd@redhat.com
State New
Headers show

Pull-request

https://github.com/philmd/qemu.git tags/avocado-20211108

Message

Philippe Mathieu-Daudé Nov. 8, 2021, 4:17 p.m. UTC
The following changes since commit 260f9210d2ce892c5e162a45b0e5ec0036bedc79:

  Merge remote-tracking branch 'remotes/marcandre.lureau/tags/sphinx-pull-request' into staging (2021-11-08 14:56:10 +0100)

are available in the Git repository at:

  https://github.com/philmd/qemu.git tags/avocado-20211108

for you to fetch changes up to b94d00898a9ee708b4d4b79432c2272905a56b06:

  tests/avocado: Remove p7zip binary availability check (2021-11-08 17:00:22 +0100)

----------------------------------------------------------------
Integration testing patches

- Rename tests/acceptance/ -> tests/avocado/
- Rename avocado_qemu.Test -> avocado_qemu.QemuSystemTest
- Introduce QemuUserTest class
- Add the first linux-user test, covering the bFLT loader

----------------------------------------------------------------

Philippe Mathieu-Daudé (7):
  tests/avocado: Extract QemuBaseTest from Test
  tests/avocado: Make pick_default_qemu_bin() more generic
  tests/avocado: Introduce QemuUserTest base class
  tests/avocado: Share useful helpers from virtiofs_submounts test
  tests/avocado: Add bFLT loader linux-user test
  tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest
  tests/avocado: Remove p7zip binary availability check

Willian Rampazzo (2):
  tests/acceptance: introduce new check-avocado target
  tests/acceptance: rename tests acceptance to tests avocado

 docs/devel/build-system.rst                   |   2 +-
 docs/devel/ci-definitions.rst.inc             |   2 +-
 docs/devel/testing.rst                        |  57 +++---
 docs/system/arm/orangepi.rst                  |   8 +-
 python/qemu/machine/README.rst                |   2 +-
 python/qemu/qmp/README.rst                    |   2 +-
 python/qemu/utils/README.rst                  |   2 +-
 tests/acceptance/README.rst                   |  10 --
 tests/avocado/README.rst                      |  10 ++
 configure                                     |   2 +-
 .gitlab-ci.d/buildtest-template.yml           |   2 +-
 .gitlab-ci.d/buildtest.yml                    |  56 +++---
 MAINTAINERS                                   |  52 +++---
 tests/Makefile.include                        |  21 ++-
 .../avocado_qemu/__init__.py                  | 163 +++++++++++++-----
 tests/{acceptance => avocado}/boot_linux.py   |   0
 .../boot_linux_console.py                     |  11 +-
 tests/{acceptance => avocado}/boot_xen.py     |   0
 tests/{acceptance => avocado}/cpu_queries.py  |   4 +-
 .../empty_cpu_model.py                        |   4 +-
 tests/{acceptance => avocado}/hotplug_cpu.py  |   0
 tests/{acceptance => avocado}/info_usernet.py |   4 +-
 tests/{acceptance => avocado}/intel_iommu.py  |   0
 tests/{acceptance => avocado}/linux_initrd.py |   6 +-
 .../linux_ssh_mips_malta.py                   |   5 +-
 tests/avocado/load_bflt.py                    |  54 ++++++
 .../machine_arm_canona1100.py                 |   4 +-
 .../machine_arm_integratorcp.py               |   4 +-
 .../machine_arm_n8x0.py                       |   4 +-
 tests/{acceptance => avocado}/machine_avr6.py |   6 +-
 .../machine_m68k_nextcube.py                  |   4 +-
 .../machine_microblaze.py                     |   4 +-
 .../machine_mips_fuloong2e.py                 |   4 +-
 .../machine_mips_loongson3v.py                |   4 +-
 .../machine_mips_malta.py                     |   4 +-
 .../machine_rx_gdbsim.py                      |   4 +-
 .../machine_s390_ccw_virtio.py                |   4 +-
 .../machine_sparc64_sun4u.py                  |   0
 .../machine_sparc_leon3.py                    |   4 +-
 tests/{acceptance => avocado}/migration.py    |   4 +-
 tests/{acceptance => avocado}/multiprocess.py |   4 +-
 .../pc_cpu_hotplug_props.py                   |   4 +-
 tests/{acceptance => avocado}/ppc_405.py      |   4 +-
 tests/{acceptance => avocado}/ppc_bamboo.py   |   4 +-
 .../{acceptance => avocado}/ppc_mpc8544ds.py  |   4 +-
 tests/{acceptance => avocado}/ppc_prep_40p.py |   4 +-
 tests/{acceptance => avocado}/ppc_pseries.py  |   4 +-
 .../ppc_virtex_ml507.py                       |   4 +-
 .../{acceptance => avocado}/replay_kernel.py  |   0
 tests/{acceptance => avocado}/replay_linux.py |   0
 .../reverse_debugging.py                      |   0
 tests/{acceptance => avocado}/smmu.py         |   0
 tests/{acceptance => avocado}/tcg_plugins.py  |   0
 .../tesseract_utils.py                        |   0
 tests/{acceptance => avocado}/version.py      |   4 +-
 tests/{acceptance => avocado}/virtio-gpu.py   |   4 +-
 .../virtio_check_params.py                    |   4 +-
 .../{acceptance => avocado}/virtio_version.py |   4 +-
 .../virtiofs_submounts.py                     |  59 +------
 .../virtiofs_submounts.py.data/cleanup.sh     |   0
 .../guest-cleanup.sh                          |   0
 .../virtiofs_submounts.py.data/guest.sh       |   0
 .../virtiofs_submounts.py.data/host.sh        |   0
 tests/{acceptance => avocado}/vnc.py          |   4 +-
 .../x86_cpu_model_versions.py                 |   4 +-
 65 files changed, 364 insertions(+), 284 deletions(-)
 delete mode 100644 tests/acceptance/README.rst
 create mode 100644 tests/avocado/README.rst
 rename tests/{acceptance => avocado}/avocado_qemu/__init__.py (87%)
 rename tests/{acceptance => avocado}/boot_linux.py (100%)
 rename tests/{acceptance => avocado}/boot_linux_console.py (99%)
 rename tests/{acceptance => avocado}/boot_xen.py (100%)
 rename tests/{acceptance => avocado}/cpu_queries.py (91%)
 rename tests/{acceptance => avocado}/empty_cpu_model.py (88%)
 rename tests/{acceptance => avocado}/hotplug_cpu.py (100%)
 rename tests/{acceptance => avocado}/info_usernet.py (92%)
 rename tests/{acceptance => avocado}/intel_iommu.py (100%)
 rename tests/{acceptance => avocado}/linux_initrd.py (96%)
 rename tests/{acceptance => avocado}/linux_ssh_mips_malta.py (98%)
 create mode 100644 tests/avocado/load_bflt.py
 rename tests/{acceptance => avocado}/machine_arm_canona1100.py (93%)
 rename tests/{acceptance => avocado}/machine_arm_integratorcp.py (97%)
 rename tests/{acceptance => avocado}/machine_arm_n8x0.py (95%)
 rename tests/{acceptance => avocado}/machine_avr6.py (94%)
 rename tests/{acceptance => avocado}/machine_m68k_nextcube.py (97%)
 rename tests/{acceptance => avocado}/machine_microblaze.py (94%)
 rename tests/{acceptance => avocado}/machine_mips_fuloong2e.py (95%)
 rename tests/{acceptance => avocado}/machine_mips_loongson3v.py (94%)
 rename tests/{acceptance => avocado}/machine_mips_malta.py (98%)
 rename tests/{acceptance => avocado}/machine_rx_gdbsim.py (97%)
 rename tests/{acceptance => avocado}/machine_s390_ccw_virtio.py (99%)
 rename tests/{acceptance => avocado}/machine_sparc64_sun4u.py (100%)
 rename tests/{acceptance => avocado}/machine_sparc_leon3.py (94%)
 rename tests/{acceptance => avocado}/migration.py (97%)
 rename tests/{acceptance => avocado}/multiprocess.py (98%)
 rename tests/{acceptance => avocado}/pc_cpu_hotplug_props.py (93%)
 rename tests/{acceptance => avocado}/ppc_405.py (94%)
 rename tests/{acceptance => avocado}/ppc_bamboo.py (95%)
 rename tests/{acceptance => avocado}/ppc_mpc8544ds.py (93%)
 rename tests/{acceptance => avocado}/ppc_prep_40p.py (97%)
 rename tests/{acceptance => avocado}/ppc_pseries.py (94%)
 rename tests/{acceptance => avocado}/ppc_virtex_ml507.py (93%)
 rename tests/{acceptance => avocado}/replay_kernel.py (100%)
 rename tests/{acceptance => avocado}/replay_linux.py (100%)
 rename tests/{acceptance => avocado}/reverse_debugging.py (100%)
 rename tests/{acceptance => avocado}/smmu.py (100%)
 rename tests/{acceptance => avocado}/tcg_plugins.py (100%)
 rename tests/{acceptance => avocado}/tesseract_utils.py (100%)
 rename tests/{acceptance => avocado}/version.py (88%)
 rename tests/{acceptance => avocado}/virtio-gpu.py (98%)
 rename tests/{acceptance => avocado}/virtio_check_params.py (98%)
 rename tests/{acceptance => avocado}/virtio_version.py (98%)
 rename tests/{acceptance => avocado}/virtiofs_submounts.py (82%)
 rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/cleanup.sh (100%)
 rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/guest-cleanup.sh (100%)
 rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/guest.sh (100%)
 rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/host.sh (100%)
 rename tests/{acceptance => avocado}/vnc.py (96%)
 rename tests/{acceptance => avocado}/x86_cpu_model_versions.py (99%)

Comments

Richard Henderson Nov. 8, 2021, 7:37 p.m. UTC | #1
On 11/8/21 5:17 PM, Philippe Mathieu-Daudé wrote:
> The following changes since commit 260f9210d2ce892c5e162a45b0e5ec0036bedc79:
> 
>    Merge remote-tracking branch 'remotes/marcandre.lureau/tags/sphinx-pull-request' into staging (2021-11-08 14:56:10 +0100)
> 
> are available in the Git repository at:
> 
>    https://github.com/philmd/qemu.git tags/avocado-20211108
> 
> for you to fetch changes up to b94d00898a9ee708b4d4b79432c2272905a56b06:
> 
>    tests/avocado: Remove p7zip binary availability check (2021-11-08 17:00:22 +0100)
> 
> ----------------------------------------------------------------
> Integration testing patches
> 
> - Rename tests/acceptance/ -> tests/avocado/
> - Rename avocado_qemu.Test -> avocado_qemu.QemuSystemTest
> - Introduce QemuUserTest class
> - Add the first linux-user test, covering the bFLT loader
> 
> ----------------------------------------------------------------
> 
> Philippe Mathieu-Daudé (7):
>    tests/avocado: Extract QemuBaseTest from Test
>    tests/avocado: Make pick_default_qemu_bin() more generic
>    tests/avocado: Introduce QemuUserTest base class
>    tests/avocado: Share useful helpers from virtiofs_submounts test
>    tests/avocado: Add bFLT loader linux-user test
>    tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest
>    tests/avocado: Remove p7zip binary availability check
> 
> Willian Rampazzo (2):
>    tests/acceptance: introduce new check-avocado target
>    tests/acceptance: rename tests acceptance to tests avocado
> 
>   docs/devel/build-system.rst                   |   2 +-
>   docs/devel/ci-definitions.rst.inc             |   2 +-
>   docs/devel/testing.rst                        |  57 +++---
>   docs/system/arm/orangepi.rst                  |   8 +-
>   python/qemu/machine/README.rst                |   2 +-
>   python/qemu/qmp/README.rst                    |   2 +-
>   python/qemu/utils/README.rst                  |   2 +-
>   tests/acceptance/README.rst                   |  10 --
>   tests/avocado/README.rst                      |  10 ++
>   configure                                     |   2 +-
>   .gitlab-ci.d/buildtest-template.yml           |   2 +-
>   .gitlab-ci.d/buildtest.yml                    |  56 +++---
>   MAINTAINERS                                   |  52 +++---
>   tests/Makefile.include                        |  21 ++-
>   .../avocado_qemu/__init__.py                  | 163 +++++++++++++-----
>   tests/{acceptance => avocado}/boot_linux.py   |   0
>   .../boot_linux_console.py                     |  11 +-
>   tests/{acceptance => avocado}/boot_xen.py     |   0
>   tests/{acceptance => avocado}/cpu_queries.py  |   4 +-
>   .../empty_cpu_model.py                        |   4 +-
>   tests/{acceptance => avocado}/hotplug_cpu.py  |   0
>   tests/{acceptance => avocado}/info_usernet.py |   4 +-
>   tests/{acceptance => avocado}/intel_iommu.py  |   0
>   tests/{acceptance => avocado}/linux_initrd.py |   6 +-
>   .../linux_ssh_mips_malta.py                   |   5 +-
>   tests/avocado/load_bflt.py                    |  54 ++++++
>   .../machine_arm_canona1100.py                 |   4 +-
>   .../machine_arm_integratorcp.py               |   4 +-
>   .../machine_arm_n8x0.py                       |   4 +-
>   tests/{acceptance => avocado}/machine_avr6.py |   6 +-
>   .../machine_m68k_nextcube.py                  |   4 +-
>   .../machine_microblaze.py                     |   4 +-
>   .../machine_mips_fuloong2e.py                 |   4 +-
>   .../machine_mips_loongson3v.py                |   4 +-
>   .../machine_mips_malta.py                     |   4 +-
>   .../machine_rx_gdbsim.py                      |   4 +-
>   .../machine_s390_ccw_virtio.py                |   4 +-
>   .../machine_sparc64_sun4u.py                  |   0
>   .../machine_sparc_leon3.py                    |   4 +-
>   tests/{acceptance => avocado}/migration.py    |   4 +-
>   tests/{acceptance => avocado}/multiprocess.py |   4 +-
>   .../pc_cpu_hotplug_props.py                   |   4 +-
>   tests/{acceptance => avocado}/ppc_405.py      |   4 +-
>   tests/{acceptance => avocado}/ppc_bamboo.py   |   4 +-
>   .../{acceptance => avocado}/ppc_mpc8544ds.py  |   4 +-
>   tests/{acceptance => avocado}/ppc_prep_40p.py |   4 +-
>   tests/{acceptance => avocado}/ppc_pseries.py  |   4 +-
>   .../ppc_virtex_ml507.py                       |   4 +-
>   .../{acceptance => avocado}/replay_kernel.py  |   0
>   tests/{acceptance => avocado}/replay_linux.py |   0
>   .../reverse_debugging.py                      |   0
>   tests/{acceptance => avocado}/smmu.py         |   0
>   tests/{acceptance => avocado}/tcg_plugins.py  |   0
>   .../tesseract_utils.py                        |   0
>   tests/{acceptance => avocado}/version.py      |   4 +-
>   tests/{acceptance => avocado}/virtio-gpu.py   |   4 +-
>   .../virtio_check_params.py                    |   4 +-
>   .../{acceptance => avocado}/virtio_version.py |   4 +-
>   .../virtiofs_submounts.py                     |  59 +------
>   .../virtiofs_submounts.py.data/cleanup.sh     |   0
>   .../guest-cleanup.sh                          |   0
>   .../virtiofs_submounts.py.data/guest.sh       |   0
>   .../virtiofs_submounts.py.data/host.sh        |   0
>   tests/{acceptance => avocado}/vnc.py          |   4 +-
>   .../x86_cpu_model_versions.py                 |   4 +-
>   65 files changed, 364 insertions(+), 284 deletions(-)
>   delete mode 100644 tests/acceptance/README.rst
>   create mode 100644 tests/avocado/README.rst
>   rename tests/{acceptance => avocado}/avocado_qemu/__init__.py (87%)
>   rename tests/{acceptance => avocado}/boot_linux.py (100%)
>   rename tests/{acceptance => avocado}/boot_linux_console.py (99%)
>   rename tests/{acceptance => avocado}/boot_xen.py (100%)
>   rename tests/{acceptance => avocado}/cpu_queries.py (91%)
>   rename tests/{acceptance => avocado}/empty_cpu_model.py (88%)
>   rename tests/{acceptance => avocado}/hotplug_cpu.py (100%)
>   rename tests/{acceptance => avocado}/info_usernet.py (92%)
>   rename tests/{acceptance => avocado}/intel_iommu.py (100%)
>   rename tests/{acceptance => avocado}/linux_initrd.py (96%)
>   rename tests/{acceptance => avocado}/linux_ssh_mips_malta.py (98%)
>   create mode 100644 tests/avocado/load_bflt.py
>   rename tests/{acceptance => avocado}/machine_arm_canona1100.py (93%)
>   rename tests/{acceptance => avocado}/machine_arm_integratorcp.py (97%)
>   rename tests/{acceptance => avocado}/machine_arm_n8x0.py (95%)
>   rename tests/{acceptance => avocado}/machine_avr6.py (94%)
>   rename tests/{acceptance => avocado}/machine_m68k_nextcube.py (97%)
>   rename tests/{acceptance => avocado}/machine_microblaze.py (94%)
>   rename tests/{acceptance => avocado}/machine_mips_fuloong2e.py (95%)
>   rename tests/{acceptance => avocado}/machine_mips_loongson3v.py (94%)
>   rename tests/{acceptance => avocado}/machine_mips_malta.py (98%)
>   rename tests/{acceptance => avocado}/machine_rx_gdbsim.py (97%)
>   rename tests/{acceptance => avocado}/machine_s390_ccw_virtio.py (99%)
>   rename tests/{acceptance => avocado}/machine_sparc64_sun4u.py (100%)
>   rename tests/{acceptance => avocado}/machine_sparc_leon3.py (94%)
>   rename tests/{acceptance => avocado}/migration.py (97%)
>   rename tests/{acceptance => avocado}/multiprocess.py (98%)
>   rename tests/{acceptance => avocado}/pc_cpu_hotplug_props.py (93%)
>   rename tests/{acceptance => avocado}/ppc_405.py (94%)
>   rename tests/{acceptance => avocado}/ppc_bamboo.py (95%)
>   rename tests/{acceptance => avocado}/ppc_mpc8544ds.py (93%)
>   rename tests/{acceptance => avocado}/ppc_prep_40p.py (97%)
>   rename tests/{acceptance => avocado}/ppc_pseries.py (94%)
>   rename tests/{acceptance => avocado}/ppc_virtex_ml507.py (93%)
>   rename tests/{acceptance => avocado}/replay_kernel.py (100%)
>   rename tests/{acceptance => avocado}/replay_linux.py (100%)
>   rename tests/{acceptance => avocado}/reverse_debugging.py (100%)
>   rename tests/{acceptance => avocado}/smmu.py (100%)
>   rename tests/{acceptance => avocado}/tcg_plugins.py (100%)
>   rename tests/{acceptance => avocado}/tesseract_utils.py (100%)
>   rename tests/{acceptance => avocado}/version.py (88%)
>   rename tests/{acceptance => avocado}/virtio-gpu.py (98%)
>   rename tests/{acceptance => avocado}/virtio_check_params.py (98%)
>   rename tests/{acceptance => avocado}/virtio_version.py (98%)
>   rename tests/{acceptance => avocado}/virtiofs_submounts.py (82%)
>   rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/cleanup.sh (100%)
>   rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/guest-cleanup.sh (100%)
>   rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/guest.sh (100%)
>   rename tests/{acceptance => avocado}/virtiofs_submounts.py.data/host.sh (100%)
>   rename tests/{acceptance => avocado}/vnc.py (96%)
>   rename tests/{acceptance => avocado}/x86_cpu_model_versions.py (99%)

Applied, thanks.

r~