{"id":2224902,"url":"http://patchwork.ozlabs.org/api/1.1/patches/2224902/?format=json","web_url":"http://patchwork.ozlabs.org/project/qemu-devel/patch/20260419130139.15554-8-alexander@mihalicyn.com/","project":{"id":14,"url":"http://patchwork.ozlabs.org/api/1.1/projects/14/?format=json","name":"QEMU Development","link_name":"qemu-devel","list_id":"qemu-devel.nongnu.org","list_email":"qemu-devel@nongnu.org","web_url":"","scm_url":"","webscm_url":""},"msgid":"<20260419130139.15554-8-alexander@mihalicyn.com>","date":"2026-04-19T13:01:38","name":"[v6,7/8] tests/functional/x86_64: add migration test for NVMe device","commit_ref":null,"pull_url":null,"state":"new","archived":false,"hash":"c3ace63524727e35c4a802d2eef742821dc0c9e4","submitter":{"id":81630,"url":"http://patchwork.ozlabs.org/api/1.1/people/81630/?format=json","name":"Alexander Mikhalitsyn","email":"alexander@mihalicyn.com"},"delegate":null,"mbox":"http://patchwork.ozlabs.org/project/qemu-devel/patch/20260419130139.15554-8-alexander@mihalicyn.com/mbox/","series":[{"id":500500,"url":"http://patchwork.ozlabs.org/api/1.1/series/500500/?format=json","web_url":"http://patchwork.ozlabs.org/project/qemu-devel/list/?series=500500","date":"2026-04-19T13:01:32","name":"hw/nvme: add basic live migration support","version":6,"mbox":"http://patchwork.ozlabs.org/series/500500/mbox/"}],"comments":"http://patchwork.ozlabs.org/api/patches/2224902/comments/","check":"pending","checks":"http://patchwork.ozlabs.org/api/patches/2224902/checks/","tags":{},"headers":{"Return-Path":"","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@legolas.ozlabs.org","Authentication-Results":["legolas.ozlabs.org;\n\tdkim=pass (1024-bit key;\n secure) header.d=mihalicyn.com header.i=@mihalicyn.com header.a=rsa-sha256\n header.s=mihalicyn header.b=YPN9TbsP;\n\tdkim-atps=neutral","legolas.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=nongnu.org\n (client-ip=209.51.188.17; helo=lists1p.gnu.org;\n envelope-from=qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org;\n receiver=patchwork.ozlabs.org)"],"Received":["from lists1p.gnu.org (lists1p.gnu.org [209.51.188.17])\n\t(using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby legolas.ozlabs.org (Postfix) with ESMTPS id 4fz82b6jhdz1yD4\n\tfor ; Sun, 19 Apr 2026 23:04:07 +1000 (AEST)","from localhost ([::1] helo=lists1p.gnu.org)\n\tby lists1p.gnu.org with esmtp (Exim 4.90_1)\n\t(envelope-from )\n\tid 1wERn7-00011m-ML; Sun, 19 Apr 2026 09:02:25 -0400","from eggs.gnu.org ([2001:470:142:3::10])\n by lists1p.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)\n (Exim 4.90_1) (envelope-from )\n id 1wERml-0000uF-IJ\n for qemu-devel@nongnu.org; Sun, 19 Apr 2026 09:02:05 -0400","from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a])\n by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)\n (Exim 4.90_1) (envelope-from )\n id 1wERme-0008K8-NI\n for qemu-devel@nongnu.org; Sun, 19 Apr 2026 09:02:03 -0400","by mail-wm1-x32a.google.com with SMTP id\n 5b1f17b1804b1-4887ca8e529so15664995e9.0\n for ; Sun, 19 Apr 2026 06:01:51 -0700 (PDT)","from alex-laptop.lan\n (p200300cf57228c00995e4e0d3496e07b.dip0.t-ipconnect.de.\n [2003:cf:5722:8c00:995e:4e0d:3496:e07b])\n by smtp.gmail.com with ESMTPSA id\n ffacd0b85a97d-43fe4cc2cacsm20734304f8f.13.2026.04.19.06.01.49\n (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n Sun, 19 Apr 2026 06:01:49 -0700 (PDT)"],"DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n d=mihalicyn.com; s=mihalicyn; t=1776603710; x=1777208510; darn=nongnu.org;\n h=content-transfer-encoding:mime-version:references:in-reply-to\n :message-id:date:subject:cc:to:from:from:to:cc:subject:date\n :message-id:reply-to;\n bh=sBpcKOoEk+DQ0qOwh5vSLzEuS5T0qQxiJFTEUttDnck=;\n b=YPN9TbsP303pdJpJiA0fJA/xhd75FAhT+fN/FV/EDepmIvcW/j26hlxq1OGg49Njk0\n xNs5kH3iu4KSPrgfaO04ThZiKMwSancvTMVH/k7OV5mbmwQXDKcek/0G80WDj48YBKTa\n ZPtu+bPaVoAUQvu+gJyyN/Afr3lB/1CZ+iBrQ=","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n d=1e100.net; s=20251104; t=1776603710; x=1777208510;\n h=content-transfer-encoding:mime-version:references:in-reply-to\n :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from\n :to:cc:subject:date:message-id:reply-to;\n bh=sBpcKOoEk+DQ0qOwh5vSLzEuS5T0qQxiJFTEUttDnck=;\n b=ZLM6HKvM2BLAjuYukMqRy8m3sYex7wefWMu6XmcQYwawn/NjiBQxapzqAmoK/mpV1I\n VJ4yNmilBMA8HkEfP2OcHSZFhu4QEuSWXRrw0H+mRhxgN05c2ua8fm96xWgOvLHTMl9r\n DVGA8fGdWnCd+dtoymG7BXR+HUOyGFreYBs7Uxq2p0lrkbrBYplVHIu3J77fNzariz68\n nCX6NjrOI5zYMZvWF6X2f5KOXNIKBgWcf/G3cB8KZYintzwdECdd1o9bqgp8hTFts/ll\n 9Ns47TRXnJaFAUwizgQR/0G2j1VRO1MGxpMa9iYEmEDEoNuAoPRr+lzdVCvXN9ZMU+J8\n nT0A==","X-Gm-Message-State":"AOJu0YzA+4wweA/olWZkYZPLBAOWzEuAHYsTtX8CseFoLmDsD//RnlKJ\n 41Gd7ne0xvSqrs5wklYnsumQQyDxraPU+t6rdYMy8uhReSrGufHFNJTn6/faHZQhMu2Z/689xC0\n rTxPnj+o=","X-Gm-Gg":"AeBDiev8RpZB6UyGkJiDUin2WcPeGBdVPRJFWJAhuprK/73h7ywkoQfQfDOKZZ9y77S\n uCDapj/I1JatmSqD+uTpvv+fpoCVV0Z0t5/QJ8awuDmioa2FSlcADn2HxFX0TTwMKuMxlgmcMpk\n FkVoSB9/7PVv9liRUkQqlD/Q4FruWF9bE1VR9ko2Sv4HELSmtVxyeHBydeJWo872vHoK+Mt2qMW\n IvTprq/pSbyYjYaodhlHvD+JoK64o2UH3EAFJdhDDZUZH33UcmTVkh89X0/IEdkFV2w3nO9TeKa\n Zrq0T3NCyUBOGIc6wAHpq2ZydX1DF3tnL+IQvhwxN6Uy2q7tcuw7nhMSX+YnO9aDLK/ghQ9Vbpn\n FXCapYDCfs65HZvA0IUVLpzHnn4YBOtkFSt8l3OeOhX8J1FIFYbb2hYcXNgJ45QVyCIBvPHBdQu\n YcRyA6kYB2aPEReHZrVOcUO60+er7mKPrafFjPnFywiSUgQAel2aXe9mXeShs555ElMjA9E5mYd\n ZQ6Qtjrs12lRJULy2jim5KZpiZrLVk8kg==","X-Received":"by 2002:a05:600c:8a1a:20b0:485:3038:72c2 with SMTP id\n 5b1f17b1804b1-488fb8bcdf6mr98009815e9.17.1776603710387;\n Sun, 19 Apr 2026 06:01:50 -0700 (PDT)","From":"Alexander Mikhalitsyn ","To":"qemu-devel@nongnu.org","Cc":"Alexander Mikhalitsyn ,\n Kevin Wolf , qemu-block@nongnu.org,\n Fam Zheng ,\n =?utf-8?q?St=C3=A9phane_Graber?= , =?utf-8?q?Philipp?=\n\t=?utf-8?q?e_Mathieu-Daud=C3=A9?= ,\n Paolo Bonzini , Stefan Hajnoczi ,\n Laurent Vivier , Jesper Devantier ,\n Klaus Jensen , Fabiano Rosas ,\n Zhao Liu , Keith Busch ,\n Peter Xu , Hanna Reitz ,\n Alexander Mikhalitsyn ","Subject":"[PATCH v6 7/8] tests/functional/x86_64: add migration test for NVMe\n device","Date":"Sun, 19 Apr 2026 15:01:38 +0200","Message-ID":"<20260419130139.15554-8-alexander@mihalicyn.com>","X-Mailer":"git-send-email 2.47.3","In-Reply-To":"<20260419130139.15554-1-alexander@mihalicyn.com>","References":"<20260419130139.15554-1-alexander@mihalicyn.com>","MIME-Version":"1.0","Content-Transfer-Encoding":"8bit","Received-SPF":"pass client-ip=2a00:1450:4864:20::32a;\n envelope-from=alexander@mihalicyn.com; helo=mail-wm1-x32a.google.com","X-Spam_score_int":"-20","X-Spam_score":"-2.1","X-Spam_bar":"--","X-Spam_report":"(-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,\n DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,\n RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,\n SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no","X-Spam_action":"no action","X-BeenThere":"qemu-devel@nongnu.org","X-Mailman-Version":"2.1.29","Precedence":"list","List-Id":"qemu development ","List-Unsubscribe":",\n ","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n ","Errors-To":"qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org","Sender":"qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org"},"content":"From: Alexander Mikhalitsyn \n\nIntroduce a very simple test to ensure that NVMe device\nmigration works fine.\n\nTest plan is simple:\n1. prepare VM with NVMe device\n2. run workload that produces relatively heavy IO on the device\n3. migrate VM\n4. ensure that workload is alive and finishes without errors\n\nTest can be run as simple as:\n$ meson test 'func-x86_64-nvme_migration' --setup thorough -C build\n\nIn the future we can extend this approach, and introduce some\nfio-based tests. And probably, it makes sense to make this test\nto apply not only to NVMe device, but also virtio-{blk,scsi},\nide, sata and other migratable devices.\n\nSigned-off-by: Alexander Mikhalitsyn \n---\n tests/functional/x86_64/meson.build | 1 +\n .../functional/x86_64/test_nvme_migration.py | 159 ++++++++++++++++++\n 2 files changed, 160 insertions(+)\n create mode 100755 tests/functional/x86_64/test_nvme_migration.py","diff":"diff --git a/tests/functional/x86_64/meson.build b/tests/functional/x86_64/meson.build\nindex 1ed10ad6c29..fd77f19d726 100644\n--- a/tests/functional/x86_64/meson.build\n+++ b/tests/functional/x86_64/meson.build\n@@ -37,6 +37,7 @@ tests_x86_64_system_thorough = [\n 'linux_initrd',\n 'multiprocess',\n 'netdev_ethtool',\n+ 'nvme_migration',\n 'replay',\n 'reverse_debug',\n 'tuxrun',\ndiff --git a/tests/functional/x86_64/test_nvme_migration.py b/tests/functional/x86_64/test_nvme_migration.py\nnew file mode 100755\nindex 00000000000..3788a8e3473\n--- /dev/null\n+++ b/tests/functional/x86_64/test_nvme_migration.py\n@@ -0,0 +1,159 @@\n+#!/usr/bin/env python3\n+#\n+# SPDX-License-Identifier: GPL-2.0-or-later\n+#\n+# x86_64 NVMe migration test\n+\n+from migration import MigrationTest\n+from qemu_test import QemuSystemTest, Asset\n+from qemu_test import wait_for_console_pattern\n+from qemu_test import exec_command, exec_command_and_wait_for_pattern\n+\n+\n+class X8664NVMeMigrationTest(MigrationTest):\n+ ASSET_KERNEL = Asset(\n+ ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases'\n+ '/31/Server/x86_64/os/images/pxeboot/vmlinuz'),\n+ 'd4738d03dbbe083ca610d0821d0a8f1488bebbdccef54ce33e3adb35fda00129')\n+\n+ ASSET_INITRD = Asset(\n+ ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases'\n+ '/31/Server/x86_64/os/images/pxeboot/initrd.img'),\n+ '277cd6c7adf77c7e63d73bbb2cded8ef9e2d3a2f100000e92ff1f8396513cd8b')\n+\n+ ASSET_DISKIMAGE = Asset(\n+ ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases'\n+ '/31/Cloud/x86_64/images/Fedora-Cloud-Base-31-1.9.x86_64.qcow2'),\n+ 'e3c1b309d9203604922d6e255c2c5d098a309c2d46215d8fc026954f3c5c27a0')\n+\n+ DEFAULT_KERNEL_PARAMS = ('root=/dev/nvme0n1p1 console=ttyS0 net.ifnames=0 '\n+ 'rd.rescue quiet')\n+\n+ def wait_for_console_pattern(self, success_message, vm):\n+ wait_for_console_pattern(\n+ self,\n+ success_message,\n+ failure_message=\"Kernel panic - not syncing\",\n+ vm=vm,\n+ )\n+\n+ def exec_command_and_check(self, command, vm):\n+ prompt = '# '\n+ exec_command_and_wait_for_pattern(self,\n+ f\"{command} && echo OK || echo FAIL\",\n+ 'FAIL', vm=vm)\n+ # Note, that commands we send to the console are echo-ed back, so if we have a word \"FAIL\"\n+ # in the command itself, we should expect to see it once.\n+ wait_for_console_pattern(self, 'OK', failure_message=\"FAIL\", vm=vm)\n+ self.wait_for_console_pattern(prompt, vm)\n+\n+ def configure_machine(self, vm):\n+ kernel_path = self.ASSET_KERNEL.fetch()\n+ initrd_path = self.ASSET_INITRD.fetch()\n+ diskimage_path = self.ASSET_DISKIMAGE.fetch()\n+\n+ vm.set_console()\n+ vm.add_args(\"-cpu\", \"max\")\n+ vm.add_args(\"-m\", \"2G\")\n+ vm.add_args(\"-accel\", \"kvm\")\n+\n+ vm.add_args('-drive',\n+ f'file={diskimage_path},if=none,id=drv0,snapshot=on')\n+ vm.add_args('-device', 'nvme,bus=pcie.0,' +\n+ 'drive=drv0,id=nvme-disk0,serial=nvmemigratetest,bootindex=1')\n+\n+ vm.add_args(\n+ \"-kernel\",\n+ kernel_path,\n+ \"-initrd\",\n+ initrd_path,\n+ \"-append\",\n+ self.DEFAULT_KERNEL_PARAMS\n+ )\n+\n+ def launch_source_vm(self, vm):\n+ vm.launch()\n+\n+ self.wait_for_console_pattern('Entering emergency mode.', vm)\n+ prompt = '# '\n+ self.wait_for_console_pattern(prompt, vm)\n+\n+ # Synchronize on NVMe driver creating the root device\n+ exec_command_and_wait_for_pattern(self,\n+ \"while ! (dmesg -c | grep nvme0n1:) ; do sleep 1 ; done\",\n+ \"nvme0n1\", vm=vm)\n+ self.wait_for_console_pattern(prompt, vm)\n+\n+ # prepare system\n+ exec_command_and_wait_for_pattern(self, 'mount /dev/nvme0n1p1 /sysroot',\n+ prompt, vm=vm)\n+ exec_command_and_wait_for_pattern(self, 'chroot /sysroot',\n+ prompt, vm=vm)\n+ exec_command_and_wait_for_pattern(self, 'mount -t proc proc /proc',\n+ prompt, vm=vm)\n+ exec_command_and_wait_for_pattern(self, 'mount -t sysfs sysfs /sys',\n+ prompt, vm=vm)\n+\n+ # Run workload before migration to check if it continues to run properly after migration\n+ #\n+ # Workload is simple: it continuously calculates checksums of all files in /usr/bin\n+ # to generate some I/O load on the NVMe disk and at the same time it drops caches to\n+ # make sure that we have some read I/O on the disk as well.\n+ # If there are any issues with the migration of the NVMe device, we should see errors\n+ # in dmesg and consequently in the workload log.\n+ exec_command_and_wait_for_pattern(self,\n+ \"(while [ ! -f /tmp/test_nvme_migration_workload.stop ]; do \\\n+ rm -f /tmp/test_nvme_migration_workload.iteration_finished; \\\n+ echo 3 > /proc/sys/vm/drop_caches; \\\n+ find /usr/bin -type f -exec cksum {} \\\\;; \\\n+ touch /tmp/test_nvme_migration_workload.iteration_finished; \\\n+ done) > /dev/null 2> /tmp/test_nvme_migration_workload.errors &\",\n+ prompt, vm=vm)\n+ exec_command_and_wait_for_pattern(self, 'echo $! > /tmp/test_nvme_migration_workload.pid',\n+ prompt, vm=vm)\n+\n+ # check if process is alive and running\n+ self.exec_command_and_check(\"kill -0 $(cat /tmp/test_nvme_migration_workload.pid)\", vm)\n+\n+ def assert_dest_vm(self, vm):\n+ prompt = '# '\n+\n+ # check if process is alive and running after migration, if not - fail the test\n+ self.exec_command_and_check(\"kill -0 $(cat /tmp/test_nvme_migration_workload.pid)\", vm)\n+\n+ # signal workload to stop\n+ exec_command_and_wait_for_pattern(self, 'touch /tmp/test_nvme_migration_workload.stop',\n+ prompt, vm=vm)\n+\n+ # wait workload to finish, because we want to examine log to see if there are any errors\n+ exec_command_and_wait_for_pattern(self,\n+ \"while [ ! -f /tmp/test_nvme_migration_workload.iteration_finished ]; do sleep 1; done;\",\n+ prompt, vm=vm)\n+\n+ exec_command_and_wait_for_pattern(self, 'cat /tmp/test_nvme_migration_workload.errors',\n+ prompt, vm=vm)\n+\n+ # fail the test if non-empty\n+ self.exec_command_and_check(\"[ ! -s /tmp/test_nvme_migration_workload.errors ]\", vm)\n+\n+ def test_migration_with_tcp_localhost(self):\n+ self.set_machine('q35')\n+ self.require_accelerator(\"kvm\")\n+\n+ self.migration_with_tcp_localhost()\n+\n+ def test_migration_with_unix(self):\n+ self.set_machine('q35')\n+ self.require_accelerator(\"kvm\")\n+\n+ self.migration_with_unix()\n+\n+ def test_migration_with_exec(self):\n+ self.set_machine('q35')\n+ self.require_accelerator(\"kvm\")\n+\n+ self.migration_with_exec()\n+\n+\n+if __name__ == '__main__':\n+ MigrationTest.main()\n","prefixes":["v6","7/8"]}