[{"id":1765491,"web_url":"http://patchwork.ozlabs.org/comment/1765491/","msgid":"<87shfxgo1g.fsf@linaro.org>","list_archive_url":null,"date":"2017-09-08T16:20:27","subject":"Re: [Qemu-devel] [PATCH v6 00/12] tests: Add VM based build tests\n\t(for non-x86_64 and/or non-Linux)","submitter":{"id":39532,"url":"http://patchwork.ozlabs.org/api/people/39532/","name":"Alex Bennée","email":"alex.bennee@linaro.org"},"content":"Fam Zheng <famz@redhat.com> writes:\n\n> v6: Add license to new file. [Philippe]\n>     Change tests/.gitignore. [Philippe]\n>\n> v5: Generate source tar file with a script.\n>     Fix tmpdir, use pwd.\n>     Reduce default -j to half cores.\n>\n> v4: Drop unused imports and parameters. [Cleber]\n>     Use --exclude-vcs (still no --exclude-vcs-ignores because it's too new). [Philippe]\n>     Use gtar if available. [Philippe, Kamil]\n>     /dev/ld1a -> /dev/rld1a for netbsd. [Kamil]\n>     Only use '-enable-kvm' if /dev/kvm is there. [Kamil]\n>     Grammar fixes of README. [Stefan]\n>     Rename image on the server to include version and arch. [Kamil]\n>     Just ignore *.tmp. [Philippe]\n>\n> v3: Drop RFC.\n>     Add Stefan's and Kamil's reviewed-bys.\n>     Use optparse. [Stefan]\n>     Drop the VGA patch. [Paolo, Stefan]\n>     Improve exit/exit code/doc. [Stefan]\n>     Drop unused line from basevm.py. [Stefan]\n>     Drop \"--target-list\" form Makefile.\n>     More intelligent '-j'.\n>     Add README. [Stefan]\n>\n> v2: - Add docstring. [Stefan]\n>     - Call self._load_io_lod. [Stefan]\n>     - Use \"info usernet\" and dynamic ssh_port forwarding. [Stefan]\n>     - Add image checksum.\n>     - Use os.rename() and os.makedirs(). [Stefan]\n>     - Fix NetBSD URL. [Kamil]\n>\n> Build tests in one 32 bit Linux guest and three BSD images are defined in this\n> series. This is a more managable way than the manually maintained virtual\n> machines in patchew. Also, one big advantage of ephemeral VMs over long running\n> guests is the reduced RAM usage of host, which makes it possible to have one\n> host test all these BSD variants and probably more.\n>\n> The BSD guest templates are manually prepared following\n>\n> https://wiki.qemu.org/Hosts/BSD\n>\n> as it is not easy to automate. (The ideal approach is like the ubuntu.i386\n> script, which configures the guest on top of an official released image, fully\n> automatically.)\n>\n> Need for help: \"gmake check\" in the added OpenBSD image fails with -ENOMEM\n> errors, even if I change \"-m 2G\" to \"-m 8G\" when starting VM. Ideas? And there\n> is a warning from ./configure about OpenBSD going to be unsupported in coming\n> releases, is it still the case?\n\nOK I can't boot any of the VMs so I need some more feedback from the\nscript when things run.\n\n>\n> Fam\n>\n> Fam Zheng (12):\n>   gitignore: Ignore vm test images\n>   qemu.py: Add \"wait()\" method\n>   scripts: Add archive-source.sh\n>   tests: Add vm test lib\n>   tests: Add ubuntu.i386 image\n>   tests: Add FreeBSD image\n>   tests: Add NetBSD image\n>   tests: Add OpenBSD image\n>   Makefile: Add rules to run vm tests\n>   MAINTAINERS: Add tests/vm entry\n>   tests: Add README for vm tests\n>   docker: Use archive-source.py\n>\n>  .gitignore                    |   1 +\n>  MAINTAINERS                   |   1 +\n>  Makefile                      |   2 +\n>  configure                     |   2 +-\n>  scripts/archive-source.sh     |  31 +++++\n>  scripts/qemu.py               |   7 ++\n>  tests/.gitignore              |   1 +\n>  tests/docker/Makefile.include |  15 +--\n>  tests/docker/run              |   8 +-\n>  tests/vm/Makefile.include     |  42 +++++++\n>  tests/vm/README               |  63 ++++++++++\n>  tests/vm/basevm.py            | 276 ++++++++++++++++++++++++++++++++++++++++++\n>  tests/vm/freebsd              |  42 +++++++\n>  tests/vm/netbsd               |  42 +++++++\n>  tests/vm/openbsd              |  43 +++++++\n>  tests/vm/ubuntu.i386          |  88 ++++++++++++++\n>  16 files changed, 643 insertions(+), 21 deletions(-)\n>  create mode 100755 scripts/archive-source.sh\n>  create mode 100644 tests/vm/Makefile.include\n>  create mode 100644 tests/vm/README\n>  create mode 100755 tests/vm/basevm.py\n>  create mode 100755 tests/vm/freebsd\n>  create mode 100755 tests/vm/netbsd\n>  create mode 100755 tests/vm/openbsd\n>  create mode 100755 tests/vm/ubuntu.i386\n\n\n--\nAlex Bennée","headers":{"Return-Path":"<qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org>","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@bilbo.ozlabs.org","Authentication-Results":["ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=nongnu.org\n\t(client-ip=2001:4830:134:3::11; helo=lists.gnu.org;\n\tenvelope-from=qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org;\n\treceiver=<UNKNOWN>)","ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=linaro.org header.i=@linaro.org\n\theader.b=\"LXKFjxEm\"; dkim-atps=neutral"],"Received":["from lists.gnu.org (lists.gnu.org [IPv6:2001:4830:134:3::11])\n\t(using TLSv1 with cipher AES256-SHA (256/256 bits))\n\t(No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xpjHd0CKYz9s81\n\tfor <incoming@patchwork.ozlabs.org>;\n\tSat,  9 Sep 2017 02:21:17 +1000 (AEST)","from localhost ([::1]:46365 helo=lists.gnu.org)\n\tby lists.gnu.org with esmtp (Exim 4.71) (envelope-from\n\t<qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org>)\n\tid 1dqM1r-0005Hp-4L\n\tfor incoming@patchwork.ozlabs.org; Fri, 08 Sep 2017 12:21:15 -0400","from eggs.gnu.org ([2001:4830:134:3::10]:38614)\n\tby lists.gnu.org with esmtp (Exim 4.71)\n\t(envelope-from <alex.bennee@linaro.org>) id 1dqM1C-0005Bx-5G\n\tfor qemu-devel@nongnu.org; Fri, 08 Sep 2017 12:20:35 -0400","from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)\n\t(envelope-from <alex.bennee@linaro.org>) id 1dqM19-0003X5-0D\n\tfor qemu-devel@nongnu.org; Fri, 08 Sep 2017 12:20:34 -0400","from mail-wr0-x234.google.com ([2a00:1450:400c:c0c::234]:35981)\n\tby eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)\n\t(Exim 4.71) (envelope-from <alex.bennee@linaro.org>)\n\tid 1dqM18-0003Wt-Oz\n\tfor qemu-devel@nongnu.org; Fri, 08 Sep 2017 12:20:30 -0400","by mail-wr0-x234.google.com with SMTP id o42so5545190wrb.3\n\tfor <qemu-devel@nongnu.org>; Fri, 08 Sep 2017 09:20:30 -0700 (PDT)","from zen.linaro.local ([81.128.185.34])\n\tby smtp.gmail.com with ESMTPSA id\n\tp46sm2641257wrb.46.2017.09.08.09.20.28\n\t(version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);\n\tFri, 08 Sep 2017 09:20:28 -0700 (PDT)","from zen (localhost [127.0.0.1])\n\tby zen.linaro.local (Postfix) with ESMTPS id F1F7B3E00FA;\n\tFri,  8 Sep 2017 17:20:27 +0100 (BST)"],"DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google;\n\th=references:user-agent:from:to:cc:subject:in-reply-to:date\n\t:message-id:mime-version:content-transfer-encoding;\n\tbh=rnsrpNhZqBcZuvKAwqN/as3BRPTBmY1YdXjx0xqsu2M=;\n\tb=LXKFjxEmNJbFl5r4TH8or3pzlaPlopeIudlvcnfuZNaPuXZybn69VXsTeYfmzBRhOw\n\tinOpDOEZEWB8wCYay9toqjyMXx93v3KMzNxwbofuFqRHG4GAefgiHntk+4xTFSrUt8nN\n\tYRP7zKSl62xLYQ2eP9czFeLpZwxls8fD75Y9Y=","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20161025;\n\th=x-gm-message-state:references:user-agent:from:to:cc:subject\n\t:in-reply-to:date:message-id:mime-version:content-transfer-encoding; \n\tbh=rnsrpNhZqBcZuvKAwqN/as3BRPTBmY1YdXjx0xqsu2M=;\n\tb=p2MRjaS7JJZCkDPUarCqthu+fYyd7Y3uR0xauh+vjGzjkZ9Qzl+H2/7MKPOfOZdUc/\n\tkmoZJeO1JLWQC1xwlVaNwOUtBfpr48H7XJwfv6TiAYxOGMjK/pCaODW5MjQwqms9oBiX\n\tDLy6grBE6JLfrIAZV8ZEWjtncbVcdg3yU6ehwpjM66U/pLuuznJzMpPoPRLDDRHf/LYT\n\tiSRbBkKSYQYnRmTr9CimvdqCeUiKS2njRCEw3fGlazsIHZ0awaa0Z2qbGg/tbCANuypB\n\t4PjCD9SHIwqfF0gza+9Bhnn8dbb+zNYqmk5j6G/Dfz0ZtGZWJQmWMLgn0RuAkca1VnAj\n\t3kSQ==","X-Gm-Message-State":"AHPjjUiryDYBk/WqYkKAvFNF+Tf6FMz9I4TNPa/gq/zCIqhn6P8imvJ+\n\tEaexRjihLZp6lKkZ","X-Google-Smtp-Source":"ADKCNb7evE7Jpv6rsQRcg4wkb1o4YGwI0cA72KkS3kv/1sNZtbPZPmGenOaLeavtOO3LgpCkLIhLqg==","X-Received":"by 10.223.195.37 with SMTP id n34mr2446037wrf.219.1504887629601; \n\tFri, 08 Sep 2017 09:20:29 -0700 (PDT)","References":"<20170905021201.25684-1-famz@redhat.com>","User-agent":"mu4e 0.9.19; emacs 25.2.50.3","From":"Alex =?utf-8?q?Benn=C3=A9e?= <alex.bennee@linaro.org>","To":"Fam Zheng <famz@redhat.com>","In-reply-to":"<20170905021201.25684-1-famz@redhat.com>","Date":"Fri, 08 Sep 2017 17:20:27 +0100","Message-ID":"<87shfxgo1g.fsf@linaro.org>","MIME-Version":"1.0","Content-Type":"text/plain; charset=utf-8","Content-Transfer-Encoding":"8bit","X-detected-operating-system":"by eggs.gnu.org: Genre and OS details not\n\trecognized.","X-Received-From":"2a00:1450:400c:c0c::234","Subject":"Re: [Qemu-devel] [PATCH v6 00/12] tests: Add VM based build tests\n\t(for non-x86_64 and/or non-Linux)","X-BeenThere":"qemu-devel@nongnu.org","X-Mailman-Version":"2.1.21","Precedence":"list","List-Id":"<qemu-devel.nongnu.org>","List-Unsubscribe":"<https://lists.nongnu.org/mailman/options/qemu-devel>,\n\t<mailto:qemu-devel-request@nongnu.org?subject=unsubscribe>","List-Archive":"<http://lists.nongnu.org/archive/html/qemu-devel/>","List-Post":"<mailto:qemu-devel@nongnu.org>","List-Help":"<mailto:qemu-devel-request@nongnu.org?subject=help>","List-Subscribe":"<https://lists.nongnu.org/mailman/listinfo/qemu-devel>,\n\t<mailto:qemu-devel-request@nongnu.org?subject=subscribe>","Cc":"Peter Maydell <peter.maydell@linaro.org>, qemu-devel@nongnu.org, Philippe\n\t=?utf-8?q?Mathieu-Daud=C3=A9?= <f4bug@amsat.org>,\n\tKamil Rytarowski <kamil@netbsd.org>, stefanha@redhat.com, \n\tCleber Rosa <crosa@redhat.com>, pbonzini@redhat.com","Errors-To":"qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org","Sender":"\"Qemu-devel\"\n\t<qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org>"}}]