From patchwork Sun Oct 29 17:14:35 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Thomas Petazzoni X-Patchwork-Id: 831773 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=busybox.net (client-ip=140.211.166.137; helo=fraxinus.osuosl.org; envelope-from=buildroot-bounces@busybox.net; receiver=) Received: from fraxinus.osuosl.org (smtp4.osuosl.org [140.211.166.137]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 3yQ4486KRSz9t5q for ; Mon, 30 Oct 2017 04:15:04 +1100 (AEDT) Received: from localhost (localhost [127.0.0.1]) by fraxinus.osuosl.org (Postfix) with ESMTP id AD0AA87548; Sun, 29 Oct 2017 17:15:02 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from fraxinus.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3oVysE1ahfsV; Sun, 29 Oct 2017 17:14:56 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by fraxinus.osuosl.org (Postfix) with ESMTP id A22468752A; Sun, 29 Oct 2017 17:14:56 +0000 (UTC) X-Original-To: buildroot@lists.busybox.net Delivered-To: buildroot@osuosl.org Received: from hemlock.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by ash.osuosl.org (Postfix) with ESMTP id 01D7F1C4379 for ; Sun, 29 Oct 2017 17:14:50 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by hemlock.osuosl.org (Postfix) with ESMTP id EEFE388716 for ; Sun, 29 Oct 2017 17:14:49 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from hemlock.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id K0yPiaf5z6St for ; Sun, 29 Oct 2017 17:14:46 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail.free-electrons.com (mail.free-electrons.com [62.4.15.54]) by hemlock.osuosl.org (Postfix) with ESMTP id 211CC8843B for ; Sun, 29 Oct 2017 17:14:45 +0000 (UTC) Received: by mail.free-electrons.com (Postfix, from userid 110) id E16D820765; Sun, 29 Oct 2017 18:14:42 +0100 (CET) Received: from localhost (unknown [77.147.230.132]) by mail.free-electrons.com (Postfix) with ESMTPSA id 971E02039F; Sun, 29 Oct 2017 18:14:42 +0100 (CET) From: Thomas Petazzoni To: "Yann E. MORIN" , "Arnout Vandecappelle (Essensium/Mind)" , Peter Korsgaard , Buildroot List Date: Sun, 29 Oct 2017 18:14:35 +0100 Message-Id: <20171029171440.8095-1-thomas.petazzoni@free-electrons.com> X-Mailer: git-send-email 2.13.6 Cc: Thomas Petazzoni Subject: [Buildroot] [PATCH 0/5] test-pkg: by default only test a subset of toolchains X-BeenThere: buildroot@busybox.net X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Errors-To: buildroot-bounces@busybox.net Sender: "buildroot" Hello, During the Buildroot Developers meeting, we discussed how to make test-pkg more usable for our contributors. Our idea is that test-pkg should not test all toolchains by default, but only a smaller subset of "interesting" toolchains, that exhibit the most common problems we encounter with new packages. This series does that by: - Fixing genrandconfig and test-pkg to ignore comments and empty lines in the toolchain CSV file. - Adjust the toolchain CSV file to have the interesting toolchains first, adding comments and empty lines along the way to clarify what is going on. - Update test-pkg to test only the first 7 toolchains, add a --all option to test all toolchains, and a --number option to test only the first N toolchains. - Update the Buildroot manual accordingly. Thanks! Thomas Thomas Petazzoni (5): utils/genrandconfig: filter empty lines and comments in CSV file test-pkg: filter empty lines and comments in CSV file toolchain-configs.csv: re-organize for test-pkg test-pkg: test a subset of toolchains by default, add -a and -n options docs/manual: update the documentation about test-pkg docs/manual/adding-packages-tips.txt | 11 ++-- .../autobuild/toolchain-configs.csv | 30 ++++++++--- utils/genrandconfig | 5 +- utils/test-pkg | 58 +++++++++++++++++++--- 4 files changed, 86 insertions(+), 18 deletions(-)