From patchwork Sat Mar 7 07:56:21 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Heiko Thiery X-Patchwork-Id: 1250840 Return-Path: X-Original-To: incoming-buildroot@patchwork.ozlabs.org Delivered-To: patchwork-incoming-buildroot@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=busybox.net (client-ip=140.211.166.133; helo=hemlock.osuosl.org; envelope-from=buildroot-bounces@busybox.net; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: ozlabs.org; dkim=fail reason="signature verification failed" (2048-bit key; unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20161025 header.b=kYPxFc5r; dkim-atps=neutral Received: from hemlock.osuosl.org (smtp2.osuosl.org [140.211.166.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 48ZGz22cD5z9sPK for ; Sat, 7 Mar 2020 18:56:46 +1100 (AEDT) Received: from localhost (localhost [127.0.0.1]) by hemlock.osuosl.org (Postfix) with ESMTP id 00B7188173; Sat, 7 Mar 2020 07:56:44 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from hemlock.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id D-K8ALqJwiB9; Sat, 7 Mar 2020 07:56:42 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by hemlock.osuosl.org (Postfix) with ESMTP id 7ED5387E3D; Sat, 7 Mar 2020 07:56:42 +0000 (UTC) X-Original-To: buildroot@lists.busybox.net Delivered-To: buildroot@osuosl.org Received: from silver.osuosl.org (smtp3.osuosl.org [140.211.166.136]) by ash.osuosl.org (Postfix) with ESMTP id 776CE1BF42C for ; Sat, 7 Mar 2020 07:56:40 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by silver.osuosl.org (Postfix) with ESMTP id 700E320356 for ; Sat, 7 Mar 2020 07:56:40 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from silver.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jxXzHlO-bjrq for ; Sat, 7 Mar 2020 07:56:39 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-wr1-f46.google.com (mail-wr1-f46.google.com [209.85.221.46]) by silver.osuosl.org (Postfix) with ESMTPS id 5427D1FE2F for ; Sat, 7 Mar 2020 07:56:39 +0000 (UTC) Received: by mail-wr1-f46.google.com with SMTP id s5so1054686wrg.3 for ; Fri, 06 Mar 2020 23:56:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=oFNCRna4yELqGM8oTHyHdv+KsB0cwjXnJiEPLB3IaQw=; b=kYPxFc5r44GWr2bSK+sB6jSuQrFGQKNJKCYCMZ0b9ztWpHc0MetsNQr+7oUFlQYxR8 1Q+B5GiKgJVQwyO2hdiQ0+bqtmC0RgAuw3c/n9M3buLYWI9z+Eio0/bbhWNMhm52ycsB 2vUD35TluwuWf15ebHqxb45jXTVH/I1hOIRqt5Pf1Ivp5VpTRsGXnye82G1UAABTR0mG f0Jt3icF30jix9dTdx9UGeoejxksvYjts9S40JopiU2K+m6hJLtuH/or3IO252rou/nx 7xK1McxfCYIlYTDd6TNA7EwoL2Kp8eSiBJfrpGQc+7l3Z5YU7ROxt07gdbhfeZSBlv++ 13Vg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=oFNCRna4yELqGM8oTHyHdv+KsB0cwjXnJiEPLB3IaQw=; b=qa/tdChmQ5zUAJAOtZ8enAWxBXz6aTY79N4WdAAuSSxXfnpbos+h7865YITOCPMVpj fSOjytKFZjLlOSima/r6yQgtjKH11GnRVAecT/Mg8eij+7YlZ/tSFmLc8NydoYk+luSx RYEi0Hy3Olu+Wg4uXqiYhsW1QtVhEQ5dEAy7aUzdYN8I25Xdkqkab/M3FlKGe99ciVpj WIqrSQQuNy96VxqUJi/rD/cx1OQLVNki06aq22a808joU137R2F2nn1z0P9N2w8bOupR qOL66IdyQs0AMsU+HmQru+nSnvlJDGfA+YSQg+IrEooJnJewfSIm01RmV7SDpo5rMIXh vO4g== X-Gm-Message-State: ANhLgQ1T9YiUoJjCFXwJFuP+v67GCrqkw7yJxownk3XEr7q8sCetPhya upi1//kHvBTHvlxm+T26/NmMsBxU X-Google-Smtp-Source: ADFU+vvYsTpl4/CSWOP6IXXCW9XE69/qbJlO+s8V5xxtaA11h6huI+jZgiEnk4WP1Yi+DaaTKlvNFw== X-Received: by 2002:a5d:5506:: with SMTP id b6mr7996097wrv.94.1583567797444; Fri, 06 Mar 2020 23:56:37 -0800 (PST) Received: from t450s.fritz.box (ip5f58981a.dynamic.kabel-deutschland.de. [95.88.152.26]) by smtp.gmail.com with ESMTPSA id g129sm19189071wmg.12.2020.03.06.23.56.36 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 06 Mar 2020 23:56:36 -0800 (PST) From: Heiko Thiery To: buildroot@buildroot.org Date: Sat, 7 Mar 2020 08:56:21 +0100 Message-Id: <20200307075633.7514-1-heiko.thiery@gmail.com> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Subject: [Buildroot] [PATCH v5 00/12] pkg-stats json output improvements X-BeenThere: buildroot@busybox.net X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Heiko Thiery , Thomas Petazzoni , Titouan Christophe Errors-To: buildroot-bounces@busybox.net Sender: "buildroot" - add developers information to the packages - add supported defconfigs to json - add license information to json - add license file information to json - add patch files to json - add a more generic check status field to the packages for easier post processing. The following check status are availble: checks: cve, license, license-files, hash, hash-license,patches, version, url, developers, pkg-check --- v4 -> v5: - fix failure while applying to master v3 -> v4: Included the review comments from Titouan - use only one signed-off mail address - do some things in a more pythonic way - remove the patch_count attribute and use a class property instead (Note that the patch_count value will not go into the json output anymore,but then coutn can be computed by "len(patch_files)".) - remove the status initializer in the package class that was introduced in v3 - update the cve status at the end of the cve check loop - change the is_valid_infra -> has_valid_infra and use it as property v2 -> v3: - keep variable latest_release but change format - add check for license file hashes - introduce a na status for the checks - add a list of all possible checks to the json output - add the cve check status v1 -> v2: - cleanup and recreation of patches - remove pkg name from dumping to json - use patch_files instead of combine count and files in dict - include getdevelopers.py to reuse Developers class --- Heiko Thiery (12): support/scripts/pkg-stats: store latest version in a dict support/scripts/pkg-stats: store patch files for the package support/scripts/pkg-stats: set developers info support/scripts/pkg-stats: store licences of package support/scripts/pkg-stats: add package status support/scripts/pkg-stats: add package count to stats support/scripts/pkg-stats: store pkg dir path support/scripts/pkg-stats: add defconfig support support/scripts/pkg-stats: add support for license hash check support/scripts/pkg-stats: set status to 'na' for virtual packages support/scripts/pkg-stats: initialize all package status checks support/scripts/pkg-stats: add status for cve check support/scripts/pkg-stats | 271 +++++++++++++++++++++++++++++--------- 1 file changed, 211 insertions(+), 60 deletions(-)