From patchwork Thu Jul 12 08:41:05 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Christophe Lyon X-Patchwork-Id: 942856 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=gcc.gnu.org (client-ip=209.132.180.131; helo=sourceware.org; envelope-from=gcc-patches-return-481407-incoming=patchwork.ozlabs.org@gcc.gnu.org; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=linaro.org Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=gcc.gnu.org header.i=@gcc.gnu.org header.b="oCn8iLNP"; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=linaro.org header.i=@linaro.org header.b="CoAfSDE+"; dkim-atps=neutral Received: from sourceware.org (server1.sourceware.org [209.132.180.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 41R8Z81GTyz9s1R for ; Thu, 12 Jul 2018 18:42:07 +1000 (AEST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender :mime-version:from:date:message-id:subject:to:content-type; q= dns; s=default; b=X4OjlcySrw4yVOcKHDbyg2V/dNqEQSYDPjMwgX8uA9CpOw GH43Xtc/kS3Y0qZrDo/E16IYxwOtNNOARqccwxGeVOLgMpiwn+fhMOzV/xgVduJO XcruTTsqgnAF4fW2d0ALiZLkVbekqaAat2is2kMMeucCWXVIUy4DpLc0pbLbI= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender :mime-version:from:date:message-id:subject:to:content-type; s= default; bh=6qMQ4lwa5/spwVDU4ZK0gZASsx4=; b=oCn8iLNP+iXNEIOxNK3y kXXvyu+EYyHDoyvJR7qu9jk9eTWvgjlMN7gwy4vvWsHcmSgng06ue9PYnJ5i1RP9 zpryMBDu2kC4+26CokOTuQGd2UdV11NfY7eC7IxXohrnyOdRMLVVcAG4+q2e3IwL QSF49TJ6hdWm5JCrfWTXgik= Received: (qmail 36349 invoked by alias); 12 Jul 2018 08:41:55 -0000 Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org Delivered-To: mailing list gcc-patches@gcc.gnu.org Received: (qmail 36132 invoked by uid 89); 12 Jul 2018 08:41:20 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-25.2 required=5.0 tests=AWL, BAYES_00, GIT_PATCH_0, GIT_PATCH_1, GIT_PATCH_2, GIT_PATCH_3, RCVD_IN_DNSWL_NONE, SPF_PASS autolearn=ham version=3.3.2 spammy= X-HELO: mail-ua0-f173.google.com Received: from mail-ua0-f173.google.com (HELO mail-ua0-f173.google.com) (209.85.217.173) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Thu, 12 Jul 2018 08:41:19 +0000 Received: by mail-ua0-f173.google.com with SMTP id x18-v6so17925429uaj.9 for ; Thu, 12 Jul 2018 01:41:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:from:date:message-id:subject:to; bh=Rkt8BCBheyxoWSYh7jQlDFp/rfuyWDYdxW/2NPdRj+s=; b=CoAfSDE+fqcwEnRLWS47wnH3HP3wg3+2LZr2H8pTACpCYXWoLwxxPevooEw7/VijZD ffaACu++rX+6ALpC1ogGKKVQ5xpwB0pQkJh2qBcseSg4GCdpP1cshUAtOp4IPTfmOlpH BCeYZP2jdlIyxvLryrtnus0LowtsgFm8JMkI4= MIME-Version: 1.0 From: Christophe Lyon Date: Thu, 12 Jul 2018 10:41:05 +0200 Message-ID: Subject: [contrib] compare_tests: Print number of tests To: gcc Patches X-IsSubscribed: yes Hi, It can be useful to print the number of tests in each category, eg: Tests that now work, but didn't before (65 tests): instead of Tests that now work, but didn't before: This small patch does that. OK? Thanks, Christophe contrib/ChangeLog: 2018-07-12 Christophe Lyon * compare_tests: Print number of tests in each category. diff --git a/contrib/compare_tests b/contrib/compare_tests index 51a3719..2dfa864 100755 --- a/contrib/compare_tests +++ b/contrib/compare_tests @@ -129,7 +129,8 @@ grep '^PASS' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -12 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Tests that now fail, but worked before:" + num=`cat $tmp2 | wc -l` + echo "Tests that now fail, but worked before ($num tests):" echo cat $tmp2 echo @@ -141,7 +142,8 @@ grep '^FAIL' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -12 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Tests that now work, but didn't before:" + num=`cat $tmp2 | wc -l` + echo "Tests that now work, but didn't before ($num tests):" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -153,7 +155,8 @@ grep '^[PF]A[SI][SL]' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -23 $tmp1 - >$t grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "New tests that FAIL:" + num=`cat $tmp2 | wc -l` + echo "New tests that FAIL ($num tests):" echo cat $tmp2 echo @@ -165,7 +168,8 @@ grep '^[PF]A[SI][SL]' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -23 $tmp1 - >$t grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "New tests that PASS:" + num=`cat $tmp2 | wc -l` + echo "New tests that PASS ($num tests):" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -177,7 +181,8 @@ grep '^PASS' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -13 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Old tests that passed, that have disappeared: (Eeek!)" + num=`cat $tmp2 | wc -l` + echo "Old tests that passed, that have disappeared ($num tests): (Eeek!)" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -189,7 +194,8 @@ grep '^FAIL' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -13 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Old tests that failed, that have disappeared: (Eeek!)" + num=`cat $tmp2 | wc -l` + echo "Old tests that failed, that have disappeared ($num tests): (Eeek!)" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1