From patchwork Tue Dec 11 22:46:56 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Leonardo Sandoval X-Patchwork-Id: 1011411 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=sourceware.org (client-ip=209.132.180.131; helo=sourceware.org; envelope-from=libc-alpha-return-98243-incoming=patchwork.ozlabs.org@sourceware.org; receiver=) Authentication-Results: ozlabs.org; dmarc=none (p=none dis=none) header.from=linux.intel.com Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; secure) header.d=sourceware.org header.i=@sourceware.org header.b="vOt2e5Hc"; dkim-atps=neutral Received: from sourceware.org (server1.sourceware.org [209.132.180.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 43Dw745Rl6z9s3l for ; Wed, 12 Dec 2018 09:47:11 +1100 (AEDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:from:to:cc:subject:date:message-id :mime-version:content-transfer-encoding; q=dns; s=default; b=rV8 ZzcEDLh31RI/CI7pSsdsWhTEjclxWk7k8+YZz1w6UuLY7EDh52I3sbUSCP3/rlxv /vcnpi4Rzz7b2iuNf9d67HKiTB3mpUu3v7INtLJEq12xXJoiC6dVwPZ71rI+i02W cyR+aOHQc6gaXH7FZoQKdi+xgdAaSH1m0gQQZ5Ck= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sourceware.org; h=list-id :list-unsubscribe:list-subscribe:list-archive:list-post :list-help:sender:from:to:cc:subject:date:message-id :mime-version:content-transfer-encoding; s=default; bh=JdjvZy8ju LlIRD9UQ9DNWNORFCM=; b=vOt2e5HcE34F09h2pgg+//+hESgP/fw8l/DtVlptY ChbBpzMoEWa0i+hHFBkaQoH6Efgd7BJSqngn9N4w0QJVX4hnwOuo7NnFZ+S+XlY5 RcoNf5O0jYpfZxSvr6o0vkJjL5mhnA93zA34CuIqEbwe8Huy7Cr7EW06mPWnyr2W nE= Received: (qmail 45582 invoked by alias); 11 Dec 2018 22:47:05 -0000 Mailing-List: contact libc-alpha-help@sourceware.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Subscribe: List-Archive: List-Post: List-Help: , Sender: libc-alpha-owner@sourceware.org Delivered-To: mailing list libc-alpha@sourceware.org Received: (qmail 45565 invoked by uid 89); 11 Dec 2018 22:47:05 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-5.9 required=5.0 tests=BAYES_00, GIT_PATCH_2, KAM_LAZY_DOMAIN_SECURITY autolearn=ham version=3.3.2 spammy=HContent-Transfer-Encoding:8bit X-HELO: mga11.intel.com From: leonardo.sandoval.gonzalez@linux.intel.com To: libc-alpha@sourceware.org Cc: Leonardo Sandoval Subject: [PATCH v2 0/3] benchtests: keep comparing in case of missing fields Date: Tue, 11 Dec 2018 16:46:56 -0600 Message-Id: <20181211224659.29876-1-leonardo.sandoval.gonzalez@linux.intel.com> MIME-Version: 1.0 From: Leonardo Sandoval Without this patch series, the script immediately quits the first time a routine to compare has neither 'timings' nor 'min/mean' stats field, so making it useless at least for bench-math benchset. Also, it includes a new argument that allows user to define the desired statistic(s), defaulting to min and mean. Leonardo Sandoval (3): benchtests: keep comparing even if function timings do not match benchtests: include --stats parameter benchtests: send non-consumable data to stderr benchtests/scripts/compare_bench.py | 34 +++++++++++++++++++---------- 1 file changed, 22 insertions(+), 12 deletions(-)