[{"id":1763199,"web_url":"http://patchwork.ozlabs.org/comment/1763199/","msgid":"","list_archive_url":null,"date":"2017-09-05T10:39:50","subject":"Re: [LEDE-DEV] [PATCH 1/2] target/toolchain: Switch to xz\n\tcompression instead of bz2","submitter":{"id":65315,"url":"http://patchwork.ozlabs.org/api/people/65315/","name":"Karl Palsson","email":"karlp@tweak.net.au"},"content":"This is going to make builds _much_ slower :( \n\n\nKoen Vandeputte wrote:\n> Switch to xz compression instead of bz2\n> This reduces the output size here from 41M to 29M\n> \n> Signed-off-by: Koen Vandeputte \n> ---\n> target/toolchain/Makefile | 8 ++++----\n> 1 file changed, 4 insertions(+), 4 deletions(-)\n> \n> diff --git a/target/toolchain/Makefile\n> b/target/toolchain/Makefile index ef2dc68..da1a6d2 100644\n> --- a/target/toolchain/Makefile\n> +++ b/target/toolchain/Makefile\n> @@ -26,7 +26,7 @@ all: compile\n> \n> TOOLCHAIN_PREFIX:=$(TOOLCHAIN_BUILD_DIR)/toolchain-$(ARCH)$(ARCH_SUFFIX)_gcc-$(GCCV)$(DIR_SUFFIX)\n> \n> -$(BIN_DIR)/$(TOOLCHAIN_NAME).tar.bz2: clean\n> +$(BIN_DIR)/$(TOOLCHAIN_NAME).tar.xz: clean\n> \tmkdir -p $(TOOLCHAIN_BUILD_DIR)\n> \t$(TAR) -cf - -C $(TOPDIR)/staging_dir/ \\\n> \t $(foreach exclude,$(EXCLUDE_DIRS),--exclude=\"$(exclude)\") \\\n> @@ -59,13 +59,13 @@ $(BIN_DIR)/$(TOOLCHAIN_NAME).tar.bz2: clean\n> \tfind $(TOOLCHAIN_BUILD_DIR) -name CVS | $(XARGS) rm -rf\n> \tmkdir -p $(BIN_DIR)\n> \t(cd $(BUILD_DIR); \\\n> -\t\ttar cfj $@ $(TOOLCHAIN_NAME); \\\n> +\t\ttar cfJ $@ $(TOOLCHAIN_NAME); \\\n> \t)\n> \n> download:\n> prepare:\n> -compile: $(BIN_DIR)/$(TOOLCHAIN_NAME).tar.bz2\n> +compile: $(BIN_DIR)/$(TOOLCHAIN_NAME).tar.xz\n> install: compile\n> \n> clean:\n> -\trm -rf $(TOOLCHAIN_BUILD_DIR) $(BIN_DIR)/$(TOOLCHAIN_NAME).tar.bz2\n> +\trm -rf $(TOOLCHAIN_BUILD_DIR) $(BIN_DIR)/$(TOOLCHAIN_NAME).tar.xz\n> -- \n> 2.7.4\n> \n> \n> _______________________________________________\n> Lede-dev mailing list\n> Lede-dev@lists.infradead.org\n> http://lists.infradead.org/mailman/listinfo/lede-dev","headers":{"Return-Path":"","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@bilbo.ozlabs.org","Authentication-Results":["ozlabs.org; spf=none (mailfrom)\n\tsmtp.mailfrom=lists.infradead.org (client-ip=65.50.211.133;\n\thelo=bombadil.infradead.org;\n\tenvelope-from=lede-dev-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org;\n\treceiver=)","ozlabs.org; dkim=pass (2048-bit key;\n\tunprotected) header.d=lists.infradead.org\n\theader.i=@lists.infradead.org header.b=\"aJNV5HK1\"; \n\tdkim-atps=neutral"],"Received":["from bombadil.infradead.org (bombadil.infradead.org\n\t[65.50.211.133])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xmjvz73VTz9sNr\n\tfor ;\n\tTue, 5 Sep 2017 20:42:23 +1000 (AEST)","from localhost ([127.0.0.1] helo=bombadil.infradead.org)\n\tby bombadil.infradead.org with esmtp (Exim 4.87 #1 (Red Hat Linux))\n\tid 1dpBIy-0000sX-LK; Tue, 05 Sep 2017 10:42:04 +0000","from palmtree.beeroclock.net ([2a01:7e00::f03c:91ff:fe93:f66c])\n\tby bombadil.infradead.org with esmtps (Exim 4.87 #1 (Red Hat Linux))\n\tid 1dpBIu-0000nS-Fi\n\tfor lede-dev@lists.infradead.org; Tue, 05 Sep 2017 10:42:02 +0000","from mailpile.local (palmtree.beeroclock.net\n\t[IPv6:2a01:7e00::f03c:91ff:fe93:f66c])\n\t(using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))\n\t(No client certificate requested) (Authenticated sender: karlp)\n\tby palmtree.beeroclock.net (Postfix) with ESMTPSA id 91EDC1015D;\n\tTue, 5 Sep 2017 10:41:14 +0000 (UTC)"],"DKIM-Signature":"v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;\n\td=lists.infradead.org; s=bombadil.20170209; h=Sender:Content-Type:Cc:\n\tList-Subscribe:List-Help:List-Post:List-Archive:List-Unsubscribe:List-Id:\n\tSubject:Date:Message-Id:References:In-Reply-To:To:From:MIME-Version:Reply-To:\n\tContent-Transfer-Encoding:Content-ID:Content-Description:Resent-Date:\n\tResent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner;\n\tbh=9E7ojXKWNL8FToNtOFx487mMQk/JB2p+V4BeuOCyIek=;\n\tb=aJNV5HK1DyU05UWL77a8vp+bs\n\tmhhB+93OiWuaklwp10oIPrj2QfNBmOODchg3JJGYQIfu+2qNRwPi8vZzivZ4yxWfMW5WJ0MU44tTN\n\t9iZ1lXS6VzB/FjLMZtYXXCT9gWY0hVmOv6eRRBfTKfZgPhw3oxa3DmGG3BFfRsJ283s/Xi6xjB+se\n\tCIOdF1VgnnRxAko0KyOrO3+VbUUQY0iw1UsT7wykBZQ730d6LUnu94+n/loUtLtyarwAfGn6qp5o7\n\tlui3w9ER/AuWRcrSDiMmWlEWnKTFHVVunCsYDfwLdcDMitamsaRI6mP9K4YBmF6WLWEMK25IjqNYs\n\tuksoOCNYA==;","MIME-Version":"1.0","From":"Karl Palsson ","To":"\"Koen Vandeputte\" ","In-Reply-To":"<1504538663-32751-1-git-send-email-koen.vandeputte@ncentric.com>","References":"<1504538663-32751-1-git-send-email-koen.vandeputte@ncentric.com>","User-Agent":"Mailpile","Message-Id":"","Date":"Tue, 05 Sep 2017 10:39:50 -0000","OpenPGP":"id=9F020B9C40DA5E6F2CAF63B319A8B50FD4D5CAF6; preference=signencrypt","X-CRM114-Version":"20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 ","X-CRM114-CacheID":"sfid-20170905_034200_857669_A9E1131E ","X-CRM114-Status":"GOOD ( 10.41 )","X-Spam-Score":"-1.9 (-)","X-Spam-Report":"SpamAssassin version 3.4.1 on bombadil.infradead.org summary:\n\tContent analysis details: (-1.9 points)\n\tpts rule name description\n\t---- ----------------------\n\t--------------------------------------------------\n\t-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%\n\t[score: 0.0000]\n\t0.0 T_HTML_ATTACH HTML attachment to bypass scanning?","Subject":"Re: [LEDE-DEV] [PATCH 1/2] target/toolchain: Switch to xz\n\tcompression instead of bz2","X-BeenThere":"lede-dev@lists.infradead.org","X-Mailman-Version":"2.1.21","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Cc":"lede-dev@lists.infradead.org","Content-Type":"multipart/mixed;\n\tboundary=\"===============0423189932179373833==\"","Sender":"\"Lede-dev\" ","Errors-To":"lede-dev-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org"}},{"id":1763288,"web_url":"http://patchwork.ozlabs.org/comment/1763288/","msgid":"","list_archive_url":null,"date":"2017-09-05T12:23:36","subject":"Re: [LEDE-DEV] [PATCH 1/2] target/toolchain: Switch to xz\n\tcompression instead of bz2","submitter":{"id":69184,"url":"http://patchwork.ozlabs.org/api/people/69184/","name":"Koen Vandeputte","email":"koen.vandeputte@ncentric.com"},"content":"On 2017-09-05 12:39, Karl Palsson wrote:\n> This is going to make builds _much_ slower :(\n>\n\nHi Karl,\n\nYou are right, but the main reasons for this patch were:\n\n- Use same output as ie. target/SDK (cleanup)\n- Toolchain build is disabled by default (as is SDK)\n- Eventually switch to multithreaded version for XZ (like your patch [1])\n\n\n\nI've done some benchmarks on a machine here (i7 4770K):\n\n\ntar bz2: 0m19.271s (now)\ntar cfJ: 1m3.384s\nxz: 1m19.958s (patch)\nxz - T 0: 0m38.587s (Future with -T 0 ?)\n\n\n[1] http://patchwork.ozlabs.org/patch/802620/\n\nKoen","headers":{"Return-Path":"","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@bilbo.ozlabs.org","Authentication-Results":["ozlabs.org; spf=none (mailfrom)\n\tsmtp.mailfrom=lists.infradead.org (client-ip=65.50.211.133;\n\thelo=bombadil.infradead.org;\n\tenvelope-from=lede-dev-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org;\n\treceiver=)","ozlabs.org; dkim=pass (2048-bit key;\n\tunprotected) header.d=lists.infradead.org\n\theader.i=@lists.infradead.org header.b=\"MYtkOw55\"; \n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=ncentric.com header.i=@ncentric.com\n\theader.b=\"BE84MLPG\"; dkim-atps=neutral"],"Received":["from bombadil.infradead.org (bombadil.infradead.org\n\t[65.50.211.133])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xmm9c2MDFz9sRV\n\tfor ;\n\tTue, 5 Sep 2017 22:24:20 +1000 (AEST)","from localhost ([127.0.0.1] helo=bombadil.infradead.org)\n\tby bombadil.infradead.org with esmtp (Exim 4.87 #1 (Red Hat Linux))\n\tid 1dpCti-0008Tc-51; Tue, 05 Sep 2017 12:24:06 +0000","from mail-wm0-x22d.google.com ([2a00:1450:400c:c09::22d])\n\tby bombadil.infradead.org with esmtps (Exim 4.87 #1 (Red Hat Linux))\n\tid 1dpCtc-0008A5-3N\n\tfor lede-dev@lists.infradead.org; Tue, 05 Sep 2017 12:24:05 +0000","by mail-wm0-x22d.google.com with SMTP id 187so18375156wmn.1\n\tfor ;\n\tTue, 05 Sep 2017 05:23:39 -0700 (PDT)","from [192.168.3.153] (d515300d8.static.telenet.be. [81.83.0.216])\n\tby smtp.gmail.com with ESMTPSA id\n\tz8sm167722edb.32.2017.09.05.05.23.36\n\t(version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);\n\tTue, 05 Sep 2017 05:23:37 -0700 (PDT)"],"DKIM-Signature":["v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed;\n\td=lists.infradead.org; s=bombadil.20170209; h=Sender:Content-Type:\n\tContent-Transfer-Encoding:Cc:List-Subscribe:List-Help:List-Post:List-Archive:\n\tList-Unsubscribe:List-Id:Subject:In-Reply-To:MIME-Version:Date:Message-ID:\n\tFrom:References:To:Reply-To:Content-ID:Content-Description:Resent-Date:\n\tResent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner;\n\tbh=mp1hulr7ASBOdad4hAB6UgUnyNEldDxrAV8Oi4xDMow=;\n\tb=MYtkOw55SpL6m6wXrwEroyy4l\n\tUFQf+MVJMnmPePq3SG7L+PdoEs7rACED0Q00k86Cc2my2/OOvTrgr7k6AjFztanztBqOiW8NLq/YL\n\tWpFvJbixfxzLk4D5m0GDPal3rEfRiS2RKeWc5ZcPyoMmlhyNjBCqjFmHW5tC/waKQoSvXsGVYhz/I\n\tn3iOVX8s0kots82PO5hrHYlMFe5U8+E9LS3Cq3PrebA789jjCu8SWrMeSxpQeZbIBNmn8PfXIJ5Z+\n\t8G0hKS2PhImSHwuvgL6zlMqeudkUnsWwTISwrE0w+8OM6DvnPe0Eyq04yByxsv6i1GwIuQb6z5PiD\n\tuKlpvpZog==;","v=1; a=rsa-sha256; c=relaxed/relaxed; d=ncentric.com;\n\ts=google; \n\th=subject:to:cc:references:from:message-id:date:user-agent\n\t:mime-version:in-reply-to:content-transfer-encoding:content-language; \n\tbh=VPlscQv86HcYxMbZ5J7MA2/Y+uQDXXf5j9Ct0al2Vmg=;\n\tb=BE84MLPG5BRjTS4iZNuc8PqdxFC5BVcZqjsQnveacb1V6g2qUGNoppIQcRcIFds47K\n\t1Stynt/0kCgq4hlAmPp0TmUXrsIVEElwhZfYSq6TDUE1qK2WGl4dMIkwPXGGKgcxYKpT\n\tKiQZMnlg1BIvt7cNtpJtKdTs0a0akFdfiuzpU="],"X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20161025;\n\th=x-gm-message-state:subject:to:cc:references:from:message-id:date\n\t:user-agent:mime-version:in-reply-to:content-transfer-encoding\n\t:content-language;\n\tbh=VPlscQv86HcYxMbZ5J7MA2/Y+uQDXXf5j9Ct0al2Vmg=;\n\tb=r7z6bLVKhIn0tKS195p2EH23lLMnkopJYRWrTBrqkYUsV3Hr8iVVzajQhtWsI9qE3t\n\t1E3OEEj+15019b9wg7MK8FI0iJC+x3LLkpcuJeH0gSoyTSSnuCeMsGvidoOgf3pDI4Ho\n\tY7ibUJi42Z9iHkYrvbHKkn2YFb/ehElMy3UKe0O/T6PnLmhB0rtGBv21ThIb1n3Ohb9l\n\tyHwdGyIS21D3zZnU9XvxMSzuqH4KyZWOYM6Zq1UTc6ORF+2SlNGseJNrsdBC99rrjQiO\n\t5xESwmAKh/aUNBWKNTL2xqRnOLC89lGFe3wYgu3lvEDnkjPLFIs5PqeEg+8y+wXD0tiB\n\tWGwA==","X-Gm-Message-State":"AHPjjUia3rItqBonT7aSvtBf/2iRCIhMgb1Fh7dgPIfuLXhWNDOajfUI\n\tViq2xXnMKP8+xYXV5s0lqA==","X-Google-Smtp-Source":"ADKCNb4KzxXQLFB+QpUtt4uUi2P2j2m1NbqYEZvnldb6XqROhVZYrDsEbagZOfcIPTuSW6S8eD0ERA==","X-Received":"by 10.80.203.140 with SMTP id k12mr1436742edi.46.1504614217601; \n\tTue, 05 Sep 2017 05:23:37 -0700 (PDT)","To":"Karl Palsson ","References":"<1504538663-32751-1-git-send-email-koen.vandeputte@ncentric.com>\n\t","From":"Koen Vandeputte ","Message-ID":"","Date":"Tue, 5 Sep 2017 14:23:36 +0200","User-Agent":"Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101\n\tThunderbird/52.2.1","MIME-Version":"1.0","In-Reply-To":"","Content-Language":"en-US","X-CRM114-Version":"20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 ","X-CRM114-CacheID":"sfid-20170905_052400_907759_EA8B30A7 ","X-CRM114-Status":"UNSURE ( 7.44 )","X-CRM114-Notice":"Please train this message.","X-Spam-Score":"-2.7 (--)","X-Spam-Report":"SpamAssassin version 3.4.1 on bombadil.infradead.org summary:\n\tContent analysis details: (-2.7 points)\n\tpts rule name description\n\t---- ----------------------\n\t--------------------------------------------------\n\t-0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/,\n\tlow\n\ttrust [2a00:1450:400c:c09:0:0:0:22d listed in] [list.dnswl.org]\n\t-0.0 SPF_PASS SPF: sender matches SPF record\n\t-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%\n\t[score: 0.0000]\n\t-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature\n\t0.1 DKIM_SIGNED Message has a DKIM or DK signature,\n\tnot necessarily valid\n\t-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from\n\tauthor's domain","Subject":"Re: [LEDE-DEV] [PATCH 1/2] target/toolchain: Switch to xz\n\tcompression instead of bz2","X-BeenThere":"lede-dev@lists.infradead.org","X-Mailman-Version":"2.1.21","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Cc":"lede-dev@lists.infradead.org","Content-Transfer-Encoding":"7bit","Content-Type":"text/plain; charset=\"us-ascii\"; Format=\"flowed\"","Sender":"\"Lede-dev\" ","Errors-To":"lede-dev-bounces+incoming=patchwork.ozlabs.org@lists.infradead.org"}}]