{"id":808200,"url":"http://patchwork.ozlabs.org/api/1.0/patches/808200/?format=json","project":{"id":14,"url":"http://patchwork.ozlabs.org/api/1.0/projects/14/?format=json","name":"QEMU Development","link_name":"qemu-devel","list_id":"qemu-devel.nongnu.org","list_email":"qemu-devel@nongnu.org","web_url":"","scm_url":"","webscm_url":""},"msgid":"<20170831110518.10741-2-berrange@redhat.com>","date":"2017-08-31T11:05:15","name":"[v2,1/4] block: use 1 MB bounce buffers for crypto instead of 16KB","commit_ref":null,"pull_url":null,"state":"new","archived":false,"hash":"a6da3ff8e4dcc49522e38df4cce9e369af0c0171","submitter":{"id":2694,"url":"http://patchwork.ozlabs.org/api/1.0/people/2694/?format=json","name":"Daniel P. Berrangé","email":"berrange@redhat.com"},"delegate":null,"mbox":"http://patchwork.ozlabs.org/project/qemu-devel/patch/20170831110518.10741-2-berrange@redhat.com/mbox/","series":[{"id":795,"url":"http://patchwork.ozlabs.org/api/1.0/series/795/?format=json","date":"2017-08-31T11:05:16","name":"block: improve luks driver perf & switch to byte APIs","version":2,"mbox":"http://patchwork.ozlabs.org/series/795/mbox/"}],"check":"pending","checks":"http://patchwork.ozlabs.org/api/patches/808200/checks/","tags":{},"headers":{"Return-Path":"","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@bilbo.ozlabs.org","Authentication-Results":["ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=nongnu.org\n\t(client-ip=2001:4830:134:3::11; helo=lists.gnu.org;\n\tenvelope-from=qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org;\n\treceiver=)","ext-mx01.extmail.prod.ext.phx2.redhat.com;\n\tdmarc=none (p=none dis=none) header.from=redhat.com","ext-mx01.extmail.prod.ext.phx2.redhat.com;\n\tspf=fail smtp.mailfrom=berrange@redhat.com"],"Received":["from lists.gnu.org (lists.gnu.org [IPv6:2001:4830:134:3::11])\n\t(using TLSv1 with cipher AES256-SHA (256/256 bits))\n\t(No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xjfkQ3y92z9sQl\n\tfor ;\n\tThu, 31 Aug 2017 21:08:30 +1000 (AEST)","from localhost ([::1]:55045 helo=lists.gnu.org)\n\tby lists.gnu.org with esmtp (Exim 4.71) (envelope-from\n\t)\n\tid 1dnNKm-0008Td-G4\n\tfor incoming@patchwork.ozlabs.org; Thu, 31 Aug 2017 07:08:28 -0400","from eggs.gnu.org ([2001:4830:134:3::10]:50068)\n\tby lists.gnu.org with esmtp (Exim 4.71)\n\t(envelope-from ) id 1dnNI1-0006ea-BU\n\tfor qemu-devel@nongnu.org; Thu, 31 Aug 2017 07:05:41 -0400","from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)\n\t(envelope-from ) id 1dnNHv-0007bD-55\n\tfor qemu-devel@nongnu.org; Thu, 31 Aug 2017 07:05:37 -0400","from mx1.redhat.com ([209.132.183.28]:46196)\n\tby eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)\n\t(Exim 4.71) (envelope-from )\n\tid 1dnNHs-0007YF-Mu; Thu, 31 Aug 2017 07:05:28 -0400","from smtp.corp.redhat.com\n\t(int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16])\n\t(using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))\n\t(No client certificate requested)\n\tby mx1.redhat.com (Postfix) with ESMTPS id BAF9E7F3E4;\n\tThu, 31 Aug 2017 11:05:27 +0000 (UTC)","from localhost.localdomain.com (unknown [10.42.22.189])\n\tby smtp.corp.redhat.com (Postfix) with ESMTP id D88DF9ABBC;\n\tThu, 31 Aug 2017 11:05:25 +0000 (UTC)"],"DMARC-Filter":"OpenDMARC Filter v1.3.2 mx1.redhat.com BAF9E7F3E4","From":"\"Daniel P. Berrange\" ","To":"qemu-devel@nongnu.org","Date":"Thu, 31 Aug 2017 12:05:15 +0100","Message-Id":"<20170831110518.10741-2-berrange@redhat.com>","In-Reply-To":"<20170831110518.10741-1-berrange@redhat.com>","References":"<20170831110518.10741-1-berrange@redhat.com>","X-Scanned-By":"MIMEDefang 2.79 on 10.5.11.16","X-Greylist":"Sender IP whitelisted, not delayed by milter-greylist-4.5.16\n\t(mx1.redhat.com [10.5.110.25]);\n\tThu, 31 Aug 2017 11:05:27 +0000 (UTC)","X-detected-operating-system":"by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]\n\t[fuzzy]","X-Received-From":"209.132.183.28","Subject":"[Qemu-devel] [PATCH v2 1/4] block: use 1 MB bounce buffers for\n\tcrypto instead of 16KB","X-BeenThere":"qemu-devel@nongnu.org","X-Mailman-Version":"2.1.21","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","Cc":"Kevin Wolf , qemu-block@nongnu.org,\n\tStefan Hajnoczi , Max Reitz ","Errors-To":"qemu-devel-bounces+incoming=patchwork.ozlabs.org@nongnu.org","Sender":"\"Qemu-devel\"\n\t"},"content":"Using 16KB bounce buffers creates a significant performance\npenalty for I/O to encrypted volumes on storage which high\nI/O latency (rotating rust & network drives), because it\ntriggers lots of fairly small I/O operations.\n\nOn tests with rotating rust, and cache=none|directsync,\nwrite speed increased from 2MiB/s to 32MiB/s, on a par\nwith that achieved by the in-kernel luks driver. With\nother cache modes the in-kernel driver is still notably\nfaster because it is able to report completion of the\nI/O request before any encryption is done, while the\nin-QEMU driver must encrypt the data before completion.\n\nReviewed-by: Eric Blake \nReviewed-by: Stefan Hajnoczi \nSigned-off-by: Daniel P. Berrange \n---\n block/crypto.c | 12 +++++-------\n 1 file changed, 5 insertions(+), 7 deletions(-)","diff":"diff --git a/block/crypto.c b/block/crypto.c\nindex 58ef6f2f52..cc8afe0e0d 100644\n--- a/block/crypto.c\n+++ b/block/crypto.c\n@@ -379,7 +379,7 @@ static void block_crypto_close(BlockDriverState *bs)\n }\n \n \n-#define BLOCK_CRYPTO_MAX_SECTORS 32\n+#define BLOCK_CRYPTO_MAX_SECTORS 2048\n \n static coroutine_fn int\n block_crypto_co_readv(BlockDriverState *bs, int64_t sector_num,\n@@ -396,9 +396,8 @@ block_crypto_co_readv(BlockDriverState *bs, int64_t sector_num,\n \n qemu_iovec_init(&hd_qiov, qiov->niov);\n \n- /* Bounce buffer so we have a linear mem region for\n- * entire sector. XXX optimize so we avoid bounce\n- * buffer in case that qiov->niov == 1\n+ /* Bounce buffer because we don't wish to expose cipher text\n+ * in qiov which points to guest memory.\n */\n cipher_data =\n qemu_try_blockalign(bs->file->bs, MIN(BLOCK_CRYPTO_MAX_SECTORS * 512,\n@@ -464,9 +463,8 @@ block_crypto_co_writev(BlockDriverState *bs, int64_t sector_num,\n \n qemu_iovec_init(&hd_qiov, qiov->niov);\n \n- /* Bounce buffer so we have a linear mem region for\n- * entire sector. XXX optimize so we avoid bounce\n- * buffer in case that qiov->niov == 1\n+ /* Bounce buffer because we're not permitted to touch\n+ * contents of qiov - it points to guest memory.\n */\n cipher_data =\n qemu_try_blockalign(bs->file->bs, MIN(BLOCK_CRYPTO_MAX_SECTORS * 512,\n","prefixes":["v2","1/4"]}