Cover Letter Detail
Show a cover letter.
GET /api/covers/816462/?format=api
{ "id": 816462, "url": "http://patchwork.ozlabs.org/api/covers/816462/?format=api", "web_url": "http://patchwork.ozlabs.org/project/linuxppc-dev/cover/20170920201714.19817-1-pasha.tatashin@oracle.com/", "project": { "id": 2, "url": "http://patchwork.ozlabs.org/api/projects/2/?format=api", "name": "Linux PPC development", "link_name": "linuxppc-dev", "list_id": "linuxppc-dev.lists.ozlabs.org", "list_email": "linuxppc-dev@lists.ozlabs.org", "web_url": "https://github.com/linuxppc/wiki/wiki", "scm_url": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git", "webscm_url": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/", "list_archive_url": "https://lore.kernel.org/linuxppc-dev/", "list_archive_url_format": "https://lore.kernel.org/linuxppc-dev/{}/", "commit_url_format": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/commit/?id={}" }, "msgid": "<20170920201714.19817-1-pasha.tatashin@oracle.com>", "list_archive_url": "https://lore.kernel.org/linuxppc-dev/20170920201714.19817-1-pasha.tatashin@oracle.com/", "date": "2017-09-20T20:17:02", "name": "[v9,00/12] complete deferred page initialization", "submitter": { "id": 71010, "url": "http://patchwork.ozlabs.org/api/people/71010/?format=api", "name": "Pavel Tatashin", "email": "pasha.tatashin@oracle.com" }, "mbox": "http://patchwork.ozlabs.org/project/linuxppc-dev/cover/20170920201714.19817-1-pasha.tatashin@oracle.com/mbox/", "series": [ { "id": 4225, "url": "http://patchwork.ozlabs.org/api/series/4225/?format=api", "web_url": "http://patchwork.ozlabs.org/project/linuxppc-dev/list/?series=4225", "date": "2017-09-20T20:17:06", "name": "complete deferred page initialization", "version": 9, "mbox": "http://patchwork.ozlabs.org/series/4225/mbox/" } ], "comments": "http://patchwork.ozlabs.org/api/covers/816462/comments/", "headers": { "Return-Path": "<linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org>", "X-Original-To": [ "patchwork-incoming@ozlabs.org", "linuxppc-dev@lists.ozlabs.org" ], "Delivered-To": [ "patchwork-incoming@ozlabs.org", "linuxppc-dev@lists.ozlabs.org" ], "Received": [ "from lists.ozlabs.org (lists.ozlabs.org [103.22.144.68])\n\t(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xyB4j1gPDz9s7v\n\tfor <patchwork-incoming@ozlabs.org>;\n\tThu, 21 Sep 2017 06:22:45 +1000 (AEST)", "from lists.ozlabs.org (lists.ozlabs.org [IPv6:2401:3900:2:1::3])\n\tby lists.ozlabs.org (Postfix) with ESMTP id 3xyB4j0m7rzDrFT\n\tfor <patchwork-incoming@ozlabs.org>;\n\tThu, 21 Sep 2017 06:22:45 +1000 (AEST)", "from aserp1040.oracle.com (aserp1040.oracle.com [141.146.126.69])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby lists.ozlabs.org (Postfix) with ESMTPS id 3xy9zp4f8dzDqT0\n\tfor <linuxppc-dev@lists.ozlabs.org>;\n\tThu, 21 Sep 2017 06:18:30 +1000 (AEST)", "from aserv0021.oracle.com (aserv0021.oracle.com [141.146.126.233])\n\tby aserp1040.oracle.com (Sentrion-MTA-4.3.2/Sentrion-MTA-4.3.2)\n\twith ESMTP id v8KKHLqD011273\n\t(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256\n\tverify=OK); Wed, 20 Sep 2017 20:17:21 GMT", "from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235])\n\tby aserv0021.oracle.com (8.14.4/8.14.4) with ESMTP id\n\tv8KKHLww020827\n\t(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256\n\tverify=OK); Wed, 20 Sep 2017 20:17:21 GMT", "from abhmp0008.oracle.com (abhmp0008.oracle.com [141.146.116.14])\n\tby aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id\n\tv8KKHJmo007108; Wed, 20 Sep 2017 20:17:19 GMT", "from xakep.us.oracle.com (/10.154.127.176)\n\tby default (Oracle Beehive Gateway v4.0)\n\twith ESMTP ; Wed, 20 Sep 2017 13:17:19 -0700" ], "Authentication-Results": "ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=oracle.com\n\t(client-ip=141.146.126.69; helo=aserp1040.oracle.com;\n\tenvelope-from=pasha.tatashin@oracle.com; receiver=<UNKNOWN>)", "From": "Pavel Tatashin <pasha.tatashin@oracle.com>", "To": "linux-kernel@vger.kernel.org, sparclinux@vger.kernel.org,\n\tlinux-mm@kvack.org, linuxppc-dev@lists.ozlabs.org,\n\tlinux-s390@vger.kernel.org, linux-arm-kernel@lists.infradead.org,\n\tx86@kernel.org, kasan-dev@googlegroups.com, borntraeger@de.ibm.com,\n\theiko.carstens@de.ibm.com, davem@davemloft.net, willy@infradead.org, \n\tmhocko@kernel.org, ard.biesheuvel@linaro.org, mark.rutland@arm.com,\n\twill.deacon@arm.com, catalin.marinas@arm.com, sam@ravnborg.org,\n\tmgorman@techsingularity.net, steven.sistare@oracle.com,\n\tdaniel.m.jordan@oracle.com, bob.picco@oracle.com", "Subject": "[PATCH v9 00/12] complete deferred page initialization", "Date": "Wed, 20 Sep 2017 16:17:02 -0400", "Message-Id": "<20170920201714.19817-1-pasha.tatashin@oracle.com>", "X-Mailer": "git-send-email 2.14.1", "X-Source-IP": "aserv0021.oracle.com [141.146.126.233]", "X-BeenThere": "linuxppc-dev@lists.ozlabs.org", "X-Mailman-Version": "2.1.24", "Precedence": "list", "List-Id": "Linux on PowerPC Developers Mail List\n\t<linuxppc-dev.lists.ozlabs.org>", "List-Unsubscribe": "<https://lists.ozlabs.org/options/linuxppc-dev>,\n\t<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=unsubscribe>", "List-Archive": "<http://lists.ozlabs.org/pipermail/linuxppc-dev/>", "List-Post": "<mailto:linuxppc-dev@lists.ozlabs.org>", "List-Help": "<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=help>", "List-Subscribe": "<https://lists.ozlabs.org/listinfo/linuxppc-dev>,\n\t<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=subscribe>", "Errors-To": "linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org", "Sender": "\"Linuxppc-dev\"\n\t<linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org>" }, "content": "Changelog:\nv9 - v8\n- Addressed comments raised by Mark Rutland and Ard Biesheuvel: changed\n kasan implementation. Added a new function: kasan_map_populate() that\n zeroes the allocated and mapped memory\n\nv8 - v7\n- Added Acked-by's from Dave Miller for SPARC changes\n- Fixed a minor compiling issue on tile architecture reported by kbuild\n\nv7 - v6\n- Addressed comments from Michal Hocko\n- memblock_discard() patch was removed from this series and integrated\n separately\n- Fixed bug reported by kbuild test robot new patch:\n mm: zero reserved and unavailable struct pages\n- Removed patch\n x86/mm: reserve only exiting low pages\n As, it is not needed anymore, because of the previous fix\n- Re-wrote deferred_init_memmap(), found and fixed an existing bug, where\n page variable is not reset when zone holes present.\n- Merged several patches together per Michal request\n- Added performance data including raw logs\n\nv6 - v5\n- Fixed ARM64 + kasan code, as reported by Ard Biesheuvel\n- Tested ARM64 code in qemu and found few more issues, that I fixed in this\n iteration\n- Added page roundup/rounddown to x86 and arm zeroing routines to zero the\n whole allocated range, instead of only provided address range.\n- Addressed SPARC related comment from Sam Ravnborg\n- Fixed section mismatch warnings related to memblock_discard().\n\nv5 - v4\n- Fixed build issues reported by kbuild on various configurations\n\nv4 - v3\n- Rewrote code to zero sturct pages in __init_single_page() as\n suggested by Michal Hocko\n- Added code to handle issues related to accessing struct page\n memory before they are initialized.\n\nv3 - v2\n- Addressed David Miller comments about one change per patch:\n * Splited changes to platforms into 4 patches\n * Made \"do not zero vmemmap_buf\" as a separate patch\n\nv2 - v1\n- Per request, added s390 to deferred \"struct page\" zeroing\n- Collected performance data on x86 which proofs the importance to\n keep memset() as prefetch (see below).\n\nSMP machines can benefit from the DEFERRED_STRUCT_PAGE_INIT config option,\nwhich defers initializing struct pages until all cpus have been started so\nit can be done in parallel.\n\nHowever, this feature is sub-optimal, because the deferred page\ninitialization code expects that the struct pages have already been zeroed,\nand the zeroing is done early in boot with a single thread only. Also, we\naccess that memory and set flags before struct pages are initialized. All\nof this is fixed in this patchset.\n\nIn this work we do the following:\n- Never read access struct page until it was initialized\n- Never set any fields in struct pages before they are initialized\n- Zero struct page at the beginning of struct page initialization\n\n\n==========================================================================\nPerformance improvements on x86 machine with 8 nodes:\nIntel(R) Xeon(R) CPU E7-8895 v3 @ 2.60GHz and 1T of memory:\n TIME SPEED UP\nbase no deferred: 95.796233s\nfix no deferred: 79.978956s 19.77%\n\nbase deferred: 77.254713s\nfix deferred: 55.050509s 40.34%\n==========================================================================\nSPARC M6 3600 MHz with 15T of memory\n TIME SPEED UP\nbase no deferred: 358.335727s\nfix no deferred: 302.320936s 18.52%\n\nbase deferred: 237.534603s\nfix deferred: 182.103003s 30.44%\n==========================================================================\nRaw dmesg output with timestamps:\nx86 base no deferred: https://hastebin.com/ofunepurit.scala\nx86 base deferred: https://hastebin.com/ifazegeyas.scala\nx86 fix no deferred: https://hastebin.com/pegocohevo.scala\nx86 fix deferred: https://hastebin.com/ofupevikuk.scala\nsparc base no deferred: https://hastebin.com/ibobeteken.go\nsparc base deferred: https://hastebin.com/fariqimiyu.go\nsparc fix no deferred: https://hastebin.com/muhegoheyi.go\nsparc fix deferred: https://hastebin.com/xadinobutu.go\n\nPavel Tatashin (12):\n x86/mm: setting fields in deferred pages\n sparc64/mm: setting fields in deferred pages\n mm: deferred_init_memmap improvements\n sparc64: simplify vmemmap_populate\n mm: defining memblock_virt_alloc_try_nid_raw\n mm: zero struct pages during initialization\n sparc64: optimized struct page zeroing\n mm: zero reserved and unavailable struct pages\n mm/kasan: kasan specific map populate function\n x86/kasan: use kasan_map_populate()\n arm64/kasan: use kasan_map_populate()\n mm: stop zeroing memory during allocation in vmemmap\n\n arch/arm64/include/asm/pgtable.h | 3 +\n arch/arm64/mm/kasan_init.c | 12 +--\n arch/sparc/include/asm/pgtable_64.h | 30 ++++++\n arch/sparc/mm/init_64.c | 31 +++---\n arch/x86/mm/init_64.c | 9 +-\n arch/x86/mm/kasan_init_64.c | 8 +-\n include/linux/bootmem.h | 27 +++++\n include/linux/kasan.h | 2 +\n include/linux/memblock.h | 16 +++\n include/linux/mm.h | 26 +++++\n mm/kasan/kasan_init.c | 67 ++++++++++++\n mm/memblock.c | 60 +++++++++--\n mm/page_alloc.c | 207 ++++++++++++++++++++----------------\n mm/sparse-vmemmap.c | 15 ++-\n mm/sparse.c | 6 +-\n 15 files changed, 380 insertions(+), 139 deletions(-)" }