Cover Letter Detail
Show a cover letter.
GET /api/covers/806916/?format=api
{ "id": 806916, "url": "http://patchwork.ozlabs.org/api/covers/806916/?format=api", "web_url": "http://patchwork.ozlabs.org/project/linuxppc-dev/cover/1503972142-289376-1-git-send-email-pasha.tatashin@oracle.com/", "project": { "id": 2, "url": "http://patchwork.ozlabs.org/api/projects/2/?format=api", "name": "Linux PPC development", "link_name": "linuxppc-dev", "list_id": "linuxppc-dev.lists.ozlabs.org", "list_email": "linuxppc-dev@lists.ozlabs.org", "web_url": "https://github.com/linuxppc/wiki/wiki", "scm_url": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git", "webscm_url": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/", "list_archive_url": "https://lore.kernel.org/linuxppc-dev/", "list_archive_url_format": "https://lore.kernel.org/linuxppc-dev/{}/", "commit_url_format": "https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/commit/?id={}" }, "msgid": "<1503972142-289376-1-git-send-email-pasha.tatashin@oracle.com>", "list_archive_url": "https://lore.kernel.org/linuxppc-dev/1503972142-289376-1-git-send-email-pasha.tatashin@oracle.com/", "date": "2017-08-29T02:02:11", "name": "[v7,00/11] complete deferred page initialization", "submitter": { "id": 71010, "url": "http://patchwork.ozlabs.org/api/people/71010/?format=api", "name": "Pavel Tatashin", "email": "pasha.tatashin@oracle.com" }, "mbox": "http://patchwork.ozlabs.org/project/linuxppc-dev/cover/1503972142-289376-1-git-send-email-pasha.tatashin@oracle.com/mbox/", "series": [ { "id": 286, "url": "http://patchwork.ozlabs.org/api/series/286/?format=api", "web_url": "http://patchwork.ozlabs.org/project/linuxppc-dev/list/?series=286", "date": "2017-08-29T02:02:21", "name": "complete deferred page initialization", "version": 7, "mbox": "http://patchwork.ozlabs.org/series/286/mbox/" } ], "comments": "http://patchwork.ozlabs.org/api/covers/806916/comments/", "headers": { "Return-Path": "<linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org>", "X-Original-To": [ "patchwork-incoming@ozlabs.org", "linuxppc-dev@lists.ozlabs.org" ], "Delivered-To": [ "patchwork-incoming@ozlabs.org", "linuxppc-dev@lists.ozlabs.org" ], "Received": [ "from lists.ozlabs.org (lists.ozlabs.org [IPv6:2401:3900:2:1::3])\n\t(using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xhC0d1Gdqz9s65\n\tfor <patchwork-incoming@ozlabs.org>;\n\tTue, 29 Aug 2017 12:15:45 +1000 (AEST)", "from lists.ozlabs.org (lists.ozlabs.org [IPv6:2401:3900:2:1::3])\n\tby lists.ozlabs.org (Postfix) with ESMTP id 3xhC0d00tlzDqTc\n\tfor <patchwork-incoming@ozlabs.org>;\n\tTue, 29 Aug 2017 12:15:45 +1000 (AEST)", "from aserp1040.oracle.com (aserp1040.oracle.com [141.146.126.69])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby lists.ozlabs.org (Postfix) with ESMTPS id 3xhBkj2HvpzDqKk\n\tfor <linuxppc-dev@lists.ozlabs.org>;\n\tTue, 29 Aug 2017 12:03:41 +1000 (AEST)", "from userv0021.oracle.com (userv0021.oracle.com [156.151.31.71])\n\tby aserp1040.oracle.com (Sentrion-MTA-4.3.2/Sentrion-MTA-4.3.2) with\n\tESMTP id v7T22Wnd011004\n\t(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256\n\tverify=OK); Tue, 29 Aug 2017 02:02:32 GMT", "from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235])\n\tby userv0021.oracle.com (8.14.4/8.14.4) with ESMTP id\n\tv7T22UQb006675\n\t(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256\n\tverify=OK); Tue, 29 Aug 2017 02:02:31 GMT", "from abhmp0011.oracle.com (abhmp0011.oracle.com [141.146.116.17])\n\tby aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id\n\tv7T22RdV011290; Tue, 29 Aug 2017 02:02:27 GMT", "from ca-ldom-ol-build-1.us.oracle.com (/10.129.68.23)\n\tby default (Oracle Beehive Gateway v4.0)\n\twith ESMTP ; Mon, 28 Aug 2017 19:02:27 -0700" ], "From": "Pavel Tatashin <pasha.tatashin@oracle.com>", "To": "linux-kernel@vger.kernel.org, sparclinux@vger.kernel.org,\n\tlinux-mm@kvack.org, linuxppc-dev@lists.ozlabs.org,\n\tlinux-s390@vger.kernel.org, linux-arm-kernel@lists.infradead.org,\n\tx86@kernel.org, kasan-dev@googlegroups.com, borntraeger@de.ibm.com,\n\theiko.carstens@de.ibm.com, davem@davemloft.net, willy@infradead.org, \n\tmhocko@kernel.org, ard.biesheuvel@linaro.org, will.deacon@arm.com,\n\tcatalin.marinas@arm.com, sam@ravnborg.org, mgorman@techsingularity.net,\n\tSteven.Sistare@oracle.com, daniel.m.jordan@oracle.com,\n\tbob.picco@oracle.com", "Subject": "[PATCH v7 00/11] complete deferred page initialization", "Date": "Mon, 28 Aug 2017 22:02:11 -0400", "Message-Id": "<1503972142-289376-1-git-send-email-pasha.tatashin@oracle.com>", "X-Mailer": "git-send-email 1.7.1", "X-Source-IP": "userv0021.oracle.com [156.151.31.71]", "X-BeenThere": "linuxppc-dev@lists.ozlabs.org", "X-Mailman-Version": "2.1.23", "Precedence": "list", "List-Id": "Linux on PowerPC Developers Mail List\n\t<linuxppc-dev.lists.ozlabs.org>", "List-Unsubscribe": "<https://lists.ozlabs.org/options/linuxppc-dev>,\n\t<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=unsubscribe>", "List-Archive": "<http://lists.ozlabs.org/pipermail/linuxppc-dev/>", "List-Post": "<mailto:linuxppc-dev@lists.ozlabs.org>", "List-Help": "<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=help>", "List-Subscribe": "<https://lists.ozlabs.org/listinfo/linuxppc-dev>,\n\t<mailto:linuxppc-dev-request@lists.ozlabs.org?subject=subscribe>", "Errors-To": "linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org", "Sender": "\"Linuxppc-dev\"\n\t<linuxppc-dev-bounces+patchwork-incoming=ozlabs.org@lists.ozlabs.org>" }, "content": "Changelog:\nv7 - v6\n- Addressed comments from Michal Hocko\n- memblock_discard() patch was removed from this series and integrated\n separately\n- Fixed bug reported by kbuild test robot new patch:\n mm: zero reserved and unavailable struct pages\n- Removed patch\n x86/mm: reserve only exiting low pages\n As, it is not needed anymore, because of the previous fix\n- Re-wrote deferred_init_memmap(), found and fixed an existing bug, where\n page variable is not reset when zone holes present.\n- Merged several patches together per Michal request\n- Added performance data including raw logs\n\nv6 - v5\n- Fixed ARM64 + kasan code, as reported by Ard Biesheuvel\n- Tested ARM64 code in qemu and found few more issues, that I fixed in this\n iteration\n- Added page roundup/rounddown to x86 and arm zeroing routines to zero the\n whole allocated range, instead of only provided address range.\n- Addressed SPARC related comment from Sam Ravnborg\n- Fixed section mismatch warnings related to memblock_discard().\n\nv5 - v4\n- Fixed build issues reported by kbuild on various configurations\n\nv4 - v3\n- Rewrote code to zero sturct pages in __init_single_page() as\n suggested by Michal Hocko\n- Added code to handle issues related to accessing struct page\n memory before they are initialized.\n\nv3 - v2\n- Addressed David Miller comments about one change per patch:\n * Splited changes to platforms into 4 patches\n * Made \"do not zero vmemmap_buf\" as a separate patch\n\nv2 - v1\n- Per request, added s390 to deferred \"struct page\" zeroing\n- Collected performance data on x86 which proofs the importance to\n keep memset() as prefetch (see below).\n\nSMP machines can benefit from the DEFERRED_STRUCT_PAGE_INIT config option,\nwhich defers initializing struct pages until all cpus have been started so\nit can be done in parallel.\n\nHowever, this feature is sub-optimal, because the deferred page\ninitialization code expects that the struct pages have already been zeroed,\nand the zeroing is done early in boot with a single thread only. Also, we\naccess that memory and set flags before struct pages are initialized. All\nof this is fixed in this patchset.\n\nIn this work we do the following:\n- Never read access struct page until it was initialized\n- Never set any fields in struct pages before they are initialized\n- Zero struct page at the beginning of struct page initialization\n\n\n==========================================================================\nPerformance improvements on x86 machine with 8 nodes:\nIntel(R) Xeon(R) CPU E7-8895 v3 @ 2.60GHz and 1T of memory:\n TIME SPEED UP\nbase no deferred: 95.796233s\nfix no deferred: 79.978956s 19.77%\n\nbase deferred: 77.254713s\nfix deferred: 55.050509s 40.34%\n==========================================================================\nSPARC M6 3600 MHz with 15T of memory\n TIME SPEED UP\nbase no deferred: 358.335727s\nfix no deferred: 302.320936s 18.52%\n\nbase deferred: 237.534603s\nfix deferred: 182.103003s 30.44%\n==========================================================================\nRaw dmesg output with timestamps:\nx86 base no deferred: https://hastebin.com/ofunepurit.scala\nx86 base deferred: https://hastebin.com/ifazegeyas.scala\nx86 fix no deferred: https://hastebin.com/pegocohevo.scala\nx86 fix deferred: https://hastebin.com/ofupevikuk.scala\nsparc base no deferred: https://hastebin.com/ibobeteken.go\nsparc base deferred: https://hastebin.com/fariqimiyu.go\nsparc fix no deferred: https://hastebin.com/muhegoheyi.go\nsparc fix deferred: https://hastebin.com/xadinobutu.go\n\nPavel Tatashin (11):\n x86/mm: setting fields in deferred pages\n sparc64/mm: setting fields in deferred pages\n mm: deferred_init_memmap improvements\n sparc64: simplify vmemmap_populate\n mm: defining memblock_virt_alloc_try_nid_raw\n mm: zero struct pages during initialization\n sparc64: optimized struct page zeroing\n mm: zero reserved and unavailable struct pages\n x86/kasan: explicitly zero kasan shadow memory\n arm64/kasan: explicitly zero kasan shadow memory\n mm: stop zeroing memory during allocation in vmemmap\n\n arch/arm64/mm/kasan_init.c | 42 ++++++++\n arch/sparc/include/asm/pgtable_64.h | 30 ++++++\n arch/sparc/mm/init_64.c | 31 +++---\n arch/x86/mm/init_64.c | 9 +-\n arch/x86/mm/kasan_init_64.c | 66 ++++++++++++\n include/linux/bootmem.h | 27 +++++\n include/linux/memblock.h | 16 +++\n include/linux/mm.h | 26 +++++\n mm/memblock.c | 60 +++++++++--\n mm/page_alloc.c | 207 ++++++++++++++++++++----------------\n mm/sparse-vmemmap.c | 14 +--\n mm/sparse.c | 6 +-\n 12 files changed, 406 insertions(+), 128 deletions(-)" }