{"id":2219941,"url":"http://patchwork.ozlabs.org/api/1.2/patches/2219941/?format=json","web_url":"http://patchwork.ozlabs.org/project/linuxppc-dev/patch/20260405125240.2558577-17-songmuchun@bytedance.com/","project":{"id":2,"url":"http://patchwork.ozlabs.org/api/1.2/projects/2/?format=json","name":"Linux PPC development","link_name":"linuxppc-dev","list_id":"linuxppc-dev.lists.ozlabs.org","list_email":"linuxppc-dev@lists.ozlabs.org","web_url":"https://github.com/linuxppc/wiki/wiki","scm_url":"https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git","webscm_url":"https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/","list_archive_url":"https://lore.kernel.org/linuxppc-dev/","list_archive_url_format":"https://lore.kernel.org/linuxppc-dev/{}/","commit_url_format":"https://git.kernel.org/pub/scm/linux/kernel/git/powerpc/linux.git/commit/?id={}"},"msgid":"<20260405125240.2558577-17-songmuchun@bytedance.com>","list_archive_url":"https://lore.kernel.org/linuxppc-dev/20260405125240.2558577-17-songmuchun@bytedance.com/","date":"2026-04-05T12:52:07","name":"[16/49] mm/hugetlb: initialize vmemmap optimization in early stage","commit_ref":null,"pull_url":null,"state":"new","archived":false,"hash":"c19c2e0c1fe65fbee07d6abe2baa375c87caf138","submitter":{"id":78930,"url":"http://patchwork.ozlabs.org/api/1.2/people/78930/?format=json","name":"Muchun Song","email":"songmuchun@bytedance.com"},"delegate":null,"mbox":"http://patchwork.ozlabs.org/project/linuxppc-dev/patch/20260405125240.2558577-17-songmuchun@bytedance.com/mbox/","series":[{"id":498783,"url":"http://patchwork.ozlabs.org/api/1.2/series/498783/?format=json","web_url":"http://patchwork.ozlabs.org/project/linuxppc-dev/list/?series=498783","date":"2026-04-05T12:51:51","name":"mm: Generalize vmemmap optimization for DAX and HugeTLB","version":1,"mbox":"http://patchwork.ozlabs.org/series/498783/mbox/"}],"comments":"http://patchwork.ozlabs.org/api/patches/2219941/comments/","check":"pending","checks":"http://patchwork.ozlabs.org/api/patches/2219941/checks/","tags":{},"related":[],"headers":{"Return-Path":"\n <linuxppc-dev+bounces-19346-incoming=patchwork.ozlabs.org@lists.ozlabs.org>","X-Original-To":["incoming@patchwork.ozlabs.org","linuxppc-dev@lists.ozlabs.org"],"Delivered-To":"patchwork-incoming@legolas.ozlabs.org","Authentication-Results":["legolas.ozlabs.org;\n\tdkim=pass (2048-bit key;\n unprotected) header.d=bytedance.com header.i=@bytedance.com\n header.a=rsa-sha256 header.s=google header.b=a813gtRw;\n\tdkim-atps=neutral","legolas.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=lists.ozlabs.org\n (client-ip=2404:9400:21b9:f100::1; helo=lists.ozlabs.org;\n envelope-from=linuxppc-dev+bounces-19346-incoming=patchwork.ozlabs.org@lists.ozlabs.org;\n receiver=patchwork.ozlabs.org)","lists.ozlabs.org;\n arc=none smtp.remote-ip=\"2607:f8b0:4864:20::1035\"","lists.ozlabs.org;\n dmarc=pass (p=quarantine dis=none) header.from=bytedance.com","lists.ozlabs.org;\n\tdkim=pass (2048-bit key;\n unprotected) header.d=bytedance.com header.i=@bytedance.com\n header.a=rsa-sha256 header.s=google header.b=a813gtRw;\n\tdkim-atps=neutral","lists.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=bytedance.com\n (client-ip=2607:f8b0:4864:20::1035; helo=mail-pj1-x1035.google.com;\n envelope-from=songmuchun@bytedance.com; receiver=lists.ozlabs.org)"],"Received":["from lists.ozlabs.org (lists.ozlabs.org\n [IPv6:2404:9400:21b9:f100::1])\n\t(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n\t key-exchange x25519)\n\t(No client certificate requested)\n\tby legolas.ozlabs.org (Postfix) with ESMTPS id 4fpXVt0DHKz1yD3\n\tfor <incoming@patchwork.ozlabs.org>; Sun, 05 Apr 2026 22:55:18 +1000 (AEST)","from boromir.ozlabs.org (localhost [127.0.0.1])\n\tby lists.ozlabs.org (Postfix) with ESMTP id 4fpXVj1n3Xz2yrM;\n\tSun, 05 Apr 2026 22:55:09 +1000 (AEST)","from mail-pj1-x1035.google.com (mail-pj1-x1035.google.com\n [IPv6:2607:f8b0:4864:20::1035])\n\t(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n\t key-exchange x25519 server-signature RSA-PSS (2048 bits) server-digest\n SHA256)\n\t(No client certificate requested)\n\tby lists.ozlabs.org (Postfix) with ESMTPS id 4fpXVh3Bp6z2yjs\n\tfor <linuxppc-dev@lists.ozlabs.org>; Sun, 05 Apr 2026 22:55:08 +1000 (AEST)","by mail-pj1-x1035.google.com with SMTP id\n 98e67ed59e1d1-35d971fbcddso1861303a91.1\n        for <linuxppc-dev@lists.ozlabs.org>;\n Sun, 05 Apr 2026 05:55:08 -0700 (PDT)","from n232-176-004.byted.org ([36.110.163.97])\n        by smtp.gmail.com with ESMTPSA id\n 98e67ed59e1d1-35de66b4808sm3748505a91.2.2026.04.05.05.55.01\n        (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n        Sun, 05 Apr 2026 05:55:06 -0700 (PDT)"],"ARC-Seal":"i=1; a=rsa-sha256; d=lists.ozlabs.org; s=201707; t=1775393709;\n\tcv=none;\n b=dJ5iPiBE8QBPMevVLjaHmHSQrY3Y36EqTRoTmLMjGeeudVN8+r/5KE0dpA5seg/uPjs+gfAckQXpcsAF8LLctqn0CClvRAs5ppKa2JTXubKSAtiZ7tmYHujwhPDQk7zG0PzvUARJx+f7yQJI5NQJznvgi76p2r+396cXUzy41BDX+ncA08nwTrXMOr1XEXHttQkrtk7IoPFqIO9aOGdhcN53ceun5S0cHpSGlezHf1e7Z9GzaJwLTyZbs5rC92ksK6XE9T5yKcgq6Jq+SDCMq0Ngnh5rrC8UMjC8wCyOXHCWGn86JF6PUCU1XV0sUhDyGRVmg9HRk86lksscHBt5Qw==","ARC-Message-Signature":"i=1; a=rsa-sha256; d=lists.ozlabs.org; s=201707;\n\tt=1775393709; c=relaxed/relaxed;\n\tbh=62kILe3INi6GkTRPTI+nnexklobUpHFgUm7h2fdMoGM=;\n\th=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References:\n\t MIME-Version;\n b=i7spGPH7evxZy+COkH4bT+VTD2BiYuDxa3Fr8AbPNhpqYH7dfXsBY+2QvE3hAr8YvJS3OOMHb6Z9IUeeGGQtcYA7AQs1wsI3C6Ov45GpZQcA27T1lKz511JER4fKZ5TPem75B3zaO+bhLkTAaAuenIfny/Pd0ohnL6UnfLAZcyv8p7Jj0IPaXpdrZdcfeyvoTLdGYRBJYMGiDKpsPjjDKYfrhxDYNLMjtds9/PP5IyM5O2NY2JV9MdlLbd51v048TtNTBdtsNADXqx4z90Cu9V7DTCFvmzB7Qk3aO/A+rNeu9JM/4tzq7LtbuGFrVHXza6ANnFhlRqIRntG5ZZHcUQ==","ARC-Authentication-Results":"i=1; lists.ozlabs.org;\n dmarc=pass (p=quarantine dis=none) header.from=bytedance.com;\n dkim=pass (2048-bit key;\n unprotected) header.d=bytedance.com header.i=@bytedance.com\n header.a=rsa-sha256 header.s=google header.b=a813gtRw; dkim-atps=neutral;\n spf=pass (client-ip=2607:f8b0:4864:20::1035; helo=mail-pj1-x1035.google.com;\n envelope-from=songmuchun@bytedance.com;\n receiver=lists.ozlabs.org) smtp.mailfrom=bytedance.com","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n        d=bytedance.com; s=google; t=1775393707; x=1775998507;\n darn=lists.ozlabs.org;\n        h=content-transfer-encoding:mime-version:references:in-reply-to\n         :message-id:date:subject:cc:to:from:from:to:cc:subject:date\n         :message-id:reply-to;\n        bh=62kILe3INi6GkTRPTI+nnexklobUpHFgUm7h2fdMoGM=;\n        b=a813gtRwA5CYxaY51efsZ7kjq9/4Jw7N2Xfa4Vg7AdZQ2InV0n7ypDcjJ1sJPIILzS\n         thlYffgqp7GRzXjA8lV/hKySttbBADUkLfk+uPQwlNFri1VQv37xMgUsJi5R6XDTGe+p\n         nGuA7o705HB2qy6GtFFUmmeD7SIoSS75+4n/QROe9EQsEEZDHRBt3ZSTlHJARpKCKnJL\n         qOmLLCoiMRI2KUKkPJfaSXkNdnVEOV6GdM/o5xarN7PmYYuDWnhxTSPj+hwS+AblHcxO\n         ywsrbvHqLFGy3Y6zTI1ihGqDg5/W/azYsftWEt8t0VY1j46E4BAMO5zGvtIgeQZXuRPz\n         yCAg==","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n        d=1e100.net; s=20251104; t=1775393707; x=1775998507;\n        h=content-transfer-encoding:mime-version:references:in-reply-to\n         :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from\n         :to:cc:subject:date:message-id:reply-to;\n        bh=62kILe3INi6GkTRPTI+nnexklobUpHFgUm7h2fdMoGM=;\n        b=q8uEZ8pkELj1fSzytJMfQ4myYEcJOqX+XzQZRoR/OI/48PJoGeSyEAHzTg5pN9jC3Y\n         tjiUAblotGhvQ9PPAs5+uoMYxJt+qLxpba9gRZmu5+4nV9GuoIv71YQnrIwIdiYsiRRF\n         zcvFotj9PF9vS8VRYmrmaL3TDUw5y8BtZtJ7FZsqAmpm7cudiProPD2qOdHLH5vjAfY/\n         rEAdzLk1E6Ckt1rtc+ER5rUOpkDtkgoearx5qVdrcmxuMuNrjq/49YmJ8YDHb1PAehkk\n         x/SJ7OsZUlNiYq4CSE6ljte5lMeP7b1mUJ/2v8iJf0HM7bNFrX1gGOjIgPGo0irqIFl2\n         TQVA==","X-Forwarded-Encrypted":"i=1;\n AJvYcCXTifMkIMT5nX1qc6lVMuM/SI9mNlSwJZFajCLu2VrNuB5Qr/fd1NO7phVmRSxEW8eZScB22oXkfuZsl2Y=@lists.ozlabs.org","X-Gm-Message-State":"AOJu0YzLxzFodxECdFtRqjCHpgeD2re6359XtlyGd+RMFCdHL27t/zZR\n\txh8ogoBqJDy/kyQhwlCX4Akd631H90K59CWAuSfJ3N6BDfiDxrczXBIQaSAdxbuFi6c=","X-Gm-Gg":"AeBDieubVqKP3BdAL3B1yUJlRCZRxs72tIo8dUuBjW19cO4PiwiafegOCYe8RuZGSNR\n\tU4KEsKbZvYgdCIonLt/y5p4om0QQGK5WNi2DEbEEIGEMpRI4bWejlHA6lMdHnhBDUNdjoG5GU8h\n\tKcXa3NNDtAH9zPbiBIZjh7r/Ns6znpjHk5Ol3ziTS0yz40wug0c/57gb3+3LsTKbP19jIyHpTYz\n\t285lSPdmdpvQu/j6I4our1NPh4+kOyU0mqWCZpwLq+4I+DsX0lEQ5X5BVKcFIwDhn6fihqBp6dY\n\tM5nJGkjBfzI13zLNObnOuLPXRAvenmcElWIve4jFSWrot2FuQtoMVIwVhm3oBxar5unJRPcTqbz\n\tnAIEgUcY3nWAtbPZWIz58Ys9szH51dZmLqzq3tMthaYw7W2tu4xU/699ddzzB7anMOhsOblbk2+\n\t7cwDQZpW8WBXRDOWHN2W/W2f7/p2f8ytHYfBvthHPBjsM=","X-Received":"by 2002:a17:90b:3d4b:b0:35d:9fe9:f830 with SMTP id\n 98e67ed59e1d1-35de5c42865mr7039662a91.12.1775393706456;\n        Sun, 05 Apr 2026 05:55:06 -0700 (PDT)","From":"Muchun Song <songmuchun@bytedance.com>","To":"Andrew Morton <akpm@linux-foundation.org>,\n\tDavid Hildenbrand <david@kernel.org>,\n\tMuchun Song <muchun.song@linux.dev>,\n\tOscar Salvador <osalvador@suse.de>,\n\tMichael Ellerman <mpe@ellerman.id.au>,\n\tMadhavan Srinivasan <maddy@linux.ibm.com>","Cc":"Lorenzo Stoakes <ljs@kernel.org>,\n\t\"Liam R . Howlett\" <Liam.Howlett@oracle.com>,\n\tVlastimil Babka <vbabka@kernel.org>,\n\tMike Rapoport <rppt@kernel.org>,\n\tSuren Baghdasaryan <surenb@google.com>,\n\tMichal Hocko <mhocko@suse.com>,\n\tNicholas Piggin <npiggin@gmail.com>,\n\tChristophe Leroy <chleroy@kernel.org>,\n\taneesh.kumar@linux.ibm.com,\n\tjoao.m.martins@oracle.com,\n\tlinux-mm@kvack.org,\n\tlinuxppc-dev@lists.ozlabs.org,\n\tlinux-kernel@vger.kernel.org,\n\tMuchun Song <songmuchun@bytedance.com>","Subject":"[PATCH 16/49] mm/hugetlb: initialize vmemmap optimization in early\n stage","Date":"Sun,  5 Apr 2026 20:52:07 +0800","Message-Id":"<20260405125240.2558577-17-songmuchun@bytedance.com>","X-Mailer":"git-send-email 2.20.1","In-Reply-To":"<20260405125240.2558577-1-songmuchun@bytedance.com>","References":"<20260405125240.2558577-1-songmuchun@bytedance.com>","X-Mailing-List":"linuxppc-dev@lists.ozlabs.org","List-Id":"<linuxppc-dev.lists.ozlabs.org>","List-Help":"<mailto:linuxppc-dev+help@lists.ozlabs.org>","List-Owner":"<mailto:linuxppc-dev+owner@lists.ozlabs.org>","List-Post":"<mailto:linuxppc-dev@lists.ozlabs.org>","List-Archive":"<https://lore.kernel.org/linuxppc-dev/>,\n  <https://lists.ozlabs.org/pipermail/linuxppc-dev/>","List-Subscribe":"<mailto:linuxppc-dev+subscribe@lists.ozlabs.org>,\n  <mailto:linuxppc-dev+subscribe-digest@lists.ozlabs.org>,\n  <mailto:linuxppc-dev+subscribe-nomail@lists.ozlabs.org>","List-Unsubscribe":"<mailto:linuxppc-dev+unsubscribe@lists.ozlabs.org>","Precedence":"list","MIME-Version":"1.0","Content-Transfer-Encoding":"8bit","X-Spam-Status":"No, score=-0.2 required=3.0 tests=DKIM_SIGNED,DKIM_VALID,\n\tDKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS\n\tautolearn=disabled version=4.0.1 OzLabs 8","X-Spam-Checker-Version":"SpamAssassin 4.0.1 (2024-03-25) on lists.ozlabs.org"},"content":"Move pfn_to_zone() to be available for hugetlb_vmemmap_init_early().\nPopulate vmemmap HVO in hugetlb_vmemmap_init_early() for bootmem allocated\nhuge pages.\n\nThe zone information is already available in hugetlb_vmemmap_init_early(),\nso there is no need to wait for hugetlb_vmemmap_init_late() to access it.\nThis prepares for the removal of hugetlb_vmemmap_init_late().\n\nSigned-off-by: Muchun Song <songmuchun@bytedance.com>\n---\n mm/hugetlb_vmemmap.c | 38 ++++++++++++++++++++++++--------------\n 1 file changed, 24 insertions(+), 14 deletions(-)","diff":"diff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c\nindex 50b7123f3bdd..e25c70453928 100644\n--- a/mm/hugetlb_vmemmap.c\n+++ b/mm/hugetlb_vmemmap.c\n@@ -745,6 +745,20 @@ static bool vmemmap_should_optimize_bootmem_page(struct huge_bootmem_page *m)\n \treturn true;\n }\n \n+static struct zone *pfn_to_zone(unsigned nid, unsigned long pfn)\n+{\n+\tstruct zone *zone;\n+\tenum zone_type zone_type;\n+\n+\tfor (zone_type = 0; zone_type < MAX_NR_ZONES; zone_type++) {\n+\t\tzone = &NODE_DATA(nid)->node_zones[zone_type];\n+\t\tif (zone_spans_pfn(zone, pfn))\n+\t\t\treturn zone;\n+\t}\n+\n+\treturn NULL;\n+}\n+\n /*\n  * Initialize memmap section for a gigantic page, HVO-style.\n  */\n@@ -752,6 +766,7 @@ void __init hugetlb_vmemmap_init_early(int nid)\n {\n \tunsigned long psize, paddr, section_size;\n \tunsigned long ns, i, pnum, pfn, nr_pages;\n+\tunsigned long start, end;\n \tstruct huge_bootmem_page *m = NULL;\n \tvoid *map;\n \n@@ -761,6 +776,8 @@ void __init hugetlb_vmemmap_init_early(int nid)\n \tsection_size = (1UL << PA_SECTION_SHIFT);\n \n \tlist_for_each_entry(m, &huge_boot_pages[nid], list) {\n+\t\tstruct zone *zone;\n+\n \t\tif (!vmemmap_should_optimize_bootmem_page(m))\n \t\t\tcontinue;\n \n@@ -769,6 +786,13 @@ void __init hugetlb_vmemmap_init_early(int nid)\n \t\tpaddr = virt_to_phys(m);\n \t\tpfn = PHYS_PFN(paddr);\n \t\tmap = pfn_to_page(pfn);\n+\t\tstart = (unsigned long)map;\n+\t\tend = start + nr_pages * sizeof(struct page);\n+\t\tzone = pfn_to_zone(nid, pfn);\n+\n+\t\tBUG_ON(vmemmap_populate_hvo(start, end, huge_page_order(m->hstate),\n+\t\t\t\t\t    zone, HUGETLB_VMEMMAP_RESERVE_SIZE));\n+\t\tmemmap_boot_pages_add(HUGETLB_VMEMMAP_RESERVE_SIZE / PAGE_SIZE);\n \n \t\tpnum = pfn_to_section_nr(pfn);\n \t\tns = psize / section_size;\n@@ -784,20 +808,6 @@ void __init hugetlb_vmemmap_init_early(int nid)\n \t}\n }\n \n-static struct zone *pfn_to_zone(unsigned nid, unsigned long pfn)\n-{\n-\tstruct zone *zone;\n-\tenum zone_type zone_type;\n-\n-\tfor (zone_type = 0; zone_type < MAX_NR_ZONES; zone_type++) {\n-\t\tzone = &NODE_DATA(nid)->node_zones[zone_type];\n-\t\tif (zone_spans_pfn(zone, pfn))\n-\t\t\treturn zone;\n-\t}\n-\n-\treturn NULL;\n-}\n-\n void __init hugetlb_vmemmap_init_late(int nid)\n {\n \tstruct huge_bootmem_page *m, *tm;\n","prefixes":["16/49"]}