From patchwork Thu Aug 12 17:44:36 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ben Pfaff X-Patchwork-Id: 1516397 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=openvswitch.org (client-ip=140.211.166.136; helo=smtp3.osuosl.org; envelope-from=ovs-dev-bounces@openvswitch.org; receiver=) Received: from smtp3.osuosl.org (smtp3.osuosl.org [140.211.166.136]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 4GlvGb3dBNz9sX5 for ; Fri, 13 Aug 2021 03:45:11 +1000 (AEST) Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 7BAFA61440; Thu, 12 Aug 2021 17:45:09 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Jh7s4b4aCiFz; Thu, 12 Aug 2021 17:45:08 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [IPv6:2605:bc80:3010:104::8cd3:938]) by smtp3.osuosl.org (Postfix) with ESMTPS id D26106141B; Thu, 12 Aug 2021 17:45:04 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id A27A0C001A; Thu, 12 Aug 2021 17:45:04 +0000 (UTC) X-Original-To: dev@openvswitch.org Delivered-To: ovs-dev@lists.linuxfoundation.org Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) by lists.linuxfoundation.org (Postfix) with ESMTP id 4B729C000E for ; Thu, 12 Aug 2021 17:45:03 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id 34A9A80CED for ; Thu, 12 Aug 2021 17:45:03 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iKDpe-kmxQBm for ; Thu, 12 Aug 2021 17:44:59 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from relay1-d.mail.gandi.net (relay1-d.mail.gandi.net [217.70.183.193]) by smtp1.osuosl.org (Postfix) with ESMTPS id 0E8E480BE9 for ; Thu, 12 Aug 2021 17:44:58 +0000 (UTC) Received: (Authenticated sender: blp@ovn.org) by relay1-d.mail.gandi.net (Postfix) with ESMTPSA id 2A2B4240002; Thu, 12 Aug 2021 17:44:55 +0000 (UTC) From: Ben Pfaff To: dev@openvswitch.org Date: Thu, 12 Aug 2021 10:44:36 -0700 Message-Id: <20210812174443.3147887-1-blp@ovn.org> X-Mailer: git-send-email 2.31.1 MIME-Version: 1.0 Cc: Ben Pfaff Subject: [ovs-dev] [PATCH ovn repost 0/7] Reduce memory consumption and time for Load_Balancer benchmark X-BeenThere: ovs-dev@openvswitch.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ovs-dev-bounces@openvswitch.org Sender: "dev" Apologies for repost; I forgot to tag this as "ovn" in the first posting. For the benchmark at https://mail.openvswitch.org/pipermail/ovs-dev/2021-July/385333.html, this reduces memory consumption from 115 GB to 17 GB and elapsed time from 19 minutes to 5 minutes. I think there's headroom for more improvement, because Leonid has some cleverness that I haven't been able to successfully work in yet. This series is also available here: https://github.com/blp/ovs-reviews/tree/ovn-memory-4 Ben Pfaff (7): ovn-northd-ddlog: Merge TaggedFlow and MeteredFlow into Flow. ovn-northd-ddlog: Use cheaper representation for stage_hint. ovn-northd-ddlog: Intern Stage. Intern all the matches and actions. ovn-northd-ddlog: Get rid of duplicate flows caused by stage_hint. ovn-northd-ddlog: Intern nb::Logical_Switch. ovn-northd-ddlog: Postpone expanding external_ids, stage_hint, tags. northd/ipam.dl | 2 +- northd/lswitch.dl | 36 +- northd/multicast.dl | 2 +- northd/ovn-nb.dlopts | 1 + northd/ovn_northd.dl | 3459 +++++++++++++++++++++++------------------- 5 files changed, 1949 insertions(+), 1551 deletions(-) Acked-by: Numan Siddique