{"id":810046,"url":"http://patchwork.ozlabs.org/api/patches/810046/?format=json","web_url":"http://patchwork.ozlabs.org/project/openvswitch/patch/1504603381-30071-7-git-send-email-yliu@fridaylinux.org/","project":{"id":47,"url":"http://patchwork.ozlabs.org/api/projects/47/?format=json","name":"Open vSwitch","link_name":"openvswitch","list_id":"ovs-dev.openvswitch.org","list_email":"ovs-dev@openvswitch.org","web_url":"http://openvswitch.org/","scm_url":"git@github.com:openvswitch/ovs.git","webscm_url":"https://github.com/openvswitch/ovs","list_archive_url":"","list_archive_url_format":"","commit_url_format":""},"msgid":"<1504603381-30071-7-git-send-email-yliu@fridaylinux.org>","list_archive_url":null,"date":"2017-09-05T09:22:59","name":"[ovs-dev,v2,6/8] netdev-dpdk: retry with queue action","commit_ref":null,"pull_url":null,"state":"superseded","archived":false,"hash":"06801936f7da8a381e6d1fafcfddc1fe1d716be8","submitter":{"id":72215,"url":"http://patchwork.ozlabs.org/api/people/72215/?format=json","name":"Yuanhan Liu","email":"yliu@fridaylinux.org"},"delegate":null,"mbox":"http://patchwork.ozlabs.org/project/openvswitch/patch/1504603381-30071-7-git-send-email-yliu@fridaylinux.org/mbox/","series":[{"id":1528,"url":"http://patchwork.ozlabs.org/api/series/1528/?format=json","web_url":"http://patchwork.ozlabs.org/project/openvswitch/list/?series=1528","date":"2017-09-05T09:22:53","name":"OVS-DPDK flow offload with rte_flow","version":2,"mbox":"http://patchwork.ozlabs.org/series/1528/mbox/"}],"comments":"http://patchwork.ozlabs.org/api/patches/810046/comments/","check":"pending","checks":"http://patchwork.ozlabs.org/api/patches/810046/checks/","tags":{},"related":[],"headers":{"Return-Path":"","X-Original-To":["incoming@patchwork.ozlabs.org","dev@openvswitch.org"],"Delivered-To":["patchwork-incoming@bilbo.ozlabs.org","ovs-dev@mail.linuxfoundation.org"],"Authentication-Results":["ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=openvswitch.org\n\t(client-ip=140.211.169.12; helo=mail.linuxfoundation.org;\n\tenvelope-from=ovs-dev-bounces@openvswitch.org;\n\treceiver=)","ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (2048-bit key;\n\tunprotected) header.d=fridaylinux-org.20150623.gappssmtp.com\n\theader.i=@fridaylinux-org.20150623.gappssmtp.com\n\theader.b=\"Sb7xdzaa\"; dkim-atps=neutral"],"Received":["from mail.linuxfoundation.org (mail.linuxfoundation.org\n\t[140.211.169.12])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xmhFs5Q4vz9s0g\n\tfor ;\n\tTue, 5 Sep 2017 19:27:45 +1000 (AEST)","from mail.linux-foundation.org (localhost [127.0.0.1])\n\tby mail.linuxfoundation.org (Postfix) with ESMTP id 89FD1B1B;\n\tTue, 5 Sep 2017 09:23:56 +0000 (UTC)","from smtp1.linuxfoundation.org (smtp1.linux-foundation.org\n\t[172.17.192.35])\n\tby mail.linuxfoundation.org (Postfix) with ESMTPS id 62D9EB09\n\tfor ; Tue, 5 Sep 2017 09:23:55 +0000 (UTC)","from mail-pg0-f50.google.com (mail-pg0-f50.google.com\n\t[74.125.83.50])\n\tby smtp1.linuxfoundation.org (Postfix) with ESMTPS id DBD1112A\n\tfor ; Tue, 5 Sep 2017 09:23:54 +0000 (UTC)","by mail-pg0-f50.google.com with SMTP id m9so8114162pgd.3\n\tfor ; Tue, 05 Sep 2017 02:23:54 -0700 (PDT)","from localhost.localdomain ([101.228.204.163])\n\tby smtp.gmail.com with ESMTPSA id\n\ti187sm295921pfe.71.2017.09.05.02.23.51\n\t(version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128);\n\tTue, 05 Sep 2017 02:23:52 -0700 (PDT)"],"X-Greylist":"whitelisted by SQLgrey-1.7.6","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=fridaylinux-org.20150623.gappssmtp.com; s=20150623;\n\th=from:to:cc:subject:date:message-id:in-reply-to:references;\n\tbh=uoE/6dgezKyBZY2V144FAWMbddf7rH9g8dbvu6mY4QQ=;\n\tb=Sb7xdzaawIqDdZG+aHLbnEuNLvmbhQVSwuT5WGA/dhzUu6F69ioX1yqORZaWh1+pUR\n\tteizYyOpI6Ulq8JSvxNiVcyAY7zHFbe3aMJw7cZJMuARE1C9Pr0Vu+4Y+vHSh95Lyj5J\n\tfDQqmgj1fN8nlbcvZsTYDkgS0f8zS2q3FSR/LfF8mOqSk+kFchBp74vj+N8dRAPubP17\n\t/aFAr8wH+FKcn7L3lqYcX5zWtMhJr/aoM0VLSYsm37GBVegT6SUveHFX4vqXmkBZ89tE\n\ta9ns/I4wAYERK7pQHwvKOzng1CZTeYniCVDd2bBy9NphSdQksobHmTqv87LRTEDQjBXu\n\tGzJA==","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=1e100.net; s=20161025;\n\th=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to\n\t:references;\n\tbh=uoE/6dgezKyBZY2V144FAWMbddf7rH9g8dbvu6mY4QQ=;\n\tb=ssnHkj1TTNBNhj47Scp/JC5hUaCP6R1eyqB4+ToDRlSQnIwc1SwX60ew1D4fXXSUzR\n\tPCC4l4bnyZaVZ3uJYy3w8ZuOUwRJFJZlAKIdqE9NlNMRuEU2W2P5kWoYMLLDd0dOwHb7\n\tvIT+xYH9ANZXu3aaRVlS8hYwsrrLBoaz6ozqC6o7myUSd0kMHRLxuSKcoi1dt6Airkup\n\tA7DGM4QSPPQo2Yzu2mdAil7ShfY2uefU2g69vJdmEXJy94Z7mk4I2h5khrGfMFApzs50\n\txSI5rrUBMjkPKEJjHhv16neexVMUGQl8g6XGyLiGOViTc4p0MTablROwUO/7ECRNk4/u\n\tkAsQ==","X-Gm-Message-State":"AHPjjUhDN0aqsW9CwhNJn6QlQsKUOz+gTAThUMElOzU/m4zAEKHNRfdU\n\t8y0ng6epMxNI5Osc+QrybFvN","X-Google-Smtp-Source":"ADKCNb7VFrRrkXW1uSx8FL8zp32YoDeCQHf6JrDuaux57SfkEO4K45Hh7Oiv3nGfleL/4uEhw244Bw==","X-Received":"by 10.84.133.6 with SMTP id 6mr3581214plf.237.1504603433927;\n\tTue, 05 Sep 2017 02:23:53 -0700 (PDT)","From":"Yuanhan Liu ","To":"dev@openvswitch.org","Date":"Tue, 5 Sep 2017 17:22:59 +0800","Message-Id":"<1504603381-30071-7-git-send-email-yliu@fridaylinux.org>","X-Mailer":"git-send-email 2.7.4","In-Reply-To":"<1504603381-30071-1-git-send-email-yliu@fridaylinux.org>","References":"<1504603381-30071-1-git-send-email-yliu@fridaylinux.org>","X-Spam-Status":"No, score=0.0 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,\n\tRCVD_IN_DNSWL_NONE autolearn=disabled version=3.3.1","X-Spam-Checker-Version":"SpamAssassin 3.3.1 (2010-03-16) on\n\tsmtp1.linux-foundation.org","Subject":"[ovs-dev] [PATCH v2 6/8] netdev-dpdk: retry with queue action","X-BeenThere":"ovs-dev@openvswitch.org","X-Mailman-Version":"2.1.12","Precedence":"list","List-Id":"","List-Unsubscribe":",\n\t","List-Archive":"","List-Post":"","List-Help":"","List-Subscribe":",\n\t","MIME-Version":"1.0","Content-Type":"text/plain; charset=\"us-ascii\"","Content-Transfer-Encoding":"7bit","Sender":"ovs-dev-bounces@openvswitch.org","Errors-To":"ovs-dev-bounces@openvswitch.org"},"content":"From: Finn Christensen \n\nAFAIK, most (if not all) NICs (including Mellanox and Intel) do not\nsupport a pure MARK action. It's required to be used together with\nsome other actions, like QUEUE.\n\nTo workaround it, retry with a queue action when first try failed.\n\nMoreover, some Intel's NIC (say XL710) needs the QUEUE action set\nbefore the MARK action.\n\nCo-authored-by: Yuanhan Liu \nSigned-off-by: Finn Christensen \nSigned-off-by: Yuanhan Liu \n---\n\nv2: - workarounded the queue action issue, which sets the queue index\n to 0 blindly.\n - added some comments regarding to the retry with queue action\n---\n lib/netdev-dpdk.c | 59 ++++++++++++++++++++++++++++++++++++++++++++++++-------\n 1 file changed, 52 insertions(+), 7 deletions(-)","diff":"diff --git a/lib/netdev-dpdk.c b/lib/netdev-dpdk.c\nindex 37b0f99..320fe80 100644\n--- a/lib/netdev-dpdk.c\n+++ b/lib/netdev-dpdk.c\n@@ -3324,6 +3324,7 @@ static struct ovs_mutex ufid_lock = OVS_MUTEX_INITIALIZER;\n struct ufid_dpdk_flow_data {\n struct hmap_node node;\n ovs_u128 ufid;\n+ int rxq;\n struct rte_flow *rte_flow;\n };\n \n@@ -3366,7 +3367,8 @@ del_ufid_dpdk_flow_mapping(const ovs_u128 *ufid)\n \n /* Add ufid to dpdk_flow mapping */\n static inline void\n-add_ufid_dpdk_flow_mapping(const ovs_u128 *ufid, struct rte_flow *rte_flow)\n+add_ufid_dpdk_flow_mapping(const ovs_u128 *ufid, struct rte_flow *rte_flow,\n+ int rxq)\n {\n size_t hash = hash_bytes(ufid, sizeof(*ufid), 0);\n struct ufid_dpdk_flow_data *data = xzalloc(sizeof(*data));\n@@ -3381,6 +3383,7 @@ add_ufid_dpdk_flow_mapping(const ovs_u128 *ufid, struct rte_flow *rte_flow)\n \n data->ufid = *ufid;\n data->rte_flow = rte_flow;\n+ data->rxq = rxq;\n \n ovs_mutex_lock(&ufid_lock);\n hmap_insert(&ufid_dpdk_flow, &data->node, hash);\n@@ -3664,15 +3667,51 @@ netdev_dpdk_add_rte_flow_offload(struct netdev *netdev,\n }\n add_flow_action(&actions, RTE_FLOW_ACTION_TYPE_END, NULL);\n \n+ bool tried = 0;\n+ struct rte_flow_action_queue queue;\n+again:\n flow = rte_flow_create(dev->port_id, &flow_attr, patterns.items,\n actions.actions, &error);\n- if (!flow) {\n+ if (!flow && !tried && actions_len) {\n+ /*\n+ * Seems most (if not all) NICs do not support a pure MARK\n+ * action. It's required to be used together with some other\n+ * actions, such as QUEUE.\n+ *\n+ * Thus, if flow creation fails, here we try again with\n+ * QUEUE action.\n+ *\n+ */\n+ if (info->rxq < 0 || info->rxq >= netdev->n_rxq) {\n+ VLOG_ERR(\"invalid queue index: %d\\n\", info->rxq);\n+ ret = -1;\n+ goto out;\n+ }\n+ queue.index = info->rxq;\n+\n+ /* re-build the action */\n+ actions.cnt = 0;\n+ /*\n+ * NOTE: Intel PMD driver needs the QUEUE action set before\n+ * the MARK action.\n+ */\n+ add_flow_action(&actions, RTE_FLOW_ACTION_TYPE_QUEUE, &queue);\n+ add_flow_action(&actions, RTE_FLOW_ACTION_TYPE_MARK, &mark);\n+ add_flow_action(&actions, RTE_FLOW_ACTION_TYPE_END, NULL);\n+\n+ VLOG_INFO(\"failed to create rte flow, \"\n+ \"try again with QUEUE action (queue index = %d)\\n\",\n+ info->rxq);\n+ tried = true;\n+\n+ goto again;\n+ } else if (!flow) {\n VLOG_ERR(\"rte flow creat error: %u : message : %s\\n\",\n error.type, error.message);\n ret = -1;\n goto out;\n }\n- add_ufid_dpdk_flow_mapping(ufid, flow);\n+ add_ufid_dpdk_flow_mapping(ufid, flow, info->rxq);\n VLOG_INFO(\"installed flow %p by ufid \"UUID_FMT\"\\n\",\n flow, UUID_ARGS((struct uuid *)ufid));\n \n@@ -3784,17 +3823,23 @@ netdev_dpdk_flow_put(struct netdev *netdev, struct match *match,\n const ovs_u128 *ufid, struct offload_info *info,\n struct dpif_flow_stats *stats OVS_UNUSED)\n {\n- struct rte_flow *rte_flow;\n+ struct ufid_dpdk_flow_data *flow_data;\n int ret;\n \n /*\n * If an old rte_flow exists, it means it's a flow modification.\n * Here destroy the old rte flow first before adding a new one.\n */\n- rte_flow = get_rte_flow_by_ufid(ufid);\n- if (rte_flow) {\n+ flow_data = find_ufid_dpdk_flow_mapping(ufid);\n+ if (flow_data && flow_data->rte_flow) {\n+ /*\n+ * there is no rxq given for flow modification. Instead, we\n+ * retrieve it from the rxq firstly registered here (by flow\n+ * add operation).\n+ */\n+ info->rxq = flow_data->rxq;\n ret = netdev_dpdk_destroy_rte_flow(netdev_dpdk_cast(netdev),\n- ufid, rte_flow);\n+ ufid, flow_data->rte_flow);\n if (ret < 0)\n return ret;\n }\n","prefixes":["ovs-dev","v2","6/8"]}