[{"id":1773818,"web_url":"http://patchwork.ozlabs.org/comment/1773818/","msgid":"<B1C7356D-E274-4C91-A560-77C722AF16B1@vmware.com>","list_archive_url":null,"date":"2017-09-22T18:20:03","subject":"Re: [ovs-dev] [RFC 0/2] EMC load-shedding","submitter":{"id":68212,"url":"http://patchwork.ozlabs.org/api/people/68212/","name":"Darrell Ball","email":"dball@vmware.com"},"content":"Thanks for working on this Billy\nOne comment inline.\n\nOn 9/22/17, 6:47 AM, \"Billy O'Mahony\" <billy.o.mahony@intel.com> wrote:\n\n    Hi All,\n    \n    Please find attached RFC patch for EMC load-shedding [1] as promised [2].\n    \n    This applies clean on 5ff834 \"Increment ct packet counters...\" It also uses\n    Ilya's patch \"Fix per packet cycles statistics.\" [3] so I've included that in\n    the patch set as it wasn't merged when I started the RFC.\n    \n    The main goal for this RFC is only to demonstrate the outline of the mechanism\n    and get feedback & advice for further work.\n    \n    However I did some initial testing with promising results. For 8K to 64K flows\n    the cycles per packet drop from ~1200 to ~1100. For small numbers of flows\n    (~16) the cycles per packet remain at ~900 which I beleive means no increase\n    but I didn't baseline that situation.\n    \n    There are some TODOs commented in the patch with XXX.\n    \n    For one I think the mechanism should take into account the expected cycle-cost\n    of EMC lookup and EMC miss (dpcls lookup) when deciding how much load to shed.\n    Rather than the heuristic in this patch which is to keep the emc hit rate (for\n    flow which have not been diverted from the EMC) between certain bounds.\n\n\n[Darrell]\nCould you expand on the description of the algorithm and the rational?\nI know the algorithm was discussed along with other proposed patches, but I\nthink it be would be beneficial if the patch (boils down to a single patch) described it.\n\nProbably the code could benefit from some expanded comments as well?\n\nI see one comment in the code\n+        /* As hit rate goes down shed thresh goes up (more is shed from EMC) */\n+        /* XXX consider increment more if further out of bounds *\n\n    \n    Also we should decide on at least one flow distribution that would be useful\n    (i.e. realistic) for EMC testing. The tests above have either been carried out\n    with a random (uniform) flow distribution which doesn't play well with flow\n    caching or else a round-robin flow distribution which is actually adverserial\n    to flow caching. If I have an agreed flow distribution I can then figure out\n    how to produce it for testing :).\n    \n    [1] https://urldefense.proofpoint.com/v2/url?u=https-3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-2DAugust_336509.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BVhFA09CGX7JQ5Ih-uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=dr9kNy7p3flCYC1W1AO02TRCvTHiazrQ9A5-Ssi4A7o&e= \n    [2] https://urldefense.proofpoint.com/v2/url?u=https-3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-2DSeptember_338380.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BVhFA09CGX7JQ5Ih-uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=OvsyuPzDlkZOk_fNXK380np29aySrXUeLKUUKqHCKjw&e= \n    [3] https://urldefense.proofpoint.com/v2/url?u=https-3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-2DAugust_337309.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BVhFA09CGX7JQ5Ih-uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=eDHE9eXgzl8wlJhJ_pCqqSIuJYM0EfxgejqgD8xHBZ0&e= \n    \n    Billy O'Mahony (1):\n      dpif-netdev: RFC EMC load-shedding\n    \n    Ilya Maximets (1):\n      dpif-netdev: Fix per packet cycles statistics.\n    \n     lib/dpif-netdev.c | 118 +++++++++++++++++++++++++++++++++++++++++++++++++-----\n     1 file changed, 108 insertions(+), 10 deletions(-)\n    \n    -- \n    2.7.4","headers":{"Return-Path":"<ovs-dev-bounces@openvswitch.org>","X-Original-To":["incoming@patchwork.ozlabs.org","dev@openvswitch.org"],"Delivered-To":["patchwork-incoming@bilbo.ozlabs.org","ovs-dev@mail.linuxfoundation.org"],"Authentication-Results":["ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=openvswitch.org\n\t(client-ip=140.211.169.12; helo=mail.linuxfoundation.org;\n\tenvelope-from=ovs-dev-bounces@openvswitch.org;\n\treceiver=<UNKNOWN>)","ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=onevmw.onmicrosoft.com\n\theader.i=@onevmw.onmicrosoft.com header.b=\"U3OYfxUM\"; \n\tdkim-atps=neutral","spf=none (sender IP is )\n\tsmtp.mailfrom=dball@vmware.com; "],"Received":["from mail.linuxfoundation.org (mail.linuxfoundation.org\n\t[140.211.169.12])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3xzMGQ5lDSz9t16\n\tfor <incoming@patchwork.ozlabs.org>;\n\tSat, 23 Sep 2017 04:20:13 +1000 (AEST)","from mail.linux-foundation.org (localhost [127.0.0.1])\n\tby mail.linuxfoundation.org (Postfix) with ESMTP id 52B6298A;\n\tFri, 22 Sep 2017 18:20:09 +0000 (UTC)","from smtp1.linuxfoundation.org (smtp1.linux-foundation.org\n\t[172.17.192.35])\n\tby mail.linuxfoundation.org (Postfix) with ESMTPS id 48F9C97A\n\tfor <dev@openvswitch.org>; Fri, 22 Sep 2017 18:20:08 +0000 (UTC)","from NAM03-CO1-obe.outbound.protection.outlook.com\n\t(mail-co1nam03on0081.outbound.protection.outlook.com [104.47.40.81])\n\tby smtp1.linuxfoundation.org (Postfix) with ESMTPS id C78D517E\n\tfor <dev@openvswitch.org>; Fri, 22 Sep 2017 18:20:06 +0000 (UTC)","from MWHPR05MB3406.namprd05.prod.outlook.com (10.174.175.155) by\n\tMWHPR05MB3406.namprd05.prod.outlook.com (10.174.175.155) with\n\tMicrosoft SMTP Server (version=TLS1_2,\n\tcipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id\n\t15.20.77.5; Fri, 22 Sep 2017 18:20:03 +0000","from MWHPR05MB3406.namprd05.prod.outlook.com ([10.174.175.155]) by\n\tMWHPR05MB3406.namprd05.prod.outlook.com ([10.174.175.155]) with\n\tmapi id 15.20.0077.007; Fri, 22 Sep 2017 18:20:03 +0000"],"X-Greylist":"whitelisted by SQLgrey-1.7.6","DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n\td=onevmw.onmicrosoft.com; s=selector1-vmware-com;\n\th=From:Date:Subject:Message-ID:Content-Type:MIME-Version;\n\tbh=duBS+lq9HIAVZS8ewZAPLEQY/k9zY/RWD0dWu3G9VHU=;\n\tb=U3OYfxUMrjeVPcadUJ/5b5AE97tKVWm+CpzcKABlhdV5/07J0ZbD2WT2II6gFMjB4jVteTHRF3REzSHkHD0U1JP40aqHCNcy3AbzT9+g5lQ+v5E0BX6HudtzxxRjaL8Fx4SrnI+g00DmFVmXGHaVw6C4i630cKUN9Pd9mYi+mb8=","From":"Darrell Ball <dball@vmware.com>","To":"Billy O'Mahony <billy.o.mahony@intel.com>, \"dev@openvswitch.org\"\n\t<dev@openvswitch.org>","Thread-Topic":"[RFC 0/2] EMC load-shedding","Thread-Index":"AQHTM6lmCCuHtsM9B0qAfFGnlwFgoqLBN30A","Date":"Fri, 22 Sep 2017 18:20:03 +0000","Message-ID":"<B1C7356D-E274-4C91-A560-77C722AF16B1@vmware.com>","References":"<1506088063-20920-1-git-send-email-billy.o.mahony@intel.com>","In-Reply-To":"<1506088063-20920-1-git-send-email-billy.o.mahony@intel.com>","Accept-Language":"en-US","Content-Language":"en-US","X-MS-Has-Attach":"","X-MS-TNEF-Correlator":"","user-agent":"Microsoft-MacOutlook/f.26.0.170902","x-originating-ip":"[73.162.236.45]","x-ms-publictraffictype":"Email","x-microsoft-exchange-diagnostics":"1; MWHPR05MB3406;\n\t20:pSojI9nwCjlrJ2MDs2dQ6Eiz9GYgKQBbcN2qS0XOd8okmt/X91xb56LFMDhcor5kEok3Yu5jpLCRCAgmLRdg5b9JZnQuWwbPEDvqrqbPiS7DdcagWFiJvdRZGtHLZjxfJLdySrXPSzMXtf/4zLhVk5/kYgJ5LJKcsT8PVsCd/aU=","x-ms-exchange-antispam-srfa-diagnostics":"SSOS;","x-ms-office365-filtering-correlation-id":"860f7105-da8a-47a9-25a9-08d501e68b5d","x-microsoft-antispam":"UriScan:; BCL:0; PCL:0;\n\tRULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(2017052603199)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095);\n\tSRVR:MWHPR05MB3406; ","x-ms-traffictypediagnostic":"MWHPR05MB3406:","authentication-results":["ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=openvswitch.org\n\t(client-ip=140.211.169.12; helo=mail.linuxfoundation.org;\n\tenvelope-from=ovs-dev-bounces@openvswitch.org;\n\treceiver=<UNKNOWN>)","ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (1024-bit key;\n\tunprotected) header.d=onevmw.onmicrosoft.com\n\theader.i=@onevmw.onmicrosoft.com header.b=\"U3OYfxUM\"; \n\tdkim-atps=neutral","spf=none (sender IP is )\n\tsmtp.mailfrom=dball@vmware.com; "],"x-exchange-antispam-report-test":"UriScan:(10436049006162)(216315784871565)(228905959029699); ","x-microsoft-antispam-prvs":"<MWHPR05MB3406D76F16778E17CEAF35E9C8670@MWHPR05MB3406.namprd05.prod.outlook.com>","x-exchange-antispam-report-cfa-test":"BCL:0; PCL:0;\n\tRULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(5005006)(8121501046)(93006095)(93001095)(10201501046)(100000703101)(100105400095)(3002001)(6041248)(20161123558100)(20161123555025)(20161123564025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123560025)(20161123562025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095);\n\tSRVR:MWHPR05MB3406; BCL:0; PCL:0;\n\tRULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095);\n\tSRVR:MWHPR05MB3406; ","x-forefront-prvs":"0438F90F17","x-forefront-antispam-report":"SFV:NSPM;\n\tSFS:(10009020)(6009001)(376002)(346002)(53754006)(189002)(377454003)(199003)(24454002)(81156014)(86362001)(97736004)(83506001)(8676002)(99286003)(6306002)(81166006)(106356001)(575784001)(6512007)(6436002)(77096006)(66066001)(6486002)(82746002)(54906003)(6506006)(8936002)(7736002)(305945005)(316002)(58126008)(229853002)(189998001)(110136005)(53546010)(2900100001)(14454004)(5660300001)(83716003)(2501003)(3280700002)(54356999)(76176999)(2906002)(101416001)(5890100001)(33656002)(2950100002)(478600001)(50986999)(105586002)(36756003)(25786009)(68736007)(6116002)(3660700001)(966005)(4326008)(3846002)(53936002)(102836003)(6246003)(21314002);\n\tDIR:OUT; SFP:1101; SCL:1; SRVR:MWHPR05MB3406;\n\tH:MWHPR05MB3406.namprd05.prod.outlook.com; FPR:; SPF:None;\n\tPTR:InfoNoRecords; MX:1; A:1; LANG:en; ","received-spf":"None (protection.outlook.com: vmware.com does not designate\n\tpermitted sender hosts)","spamdiagnosticoutput":"1:99","spamdiagnosticmetadata":"NSPM","Content-ID":"<29A4A67027F133498E7D639F834B0DFC@namprd05.prod.outlook.com>","MIME-Version":"1.0","X-OriginatorOrg":"vmware.com","X-MS-Exchange-CrossTenant-originalarrivaltime":"22 Sep 2017 18:20:03.3005\n\t(UTC)","X-MS-Exchange-CrossTenant-fromentityheader":"Hosted","X-MS-Exchange-CrossTenant-id":"b39138ca-3cee-4b4a-a4d6-cd83d9dd62f0","X-MS-Exchange-Transport-CrossTenantHeadersStamped":"MWHPR05MB3406","X-Spam-Status":"No, score=0.0 required=5.0 tests=DKIM_SIGNED,DKIM_VALID,\n\tRCVD_IN_DNSWL_NONE autolearn=disabled version=3.3.1","X-Spam-Checker-Version":"SpamAssassin 3.3.1 (2010-03-16) on\n\tsmtp1.linux-foundation.org","Cc":"\"i.maximets@samsung.com\" <i.maximets@samsung.com>","Subject":"Re: [ovs-dev] [RFC 0/2] EMC load-shedding","X-BeenThere":"ovs-dev@openvswitch.org","X-Mailman-Version":"2.1.12","Precedence":"list","List-Id":"<ovs-dev.openvswitch.org>","List-Unsubscribe":"<https://mail.openvswitch.org/mailman/options/ovs-dev>,\n\t<mailto:ovs-dev-request@openvswitch.org?subject=unsubscribe>","List-Archive":"<http://mail.openvswitch.org/pipermail/ovs-dev/>","List-Post":"<mailto:ovs-dev@openvswitch.org>","List-Help":"<mailto:ovs-dev-request@openvswitch.org?subject=help>","List-Subscribe":"<https://mail.openvswitch.org/mailman/listinfo/ovs-dev>,\n\t<mailto:ovs-dev-request@openvswitch.org?subject=subscribe>","Content-Type":"text/plain; charset=\"us-ascii\"","Content-Transfer-Encoding":"7bit","Sender":"ovs-dev-bounces@openvswitch.org","Errors-To":"ovs-dev-bounces@openvswitch.org"}},{"id":1774689,"web_url":"http://patchwork.ozlabs.org/comment/1774689/","msgid":"<03135AEA779D444E90975C2703F148DC58C2047D@IRSMSX107.ger.corp.intel.com>","list_archive_url":null,"date":"2017-09-25T12:16:22","subject":"Re: [ovs-dev] [RFC 0/2] EMC load-shedding","submitter":{"id":71090,"url":"http://patchwork.ozlabs.org/api/people/71090/","name":"Billy O'Mahony","email":"billy.o.mahony@intel.com"},"content":"Hi Darrell,\n\nSome more information below. I'll hold off on a v2 for now to give others time to comment.\n\nThanks,\nBilly. \n\n \n> -----Original Message-----\n> From: Darrell Ball [mailto:dball@vmware.com]\n> Sent: Friday, September 22, 2017 7:20 PM\n> To: O Mahony, Billy <billy.o.mahony@intel.com>; dev@openvswitch.org\n> Cc: i.maximets@samsung.com; jan.scheurich@ericsson.com\n> Subject: Re: [RFC 0/2] EMC load-shedding\n> \n> Thanks for working on this Billy\n> One comment inline.\n> \n> On 9/22/17, 6:47 AM, \"Billy O'Mahony\" <billy.o.mahony@intel.com> wrote:\n> \n>     Hi All,\n> \n>     Please find attached RFC patch for EMC load-shedding [1] as promised [2].\n> \n>     This applies clean on 5ff834 \"Increment ct packet counters...\" It also uses\n>     Ilya's patch \"Fix per packet cycles statistics.\" [3] so I've included that in\n>     the patch set as it wasn't merged when I started the RFC.\n> \n>     The main goal for this RFC is only to demonstrate the outline of the\n> mechanism\n>     and get feedback & advice for further work.\n> \n>     However I did some initial testing with promising results. For 8K to 64K\n> flows\n>     the cycles per packet drop from ~1200 to ~1100. For small numbers of flows\n>     (~16) the cycles per packet remain at ~900 which I beleive means no\n> increase\n>     but I didn't baseline that situation.\n> \n>     There are some TODOs commented in the patch with XXX.\n> \n>     For one I think the mechanism should take into account the expected\n> cycle-cost\n>     of EMC lookup and EMC miss (dpcls lookup) when deciding how much load\n> to shed.\n>     Rather than the heuristic in this patch which is to keep the emc hit rate (for\n>     flow which have not been diverted from the EMC) between certain\n> bounds.\n> \n> \n> [Darrell]\n> Could you expand on the description of the algorithm and the rational?\n> I know the algorithm was discussed along with other proposed patches, but I\n> think it be would be beneficial if the patch (boils down to a single patch)\n> described it.\n[[BO'M]] \n\nI'll add that description and some comments to the v2 of the patch.  In the meantime reviewers should find this helpful:\n\nAs the number of flows increased there will eventually be too many flows contending for a place in the EMC cache. The EMC cache becomes a liability when \nemc_lookup_cost + (emc_miss_rate * dpcls_lookup_cost) grows to be greater\nthan a straightforward dpcls_lookup_cost. When this occurs if some proportion of flows could be made to skip the EMC  (ie neither be inserted into nor looked up in the EMC) it would result in lower lookup costs overall. \n\nThis requires and efficient and flexible way to categorize flows into - 'skip EMC' and 'use EMC' categories. The RSS hash can fulfil this role by setting a threshold whereby RSS hashes under a certain value are skipped from the EMC.\n\nThe algorithm in this RFC is based on setting this shed threshold so that the hit rate on the EMC remains between 50 and 70% which from observation gives an efficient use of the EMC (based on cycles per packet). Periodically (after each 3 million packets) the EMC hit rate is checked and if it is over 70% then the shed threshold is increased (more flows are shed from the EMC) and if it is below 50% the shed threshold in decreased (fewer flows are shed from the EMC). The shed threshold as 16 different values (0x0000_0000 to 0xF000_0000) which allows for no-shedding, 1/16th, 2/16ths, ... 15/16ths of flows to skipped from the EMC.\n\nEach time the shed_threshold is adjusted it is moved by just one step.\n\nLater revisions will look at the actual lookup cost for flows in the EMC and dpcls rather than using hard-coded hit rates to define efficient use of the EMC. They may also adjust the shed rate in a proportional manner and adjust on a timed interval instead of every N packets.\n\n\n> \n> Probably the code could benefit from some expanded comments as well?\n> \n> I see one comment in the code\n> +        /* As hit rate goes down shed thresh goes up (more is shed from EMC)\n> */\n> +        /* XXX consider increment more if further out of bounds *\n> \n[[BO'M]] \n> \n>     Also we should decide on at least one flow distribution that would be\n> useful\n>     (i.e. realistic) for EMC testing. The tests above have either been carried out\n>     with a random (uniform) flow distribution which doesn't play well with flow\n>     caching or else a round-robin flow distribution which is actually adverserial\n>     to flow caching. If I have an agreed flow distribution I can then figure out\n>     how to produce it for testing :).\n> \n>     [1] https://urldefense.proofpoint.com/v2/url?u=https-\n> 3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-\n> 2DAugust_336509.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BVhFA\n> 09CGX7JQ5Ih-\n> uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=dr9kNy7p3\n> flCYC1W1AO02TRCvTHiazrQ9A5-Ssi4A7o&e=\n>     [2] https://urldefense.proofpoint.com/v2/url?u=https-\n> 3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-\n> 2DSeptember_338380.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BV\n> hFA09CGX7JQ5Ih-\n> uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=OvsyuPzDl\n> kZOk_fNXK380np29aySrXUeLKUUKqHCKjw&e=\n>     [3] https://urldefense.proofpoint.com/v2/url?u=https-\n> 3A__mail.openvswitch.org_pipermail_ovs-2Ddev_2017-\n> 2DAugust_337309.html&d=DwIBAg&c=uilaK90D4TOVoH58JNXRgQ&r=BVhFA\n> 09CGX7JQ5Ih-\n> uZnsw&m=xyXl4Y7PjflJKH8RTjHev3uMh9JgQGiFk0aPezyN3Qc&s=eDHE9eXgz\n> l8wlJhJ_pCqqSIuJYM0EfxgejqgD8xHBZ0&e=\n> \n>     Billy O'Mahony (1):\n>       dpif-netdev: RFC EMC load-shedding\n> \n>     Ilya Maximets (1):\n>       dpif-netdev: Fix per packet cycles statistics.\n> \n>      lib/dpif-netdev.c | 118\n> +++++++++++++++++++++++++++++++++++++++++++++++++-----\n>      1 file changed, 108 insertions(+), 10 deletions(-)\n> \n>     --\n>     2.7.4\n> \n>","headers":{"Return-Path":"<ovs-dev-bounces@openvswitch.org>","X-Original-To":["incoming@patchwork.ozlabs.org","dev@openvswitch.org"],"Delivered-To":["patchwork-incoming@bilbo.ozlabs.org","ovs-dev@mail.linuxfoundation.org"],"Authentication-Results":"ozlabs.org;\n\tspf=pass (mailfrom) smtp.mailfrom=openvswitch.org\n\t(client-ip=140.211.169.12; helo=mail.linuxfoundation.org;\n\tenvelope-from=ovs-dev-bounces@openvswitch.org;\n\treceiver=<UNKNOWN>)","Received":["from mail.linuxfoundation.org (mail.linuxfoundation.org\n\t[140.211.169.12])\n\t(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256\n\tbits)) (No client certificate requested)\n\tby ozlabs.org (Postfix) with ESMTPS id 3y133N3JkQz9tX3\n\tfor <incoming@patchwork.ozlabs.org>;\n\tMon, 25 Sep 2017 22:16:31 +1000 (AEST)","from mail.linux-foundation.org (localhost [127.0.0.1])\n\tby mail.linuxfoundation.org (Postfix) with ESMTP id 5E2C5A81;\n\tMon, 25 Sep 2017 12:16:28 +0000 (UTC)","from smtp1.linuxfoundation.org (smtp1.linux-foundation.org\n\t[172.17.192.35])\n\tby mail.linuxfoundation.org (Postfix) with ESMTPS id 32969710\n\tfor <dev@openvswitch.org>; Mon, 25 Sep 2017 12:16:27 +0000 (UTC)","from mga01.intel.com (mga01.intel.com [192.55.52.88])\n\tby smtp1.linuxfoundation.org (Postfix) with ESMTPS id 075E71A6\n\tfor <dev@openvswitch.org>; Mon, 25 Sep 2017 12:16:25 +0000 (UTC)","from orsmga001.jf.intel.com ([10.7.209.18])\n\tby fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384;\n\t25 Sep 2017 05:16:25 -0700","from irsmsx152.ger.corp.intel.com ([163.33.192.66])\n\tby orsmga001.jf.intel.com with ESMTP; 25 Sep 2017 05:16:23 -0700","from irsmsx107.ger.corp.intel.com ([169.254.10.65]) by\n\tIRSMSX152.ger.corp.intel.com ([169.254.6.87]) with mapi id\n\t14.03.0319.002; Mon, 25 Sep 2017 13:16:23 +0100"],"X-Greylist":"domain auto-whitelisted by SQLgrey-1.7.6","X-ExtLoop1":"1","X-IronPort-AV":"E=Sophos; i=\"5.42,436,1500966000\"; d=\"scan'208\";\n\ta=\"1175541844\"","From":"\"O Mahony, Billy\" <billy.o.mahony@intel.com>","To":"Darrell Ball <dball@vmware.com>, \"dev@openvswitch.org\"\n\t<dev@openvswitch.org>","Thread-Topic":"[RFC 0/2] EMC load-shedding","Thread-Index":"AQHTM6mAKejpGFgNBEGPPztg8/pDQaLBJrqAgARYY1A=","Date":"Mon, 25 Sep 2017 12:16:22 +0000","Message-ID":"<03135AEA779D444E90975C2703F148DC58C2047D@IRSMSX107.ger.corp.intel.com>","References":"<1506088063-20920-1-git-send-email-billy.o.mahony@intel.com>\n\t<B1C7356D-E274-4C91-A560-77C722AF16B1@vmware.com>","In-Reply-To":"<B1C7356D-E274-4C91-A560-77C722AF16B1@vmware.com>","Accept-Language":"en-IE, en-US","Content-Language":"en-US","X-MS-Has-Attach":"","X-MS-TNEF-Correlator":"","x-titus-metadata-40":"eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiM2YyNzQ5ZGQtZTkyYS00MTgxLWIzY2EtMTBkMWY2NDk4OTE4IiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX0lDIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE2LjUuOS4zIiwiVHJ1c3RlZExhYmVsSGFzaCI6IllIR00xK2NYWTRUd01LcWV5cmlPbU9iN3FneGJBOW9IQmRXczJOVUZlZkU9In0=","x-ctpclassification":"CTP_IC","dlp-product":"dlpe-windows","dlp-version":"11.0.0.116","dlp-reaction":"no-action","x-originating-ip":"[163.33.239.182]","MIME-Version":"1.0","X-Spam-Status":"No, score=-5.0 required=5.0 tests=RCVD_IN_DNSWL_HI,\n\tRP_MATCHES_RCVD autolearn=disabled version=3.3.1","X-Spam-Checker-Version":"SpamAssassin 3.3.1 (2010-03-16) on\n\tsmtp1.linux-foundation.org","Cc":"\"i.maximets@samsung.com\" <i.maximets@samsung.com>","Subject":"Re: [ovs-dev] [RFC 0/2] EMC load-shedding","X-BeenThere":"ovs-dev@openvswitch.org","X-Mailman-Version":"2.1.12","Precedence":"list","List-Id":"<ovs-dev.openvswitch.org>","List-Unsubscribe":"<https://mail.openvswitch.org/mailman/options/ovs-dev>,\n\t<mailto:ovs-dev-request@openvswitch.org?subject=unsubscribe>","List-Archive":"<http://mail.openvswitch.org/pipermail/ovs-dev/>","List-Post":"<mailto:ovs-dev@openvswitch.org>","List-Help":"<mailto:ovs-dev-request@openvswitch.org?subject=help>","List-Subscribe":"<https://mail.openvswitch.org/mailman/listinfo/ovs-dev>,\n\t<mailto:ovs-dev-request@openvswitch.org?subject=subscribe>","Content-Type":"text/plain; charset=\"us-ascii\"","Content-Transfer-Encoding":"7bit","Sender":"ovs-dev-bounces@openvswitch.org","Errors-To":"ovs-dev-bounces@openvswitch.org"}}]