From patchwork Tue Aug 31 10:50:01 2010 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: Eric Dumazet X-Patchwork-Id: 63224 X-Patchwork-Delegate: davem@davemloft.net Return-Path: X-Original-To: patchwork-incoming@ozlabs.org Delivered-To: patchwork-incoming@ozlabs.org Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by ozlabs.org (Postfix) with ESMTP id D3FC6B7139 for ; Tue, 31 Aug 2010 20:50:46 +1000 (EST) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757142Ab0HaKuJ (ORCPT ); Tue, 31 Aug 2010 06:50:09 -0400 Received: from mail-ww0-f44.google.com ([74.125.82.44]:37366 "EHLO mail-ww0-f44.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756988Ab0HaKuG (ORCPT ); Tue, 31 Aug 2010 06:50:06 -0400 Received: by wwb28 with SMTP id 28so1030370wwb.1 for ; Tue, 31 Aug 2010 03:50:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=yY9usCaWJd6Bb50UE6djFkJTtDn+JnuFAYxqdl4+0bE=; b=upatoqxjdfOapQtpdVfHbeg024b4cafVNfH0oA7OvFEHL7yIaXFak4PEJ8Jaq7oOqd 6qb7b7eyBL4kX5Z+v5zjdUMZL7/4j2NBFYsoMKZO859Nk7l3VHvoMlcG4dBWa8aqBCyw 8BgM7qtjt/XCBSUiHVssi81B4P1tf+OIA8/ho= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=ayVLGPgORJ7zlyYpnkBemYtz2oRpCpoCcGFkvAvZqzmCx4Upn8HtVcpoUCLt9PXCuN tzAE7t3U4ktQyG2VuqOAQcPFXH5t80fGfnD4as89xKkf9stX3HJOW54DXR9El0qUN/Iv 5s8sMZ/Nw7fAsfUEYdDD4xK8kvN0UjYVCremY= Received: by 10.227.144.206 with SMTP id a14mr6160664wbv.112.1283251804812; Tue, 31 Aug 2010 03:50:04 -0700 (PDT) Received: from [10.150.51.211] (gw0.net.jmsp.net [212.23.165.14]) by mx.google.com with ESMTPS id i14sm7508653wbe.12.2010.08.31.03.50.03 (version=SSLv3 cipher=RC4-MD5); Tue, 31 Aug 2010 03:50:03 -0700 (PDT) Subject: Re: vhost_dev_cleanup() crash: BUG: unable to handle kernel NULL pointer dereference From: Eric Dumazet To: Ingo Molnar Cc: netdev@vger.kernel.org, linux-kernel@vger.kernel.org, "Michael S. Tsirkin" , "David S. Miller" , Tejun Heo In-Reply-To: <20100831075705.GA4710@elte.hu> References: <20100831075705.GA4710@elte.hu> Date: Tue, 31 Aug 2010 12:50:01 +0200 Message-ID: <1283251801.2550.53.camel@edumazet-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.28.3 Sender: netdev-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org Le mardi 31 août 2010 à 09:57 +0200, Ingo Molnar a écrit : > FYI, there's a new crash in the vnet driver that occasionally triggers > on ordinary host bootups as well, when (non-virtualized) networking > initializes: > > [ 86.563889] [] page_fault+0x25/0x30 > [ 86.569065] [] ? vhost_poll_flush+0x11a/0x156 > [ 86.575119] [] ? kthread_stop+0xa/0x57 > [ 86.580544] [] vhost_dev_cleanup+0x269/0x271 > [ 86.586528] [] vhost_net_release+0x48/0x7f > [ 86.592359] [] fput+0x120/0x1d4 > [ 86.597185] [] filp_close+0x63/0x6d > [ 86.602353] [] sys_close+0xa8/0xe2 > [ 86.607429] [] system_call_fastpath+0x16/0x1b > > See the full crashlog below. Config attached. > > AFAICT this bug probably went upstream during the merge window. > > Thanks, > > Ingo > > [ 86.262123] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 > [ 86.265200] IP:ntry for device- [] kthread_stop+0xa/0x57 > [ 86.265200] PGD 3ad75067 PUD 3b352067 PMD 0 > [ 86.265200] Oops: 0002 [#1] SMP > [ 86.265200] last sysfs file: /sys/devices/pnp0/00:0d/id > [ 86.265200] CPU 0 mapper found > Is > [ 86.265200] Pid: 1254, comm: multipath.stati Not tainted 2.6.36-rc3-tip+ #31158 A8N-E/System Product Name > device-mapper d[ 86.265200] RIP: 0010:[] [] kthread_stop+0xa/0x57 > river missing fr[ 86.265200] RSP: 0018:ffff88003ae83e58 EFLAGS: 00010246 > [ 86.265200] RAX: ffff88003d1dc170 RBX: 0000000000000000 RCX: 0000000000000000 > [ 86.265200] RDX: ffff88003aa82030 RSI: 0000000000000001 RDI: 0000000000000000 > om kernel? > devi[ 86.265200] RBP: ffff88003ae83e68 R08: ffff88003ae83e68 R09: 0000000000000001 > [ 86.265200] R10: ffffffff8186d899 R11: 0000000000000246 R12: ffff88003d1dc8f0 > [ 86.265200] R13: 0000000000000002 R14: ffff88003b2a1000 R15: ffff88003aa82030 > [ 86.265200] FS: 0000000001fc5880(0063) GS:ffff88003fc00000(0000) knlGS:0000000000000000 > ce-mapper: versi[ 86.265200] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b > [ 86.265200] CR2: 0000000000000010 CR3: 000000003b377000 CR4: 00000000000006f0 > on ioctl failed:[ 86.265200] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 > [ 86.265200] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 > [ 86.265200] Process multipath.stati (pid: 1254, threadinfo ffff88003ae82000, task ffff88003b3e8000) > [ 86.265200] Stack: > [ 86.265200] ffff88003d1dc090 ffff88003d1dc8f0 ffff88003ae83e98 ffffffff8186e535 > [ 86.265200] <0> ffff88003ae83e98 ffff88003d1dc090 0000000000000000 0000000000000000 > [ 86.265200] <0> ffff88003ae83ec8 ffffffff8186e974 0000000000000008 ffff88003b3a6180 > [ 86.265200] Call Trace: > [ 86.265200] [] vhost_dev_cleanup+0x269/0x271 > Operation not p[ 86.265200] [] vhost_net_release+0x48/0x7f > [ 86.265200] [] fput+0x120/0x1d4 > ermitted > [ 86.265200] [] filp_close+0x63/0x6d > [ 86.265200] [] sys_close+0xa8/0xe2 > [ 86.265200] [] system_call_fastpath+0x16/0x1b > [ 86.265200] Code: 4c 8b 25 83 b4 16 01 49 81 fc 70 a9 1c 82 75 94 48 c7 c7 80 a9 1c 82 e8 99 5b aa 00 e9 50 ff ff ff 55 48 89 e5 41 54 53 48 89 fb ff 47 10 4c 8b a7 00 05 00 00 48 83 bf 00 05 00 00 00 74 16 > [ 86.265200] RIP [] kthread_stop+0xa/0x57 > [ 86.265200] RSP > [ 86.265200] CR2: 0000000000000010 > [ 86.499743] ---[ end trace 433623c38ffeb225 ]--- > [ 86.504397] Kernel panic - not syncing: Fatal exception > [ 86.509633] Pid: 1254, comm: multipath.stati Tainted: G D 2.6.36-rc3-tip+ #31158 > [ 86.517858] Call Trace: > [ 86.520343] [] panic+0x8c/0x196 > [ 86.525181] [] ? kmsg_dump+0x126/0x140 > [ 86.530606] [] oops_end+0x8f/0x9c > [ 86.535611] [] no_context+0x1f7/0x206 > [ 86.540948] [] __bad_area_nosemaphore+0x17f/0x1a2 > [ 86.547334] [] bad_area+0x42/0x49 > [ 86.552329] [] do_page_fault+0x1fe/0x363 > [ 86.557925] [] ? do_raw_spin_lock+0x6b/0x122 > [ 86.563889] [] page_fault+0x25/0x30 > [ 86.569065] [] ? vhost_poll_flush+0x11a/0x156 > [ 86.575119] [] ? kthread_stop+0xa/0x57 > [ 86.580544] [] vhost_dev_cleanup+0x269/0x271 > [ 86.586528] [] vhost_net_release+0x48/0x7f > [ 86.592359] [] fput+0x120/0x1d4 > [ 86.597185] [] filp_close+0x63/0x6d > [ 86.602353] [] sys_close+0xa8/0xe2 > [ 86.607429] [] system_call_fastpath+0x16/0x1b > [ 86.613516] Rebooting in 1 seconds..Press any key to enter the menu Hi Ingo Seems to be commit c23f3445e68e1 (vhost: replace vhost_workqueue with per-vhost kthread) following patch should cure it ? Thanks [PATCH] vhost: stop worker only if created Its illegal to call kthread_stop(NULL) Reported-by: Ingo Molnar Signed-off-by: Eric Dumazet Tested-by: Ingo Molnar --- -- To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html diff --git a/drivers/vhost/vhost.c b/drivers/vhost/vhost.c index e05557d..0a00121 100644 --- a/drivers/vhost/vhost.c +++ b/drivers/vhost/vhost.c @@ -323,7 +323,8 @@ void vhost_dev_cleanup(struct vhost_dev *dev) dev->mm = NULL; WARN_ON(!list_empty(&dev->work_list)); - kthread_stop(dev->worker); + if (dev->worker) + kthread_stop(dev->worker); } static int log_access_ok(void __user *log_base, u64 addr, unsigned long sz)