[{"id":3675076,"web_url":"http://patchwork.ozlabs.org/comment/3675076/","msgid":"<730ef9ef-cd7f-455c-a815-f354e34b7596@canonical.com>","list_archive_url":null,"date":"2026-04-09T05:13:29","subject":"ACK: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with data=journal\n mode may dump call trace","submitter":{"id":85372,"url":"http://patchwork.ozlabs.org/api/people/85372/","name":"Masahiro Yamada","email":"masahiro.yamada@canonical.com"},"content":"On 4/7/26 18:26, Gerald Yang wrote:\n> BugLink: https://bugs.launchpad.net/bugs/2147400\n>\n> [Impact]\n>\n> When journal is filled with some data and remount the filesystem to read-only in data=journal mode\n> it may dump the following call trace:\n> [   71.629350] CPU: 0 UID: 0 PID: 177 Comm: kworker/u96:5 Tainted: G            E       6.19.0-rc7 #1 PREEMPT(voluntary)\n> [   71.629352] Tainted: [E]=UNSIGNED_MODULE\n> [   71.629353] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS unknown 2/2/2022\n> [   71.629354] Workqueue: writeback wb_workfn (flush-7:4)\n> [   71.629359] RIP: 0010:ext4_journal_check_start+0x8b/0xd0\n> [   71.629360] Code: 31 ff 45 31 c0 45 31 c9 e9 42 ad c4 00 48 8b 5d f8 b8 fb ff ff ff c9 31 d2 31 c9 31 f6 31 ff 45 31 c0 45 31 c9 c3 cc cc cc cc <0f> 0b b8 e2 ff ff ff eb c2 0f 0b eb\n>   a9 44 8b 42 08 68 c7 53 ce b8\n> [   71.629361] RSP: 0018:ffffcf32c0fdf6a8 EFLAGS: 00010202\n> [   71.629364] RAX: ffff8f08c8505000 RBX: ffff8f08c67ee800 RCX: 0000000000000000\n> [   71.629366] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000\n> [   71.629367] RBP: ffffcf32c0fdf6b0 R08: 0000000000000001 R09: 0000000000000000\n> [   71.629368] R10: ffff8f08db18b3a8 R11: 0000000000000000 R12: 0000000000000000\n> [   71.629368] R13: 0000000000000002 R14: 0000000000000a48 R15: ffff8f08c67ee800\n> [   71.629369] FS:  0000000000000000(0000) GS:ffff8f0a7d273000(0000) knlGS:0000000000000000\n> [   71.629370] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n> [   71.629371] CR2: 00007b66825905cc CR3: 000000011053d004 CR4: 0000000000772ef0\n> [   71.629374] PKRU: 55555554\n> [   71.629374] Call Trace:\n> [   71.629378]  <TASK>\n> [   71.629382]  __ext4_journal_start_sb+0x38/0x1c0\n> [   71.629383]  mpage_prepare_extent_to_map+0x4af/0x580\n> [   71.629389]  ? sbitmap_get+0x73/0x180\n> [   71.629399]  ext4_do_writepages+0x3cc/0x10a0\n> [   71.629400]  ? kvm_sched_clock_read+0x11/0x20\n> [   71.629409]  ext4_writepages+0xc8/0x1b0\n> [   71.629410]  ? ext4_writepages+0xc8/0x1b0\n> [   71.629411]  do_writepages+0xc4/0x180\n> [   71.629416]  __writeback_single_inode+0x45/0x350\n> [   71.629419]  ? _raw_spin_unlock+0xe/0x40\n> [   71.629423]  writeback_sb_inodes+0x260/0x5c0\n> [   71.629425]  ? __schedule+0x4d1/0x1870\n> [   71.629429]  __writeback_inodes_wb+0x54/0x100\n> [   71.629431]  ? queue_io+0x82/0x140\n> [   71.629433]  wb_writeback+0x1ab/0x330\n> [   71.629448]  wb_workfn+0x31d/0x410\n> [   71.629450]  process_one_work+0x191/0x3e0\n> [   71.629455]  worker_thread+0x2e3/0x420\n>\n> [Fix]\n>\n> This upstream commit fixes the issue:\n> https://github.com/torvalds/linux/commit/f4a2b42e78914ff15630e71289adc589c3a8eb45\n>\n> All the discussions are in this thread:\n> https://lore.kernel.org/all/20260128074515.2028982-1-gerald.yang@canonical.com/\n>\n> [Test Plan]\n>\n> This can be easily reproduced by the following script:\n> mkdir -p mnt\n> dd if=/dev/zero of=ext4disk bs=1G count=2 oflag=direct\n> mkfs.ext4 ext4disk\n> tune2fs -o journal_data ext4disk\n> mount ext4disk mnt\n> fio --name=fiotest --rw=randwrite --bs=4k --runtime=3 --ioengine=libaio --iodepth=128 --numjobs=4 --filename=mnt/fiotest --filesize=1G --group_reporting\n> mount -o remount,ro ext4disk mnt\n> sync\n>\n> [Where problems could occur]\n>\n> When the call trace happens, there is no data lost, all the dirty data has been flushed to file system before remounting.\n> The fix is to make sure folio state is correct and update the xarray, so the writeback thread won't be trigger if there is no dirty data.\n> So if there is something really goes wrong, there still won't be data lost, even remount it to read-write mode again.\n>\n> Jan Kara (1):\n>    ext4: fix stale xarray tags after writeback\n>\n>   fs/ext4/page-io.c | 10 ++++++++--\n>   1 file changed, 8 insertions(+), 2 deletions(-)\n>\nAcked-by: Masahiro Yamada <masahiro.yamada@canonical.com>","headers":{"Return-Path":"<kernel-team-bounces@lists.ubuntu.com>","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@legolas.ozlabs.org","Authentication-Results":["legolas.ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (4096-bit key;\n unprotected) header.d=canonical.com header.i=@canonical.com\n header.a=rsa-sha256 header.s=20251003 header.b=oVblwwY9;\n\tdkim-atps=neutral","legolas.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=lists.ubuntu.com\n (client-ip=185.125.189.65; helo=lists.ubuntu.com;\n envelope-from=kernel-team-bounces@lists.ubuntu.com;\n receiver=patchwork.ozlabs.org)"],"Received":["from lists.ubuntu.com (lists.ubuntu.com [185.125.189.65])\n\t(using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby legolas.ozlabs.org (Postfix) with ESMTPS id 4frp4T6vk7z1yCv\n\tfor <incoming@patchwork.ozlabs.org>; Thu, 09 Apr 2026 15:13:45 +1000 (AEST)","from localhost ([127.0.0.1] helo=lists.ubuntu.com)\n\tby lists.ubuntu.com with esmtp (Exim 4.86_2)\n\t(envelope-from <kernel-team-bounces@lists.ubuntu.com>)\n\tid 1wAhhv-0005NT-On; Thu, 09 Apr 2026 05:13:35 +0000","from smtp-relay-internal-0.internal ([10.131.114.225]\n helo=smtp-relay-internal-0.canonical.com)\n by lists.ubuntu.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)\n (Exim 4.86_2) (envelope-from <masahiro.yamada@canonical.com>)\n id 1wAhhv-0005NM-7m\n for kernel-team@lists.ubuntu.com; Thu, 09 Apr 2026 05:13:35 +0000","from mail-qk1-f200.google.com (mail-qk1-f200.google.com\n [209.85.222.200])\n (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest\n SHA256)\n (No client certificate requested)\n by smtp-relay-internal-0.canonical.com (Postfix) with ESMTPS id 1DD2A3F655\n for <kernel-team@lists.ubuntu.com>; Thu,  9 Apr 2026 05:13:35 +0000 (UTC)","by mail-qk1-f200.google.com with SMTP id\n af79cd13be357-8d3bea3aa34so109675585a.0\n for <kernel-team@lists.ubuntu.com>; Wed, 08 Apr 2026 22:13:35 -0700 (PDT)","from ?IPV6:2001:67c:1562:8007::aac:401c?\n ([2001:67c:1562:8007::aac:401c]) by smtp.gmail.com with ESMTPSA id\n d75a77b69052e-50d4b73ea66sm213786811cf.14.2026.04.08.22.13.31\n (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);\n Wed, 08 Apr 2026 22:13:32 -0700 (PDT)"],"DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=canonical.com;\n s=20251003; t=1775711615;\n bh=hCFR7kVl1eoRboxiHiOe9oKgXgUiYSyFKzSzSyi4wGY=;\n h=Message-ID:Date:MIME-Version:Subject:To:References:From:\n In-Reply-To:Content-Type;\n b=oVblwwY907SrOQtBncib4py8sobn6G/9Ih0aRw5KpPgk8HPk41gK/pzJAb3Srcrgl\n 5KppwaZ2AXtCAxMRJP0VwHFfRtGD0Xh1pYDdjdj4oM6hoQQNYc3Zzgg8gK8mJD8S0v\n 0XU9/13jDpabl74rct4LngsiluOXlBeC5oGp1c2B9aF/hvEHPWadTQvY2KqyR2GNjg\n 32htdZxpogyYjx02QHrYG37waBzlxjK3Sdjoc5tjRoD4xDTBwYVjxyv7U8cetrEvnr\n Hp/0pFxFaXmDp1qG8xH8XXyRgRteuj4ZwCMEWTSltCIyyTlhrK5GP55iOCLA1pj1cj\n PWIuLkEWuzC+GL30zySUXnx4XH6KjAc14Z7DNhcduzpmfWJsVQTIYxHrcrrnhNOi9d\n mpH8F0YOUqdBFVzNsbIXJ47wDa58cUiqJlmHmDCSOtglbY2inNCKLMn798bHS+ovUI\n GiGXBd+YHtDOPjFdC8SKcWsUjX3DH3RPcwCUFV4eXomQAuJOjvgp6cz1vp1bxRjYUY\n VA/IzcDaLxf6i+lQctsIgQbSVbZoH7xcmlo1xwwH61kk84dABeJDGZkVldLbvLlJhk\n DvfM2rs6hIh/e5lVXEoaGC6e1/Sehw5dZItlMcQFZIHF3fTDjHMxeDJkwtZx1R5jq4\n zMASbYn5yagwo62dfNTqGLpU=","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n d=1e100.net; s=20251104; t=1775711614; x=1776316414;\n h=content-transfer-encoding:in-reply-to:content-language:from\n :references:to:subject:user-agent:mime-version:date:message-id\n :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id\n :reply-to;\n bh=hCFR7kVl1eoRboxiHiOe9oKgXgUiYSyFKzSzSyi4wGY=;\n b=NgZdpsKMbsQJqVk4RVGWyD/OvQWAvqE9MEZKn+601q1MfQXUt5j6vIvGYXU64xXSXq\n 4TZV8lCQuXQi/+2t844G1GvX1hc44bac4Mh0M7jIyR4jl9ff4PNHzskWRca4wHFzBV43\n iKqZFgSQRK0iXm5gEEPSYaAV2pnawF6LFg/1w5dlgcatL8mOm7MasmHb6h79SZNTIU2f\n mUp/jMRrZ3JbJ0/jv3moJj2Cuq/S1yACbXMII88KNGsjin1xO5Erpv1SANKQqsGFPFAH\n s2blK6TJ2Na2hKS3mvYoKwdpJhZh+cpKdQKQLA4yKOMiu4ECVDSzuqetZnOvLOI+ViR0\n 2+1Q==","X-Forwarded-Encrypted":"i=1;\n AJvYcCWuCOuSLDbhhuJV0Ljnu2YLFkYTllnQtDSDMqNCL9gogo2CAYIaN8B4VYM8ecVlZF7xH8wsu/3vEC4svg==@lists.ubuntu.com","X-Gm-Message-State":"AOJu0Yyey+Ukh0nz4qMp9PhHjfp0eCGtd1r5wHOdVRWp4YydWP1WKj5/\n CLUcntZi3009a0Za/i5w8D8q9W1Z2WO+ymvjGE7w9E/dKF22ZkSDuX/bDGsmLVmyjbwu34xPX1a\n l8Bc1pY6brb19Div0TT5fU6lKrnLBGsYx9An6GvAgSenRdYA0FXvcl8pGIoX4GmVTWaktoosQvK\n q8ha1bBLntfBz68Q==","X-Gm-Gg":"AeBDieumaiY0bQMlJ4auXKKMui36/jrKgAWTO3vyMs9oU4ygaNdS7TUufuhi/26h/aO\n Yty0UJdEl+2k2XSb4RPnO9BpMB1zcIT6YQ5HPMx1mMczMg3VwoS/GblRDCIy0hvhDJWeedwpSOG\n BfUrYa3gcJ4hsotbEefnc0j9FPnuIHEsBU0IYyUCpB3mJwHDZn91P4fKbvrQamjbH/QKGfsYw+H\n zdi3oB6dmlktWRymqx6GcL2IPLj9XrpNJFl3qKZmpTZ4NGj7lLPni8GcBVtKXbWmofN/3bPzBxr\n sP31pcxhUyokzphRgf6pRMG3mP8S3/Prdk7vdvAHRx6rdgGvvgC91oJoYvcQkZB9dizegQ0EMVl\n ELf4cWxzWtUbgPSzy+EjRguW9qkv05f/InDPp6+y9ZR5g/ZJSa4gqA3cr","X-Received":["by 2002:a05:622a:544f:b0:50b:29f0:299c with SMTP id\n d75a77b69052e-50d62b53f30mr353033501cf.60.1775711613670;\n Wed, 08 Apr 2026 22:13:33 -0700 (PDT)","by 2002:a05:622a:544f:b0:50b:29f0:299c with SMTP id\n d75a77b69052e-50d62b53f30mr353033341cf.60.1775711613305;\n Wed, 08 Apr 2026 22:13:33 -0700 (PDT)"],"Message-ID":"<730ef9ef-cd7f-455c-a815-f354e34b7596@canonical.com>","Date":"Thu, 9 Apr 2026 14:13:29 +0900","MIME-Version":"1.0","User-Agent":"Mozilla Thunderbird","Subject":"ACK: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with data=journal\n mode may dump call trace","To":"Gerald Yang <gerald.yang@canonical.com>, kernel-team@lists.ubuntu.com","References":"<20260407092650.1094713-1-gerald.yang@canonical.com>","From":"Masahiro Yamada <masahiro.yamada@canonical.com>","Content-Language":"en-US","In-Reply-To":"<20260407092650.1094713-1-gerald.yang@canonical.com>","X-BeenThere":"kernel-team@lists.ubuntu.com","X-Mailman-Version":"2.1.20","Precedence":"list","List-Id":"Kernel team discussions <kernel-team.lists.ubuntu.com>","List-Unsubscribe":"<https://lists.ubuntu.com/mailman/options/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=unsubscribe>","List-Archive":"<https://lists.ubuntu.com/archives/kernel-team>","List-Post":"<mailto:kernel-team@lists.ubuntu.com>","List-Help":"<mailto:kernel-team-request@lists.ubuntu.com?subject=help>","List-Subscribe":"<https://lists.ubuntu.com/mailman/listinfo/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=subscribe>","Content-Transfer-Encoding":"base64","Content-Type":"text/plain; charset=\"utf-8\"; Format=\"flowed\"","Errors-To":"kernel-team-bounces@lists.ubuntu.com","Sender":"\"kernel-team\" <kernel-team-bounces@lists.ubuntu.com>"}},{"id":3675624,"web_url":"http://patchwork.ozlabs.org/comment/3675624/","msgid":"<0d1a3393-ebca-4df5-ab88-44395f540a4f@canonical.com>","list_archive_url":null,"date":"2026-04-10T03:08:47","subject":"ACK: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with data=journal\n mode may dump call trace","submitter":{"id":92836,"url":"http://patchwork.ozlabs.org/api/people/92836/","name":"Yufeng Gao","email":"yufeng.gao@canonical.com"},"content":"On 7/4/26 19:26, Gerald Yang wrote:\n> BugLink: https://bugs.launchpad.net/bugs/2147400\n>\n> [Impact]\n>\n> When journal is filled with some data and remount the filesystem to read-only in data=journal mode\n> it may dump the following call trace:\n> [   71.629350] CPU: 0 UID: 0 PID: 177 Comm: kworker/u96:5 Tainted: G            E       6.19.0-rc7 #1 PREEMPT(voluntary)\n> [   71.629352] Tainted: [E]=UNSIGNED_MODULE\n> [   71.629353] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS unknown 2/2/2022\n> [   71.629354] Workqueue: writeback wb_workfn (flush-7:4)\n> [   71.629359] RIP: 0010:ext4_journal_check_start+0x8b/0xd0\n> [   71.629360] Code: 31 ff 45 31 c0 45 31 c9 e9 42 ad c4 00 48 8b 5d f8 b8 fb ff ff ff c9 31 d2 31 c9 31 f6 31 ff 45 31 c0 45 31 c9 c3 cc cc cc cc <0f> 0b b8 e2 ff ff ff eb c2 0f 0b eb\n>   a9 44 8b 42 08 68 c7 53 ce b8\n> [   71.629361] RSP: 0018:ffffcf32c0fdf6a8 EFLAGS: 00010202\n> [   71.629364] RAX: ffff8f08c8505000 RBX: ffff8f08c67ee800 RCX: 0000000000000000\n> [   71.629366] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000\n> [   71.629367] RBP: ffffcf32c0fdf6b0 R08: 0000000000000001 R09: 0000000000000000\n> [   71.629368] R10: ffff8f08db18b3a8 R11: 0000000000000000 R12: 0000000000000000\n> [   71.629368] R13: 0000000000000002 R14: 0000000000000a48 R15: ffff8f08c67ee800\n> [   71.629369] FS:  0000000000000000(0000) GS:ffff8f0a7d273000(0000) knlGS:0000000000000000\n> [   71.629370] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n> [   71.629371] CR2: 00007b66825905cc CR3: 000000011053d004 CR4: 0000000000772ef0\n> [   71.629374] PKRU: 55555554\n> [   71.629374] Call Trace:\n> [   71.629378]  <TASK>\n> [   71.629382]  __ext4_journal_start_sb+0x38/0x1c0\n> [   71.629383]  mpage_prepare_extent_to_map+0x4af/0x580\n> [   71.629389]  ? sbitmap_get+0x73/0x180\n> [   71.629399]  ext4_do_writepages+0x3cc/0x10a0\n> [   71.629400]  ? kvm_sched_clock_read+0x11/0x20\n> [   71.629409]  ext4_writepages+0xc8/0x1b0\n> [   71.629410]  ? ext4_writepages+0xc8/0x1b0\n> [   71.629411]  do_writepages+0xc4/0x180\n> [   71.629416]  __writeback_single_inode+0x45/0x350\n> [   71.629419]  ? _raw_spin_unlock+0xe/0x40\n> [   71.629423]  writeback_sb_inodes+0x260/0x5c0\n> [   71.629425]  ? __schedule+0x4d1/0x1870\n> [   71.629429]  __writeback_inodes_wb+0x54/0x100\n> [   71.629431]  ? queue_io+0x82/0x140\n> [   71.629433]  wb_writeback+0x1ab/0x330\n> [   71.629448]  wb_workfn+0x31d/0x410\n> [   71.629450]  process_one_work+0x191/0x3e0\n> [   71.629455]  worker_thread+0x2e3/0x420\n>\n> [Fix]\n>\n> This upstream commit fixes the issue:\n> https://github.com/torvalds/linux/commit/f4a2b42e78914ff15630e71289adc589c3a8eb45\n>\n> All the discussions are in this thread:\n> https://lore.kernel.org/all/20260128074515.2028982-1-gerald.yang@canonical.com/\n>\n> [Test Plan]\n>\n> This can be easily reproduced by the following script:\n> mkdir -p mnt\n> dd if=/dev/zero of=ext4disk bs=1G count=2 oflag=direct\n> mkfs.ext4 ext4disk\n> tune2fs -o journal_data ext4disk\n> mount ext4disk mnt\n> fio --name=fiotest --rw=randwrite --bs=4k --runtime=3 --ioengine=libaio --iodepth=128 --numjobs=4 --filename=mnt/fiotest --filesize=1G --group_reporting\n> mount -o remount,ro ext4disk mnt\n> sync\n>\n> [Where problems could occur]\n>\n> When the call trace happens, there is no data lost, all the dirty data has been flushed to file system before remounting.\n> The fix is to make sure folio state is correct and update the xarray, so the writeback thread won't be trigger if there is no dirty data.\n> So if there is something really goes wrong, there still won't be data lost, even remount it to read-write mode again.\n>\n> Jan Kara (1):\n>    ext4: fix stale xarray tags after writeback\n>\n>   fs/ext4/page-io.c | 10 ++++++++--\n>   1 file changed, 8 insertions(+), 2 deletions(-)\n>\nAcked-by: Yufeng Gao <yufeng.gao@canonical.com>","headers":{"Return-Path":"<kernel-team-bounces@lists.ubuntu.com>","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@legolas.ozlabs.org","Authentication-Results":["legolas.ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (4096-bit key;\n unprotected) header.d=canonical.com header.i=@canonical.com\n header.a=rsa-sha256 header.s=20251003 header.b=aar5SFbB;\n\tdkim-atps=neutral","legolas.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=lists.ubuntu.com\n (client-ip=185.125.189.65; helo=lists.ubuntu.com;\n envelope-from=kernel-team-bounces@lists.ubuntu.com;\n receiver=patchwork.ozlabs.org)"],"Received":["from lists.ubuntu.com (lists.ubuntu.com [185.125.189.65])\n\t(using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby legolas.ozlabs.org (Postfix) with ESMTPS id 4fsMGD15j3z1yCv\n\tfor <incoming@patchwork.ozlabs.org>; Fri, 10 Apr 2026 13:09:07 +1000 (AEST)","from localhost ([127.0.0.1] helo=lists.ubuntu.com)\n\tby lists.ubuntu.com with esmtp (Exim 4.86_2)\n\t(envelope-from <kernel-team-bounces@lists.ubuntu.com>)\n\tid 1wB2Ep-0002uX-98; Fri, 10 Apr 2026 03:08:55 +0000","from smtp-relay-internal-0.internal ([10.131.114.225]\n helo=smtp-relay-internal-0.canonical.com)\n by lists.ubuntu.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)\n (Exim 4.86_2) (envelope-from <yufeng.gao@canonical.com>)\n id 1wB2En-0002uL-QV\n for kernel-team@lists.ubuntu.com; Fri, 10 Apr 2026 03:08:53 +0000","from mail-pj1-f71.google.com (mail-pj1-f71.google.com\n [209.85.216.71])\n (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest\n SHA256)\n (No client certificate requested)\n by smtp-relay-internal-0.canonical.com (Postfix) with ESMTPS id 8F6E83F78E\n for <kernel-team@lists.ubuntu.com>; Fri, 10 Apr 2026 03:08:53 +0000 (UTC)","by mail-pj1-f71.google.com with SMTP id\n 98e67ed59e1d1-35daf3d3030so2048012a91.1\n for <kernel-team@lists.ubuntu.com>; Thu, 09 Apr 2026 20:08:53 -0700 (PDT)","from ?IPV6:2001:8003:ec14:5900:1079:dba2:1a81:86a8?\n ([2001:8003:ec14:5900:1079:dba2:1a81:86a8])\n by smtp.gmail.com with ESMTPSA id\n d9443c01a7336-2b2d4f25df6sm10565935ad.56.2026.04.09.20.08.49\n for <kernel-team@lists.ubuntu.com>\n (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);\n Thu, 09 Apr 2026 20:08:51 -0700 (PDT)"],"DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=canonical.com;\n s=20251003; t=1775790533;\n bh=/vsS3Z0mEp9qrLhm783jkP0wasfE2B2s9oiUomoVLxc=;\n h=Message-ID:Date:MIME-Version:Subject:To:References:From:\n In-Reply-To:Content-Type;\n b=aar5SFbByHkvfrAe67/XrljIe1oKWcRPEzc9rz8tVeCIuikrytFyuu2h1rgOKGAmI\n vMuNramhGEzlw6h88fXQ/T8FGQ+/5rbIXQf/niylqQl7+BVPWberG+kJ4m6Vgz1gzc\n 8ksNOjy8XzKqI+0aW/s7XV3v+CFsSMflkSSixtdYXBhtEt6BJpTB1D9akh9qsFxbg8\n JP0dqqK5GEXm0o2iHXJAEAK6ITnCPqz+2Y+rTe03M03iUnJHdRGQ2zExepIbqP0V+9\n CBfVSbDQXxSTSARn0gQCZbSiIFsFkSHcBvHZJEuM/vHCB7PJjJnvZyi4+3iKjuLNq6\n L51JZdKoMRVQN2lMakJB3tkA8R7AJx7IkGs75SOW65tPn+oJj/mWRIAYWgsJkdZWBo\n n4tMeTz+9TFx8gjWEl57TvicQ8/stacYYROkyN1KEqHYSSWRRSZJFR7CQb83KIN5/n\n Ox6fVWTgs39JH5mUof6I6FaIMN/hPY1GEdUmzHoI1shOLYBjX4srX5PIMdvyDkWFrH\n AHLXBoZtmo3nkFbEJ8+uDpav837EuM39lrZ9rAt6ke7oBod/wZPu8+MwLGA6FaGhoS\n 1ToCisPS1O2+pmM1tg2FrF3c7rb8h6i+oIGguNxas4iCzy0E6w+VsbJeEPqWsEjr6c\n +kERrYm0NMhxD18NtVcZtB8Q=","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n d=1e100.net; s=20251104; t=1775790532; x=1776395332;\n h=content-transfer-encoding:in-reply-to:content-language:from\n :references:to:subject:user-agent:mime-version:date:message-id\n :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id\n :reply-to;\n bh=/vsS3Z0mEp9qrLhm783jkP0wasfE2B2s9oiUomoVLxc=;\n b=KLRAxCr4TXoeU+oyzrhz0k/9iqwbPk+ZZxx2tCfJZtQow/b2wOU49OLO//0a5MaEeA\n 9MRJ/ovNTM4VOsFawMlWi9njCkPlhljZ0Qx+38rF3ofwqy4bsg0k+skADTDSmhxMM/c+\n pbQ6ZkndAIX2HReIFSRauRtNVo7tDLpMM8W4spsqZxDOO2y0dTQl6h65DZuvQIjQvIYE\n Es5RcK5JTZTjSH6gSORSyjD2haQM266j+z1+fGMrznWeXFKwYSyYaEtOfTh1ketDQCy4\n 31rqRB2ilssZK3Naiwy2BrhvAlOjAT8V1ZCYbZ7BfaXqpd/o+eauPgVlku3sjoMlNsUF\n uaJw==","X-Gm-Message-State":"AOJu0Yy5z18HpUGgiJoAPlM9Yr7wNVLa+qw2L8GTB22K6QWEBY7UzXFm\n 9/PY9q+B3DONdRurhnrYmjWqLhWskjOd+qp41sVxb0cFfENDOj7fgoaQnKly81mBZXzXjB2yiT/\n tRikb3aI5H/4VYRht6TkjUFk9EZjhTz820fCc2BrQOm0Ro8jGIP98I9NDI+wgmQtpdyA9whFVa/\n Q9JlyDr82gDcmbfA==","X-Gm-Gg":"AeBDietgeicjJ9XnYcRVI01A4l3ZOQM6BXn+4G/XGSX3rKyj/N2MNdCOVGSZrRRKaXz\n /F2BorDz4vyTgdIV246BbhH4lmcmjKSa93xpzfkrWcFxHzDfU8gMVwQL+ymQDeU9lrZSSDQ0yBl\n jbIlQQRv4kKS4Wz5jK+k0fPpc4V3zjpAqiVAaudrPcSlWseTcOIOSamqEd9wcH+TiVg15vomTlE\n hUYK5gF66bStqnk9W5jtBTqNQsCxlR0FFJ9mWw/ws22z4VS9CgQ1XBoNHV3j/8ZpzPeNRpE8Fvb\n 1B21fkuztfDuuU74HmfYTDwfy51sKwnMvHkLvnF5+ru/IT/FCF7ys5HF1WMTTqPlxuLH17cJ1oU\n B6+82gb9FJAyhwV2jePABbQqz/UWSlMScMaSIdIKaAOcOih0JBNLR7LoBtHyEp6ECiQm20Q4UBf\n 7MPV0=","X-Received":["by 2002:a17:90b:3dcb:b0:35c:d98:d66f with SMTP id\n 98e67ed59e1d1-35e42843cf0mr1507258a91.21.1775790532171;\n Thu, 09 Apr 2026 20:08:52 -0700 (PDT)","by 2002:a17:90b:3dcb:b0:35c:d98:d66f with SMTP id\n 98e67ed59e1d1-35e42843cf0mr1507226a91.21.1775790531573;\n Thu, 09 Apr 2026 20:08:51 -0700 (PDT)"],"Message-ID":"<0d1a3393-ebca-4df5-ab88-44395f540a4f@canonical.com>","Date":"Fri, 10 Apr 2026 13:08:47 +1000","MIME-Version":"1.0","User-Agent":"Mozilla Thunderbird","Subject":"ACK: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with data=journal\n mode may dump call trace","To":"kernel-team@lists.ubuntu.com","References":"<20260407092650.1094713-1-gerald.yang@canonical.com>","From":"Yufeng Gao <yufeng.gao@canonical.com>","Content-Language":"en-US","In-Reply-To":"<20260407092650.1094713-1-gerald.yang@canonical.com>","X-BeenThere":"kernel-team@lists.ubuntu.com","X-Mailman-Version":"2.1.20","Precedence":"list","List-Id":"Kernel team discussions <kernel-team.lists.ubuntu.com>","List-Unsubscribe":"<https://lists.ubuntu.com/mailman/options/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=unsubscribe>","List-Archive":"<https://lists.ubuntu.com/archives/kernel-team>","List-Post":"<mailto:kernel-team@lists.ubuntu.com>","List-Help":"<mailto:kernel-team-request@lists.ubuntu.com?subject=help>","List-Subscribe":"<https://lists.ubuntu.com/mailman/listinfo/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=subscribe>","Content-Transfer-Encoding":"base64","Content-Type":"text/plain; charset=\"utf-8\"; Format=\"flowed\"","Errors-To":"kernel-team-bounces@lists.ubuntu.com","Sender":"\"kernel-team\" <kernel-team-bounces@lists.ubuntu.com>"}},{"id":3676115,"web_url":"http://patchwork.ozlabs.org/comment/3676115/","msgid":"<873412rqhm.fsf@gmail.com>","list_archive_url":null,"date":"2026-04-11T05:54:45","subject":"APPLIED: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with\n data=journal mode may dump call trace","submitter":{"id":89305,"url":"http://patchwork.ozlabs.org/api/people/89305/","name":"Mehmet Basaran","email":"mehmet.basaran@canonical.com"},"content":"Applied to noble:linux, questing:linux master-next branches. Thanks.\nGerald Yang <gerald.yang@canonical.com> writes:\n\n> BugLink: https://bugs.launchpad.net/bugs/2147400\n>\n> [Impact]\n>\n> When journal is filled with some data and remount the filesystem to read-only in data=journal mode\n> it may dump the following call trace:\n> [   71.629350] CPU: 0 UID: 0 PID: 177 Comm: kworker/u96:5 Tainted: G            E       6.19.0-rc7 #1 PREEMPT(voluntary)\n> [   71.629352] Tainted: [E]=UNSIGNED_MODULE\n> [   71.629353] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/LXD, BIOS unknown 2/2/2022\n> [   71.629354] Workqueue: writeback wb_workfn (flush-7:4)\n> [   71.629359] RIP: 0010:ext4_journal_check_start+0x8b/0xd0\n> [   71.629360] Code: 31 ff 45 31 c0 45 31 c9 e9 42 ad c4 00 48 8b 5d f8 b8 fb ff ff ff c9 31 d2 31 c9 31 f6 31 ff 45 31 c0 45 31 c9 c3 cc cc cc cc <0f> 0b b8 e2 ff ff ff eb c2 0f 0b eb\n>  a9 44 8b 42 08 68 c7 53 ce b8\n> [   71.629361] RSP: 0018:ffffcf32c0fdf6a8 EFLAGS: 00010202\n> [   71.629364] RAX: ffff8f08c8505000 RBX: ffff8f08c67ee800 RCX: 0000000000000000\n> [   71.629366] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000\n> [   71.629367] RBP: ffffcf32c0fdf6b0 R08: 0000000000000001 R09: 0000000000000000\n> [   71.629368] R10: ffff8f08db18b3a8 R11: 0000000000000000 R12: 0000000000000000\n> [   71.629368] R13: 0000000000000002 R14: 0000000000000a48 R15: ffff8f08c67ee800\n> [   71.629369] FS:  0000000000000000(0000) GS:ffff8f0a7d273000(0000) knlGS:0000000000000000\n> [   71.629370] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n> [   71.629371] CR2: 00007b66825905cc CR3: 000000011053d004 CR4: 0000000000772ef0\n> [   71.629374] PKRU: 55555554\n> [   71.629374] Call Trace:\n> [   71.629378]  <TASK>\n> [   71.629382]  __ext4_journal_start_sb+0x38/0x1c0\n> [   71.629383]  mpage_prepare_extent_to_map+0x4af/0x580\n> [   71.629389]  ? sbitmap_get+0x73/0x180\n> [   71.629399]  ext4_do_writepages+0x3cc/0x10a0\n> [   71.629400]  ? kvm_sched_clock_read+0x11/0x20\n> [   71.629409]  ext4_writepages+0xc8/0x1b0\n> [   71.629410]  ? ext4_writepages+0xc8/0x1b0\n> [   71.629411]  do_writepages+0xc4/0x180\n> [   71.629416]  __writeback_single_inode+0x45/0x350\n> [   71.629419]  ? _raw_spin_unlock+0xe/0x40\n> [   71.629423]  writeback_sb_inodes+0x260/0x5c0\n> [   71.629425]  ? __schedule+0x4d1/0x1870\n> [   71.629429]  __writeback_inodes_wb+0x54/0x100\n> [   71.629431]  ? queue_io+0x82/0x140\n> [   71.629433]  wb_writeback+0x1ab/0x330\n> [   71.629448]  wb_workfn+0x31d/0x410\n> [   71.629450]  process_one_work+0x191/0x3e0\n> [   71.629455]  worker_thread+0x2e3/0x420\n>\n> [Fix]\n>\n> This upstream commit fixes the issue:\n> https://github.com/torvalds/linux/commit/f4a2b42e78914ff15630e71289adc589c3a8eb45\n>\n> All the discussions are in this thread:\n> https://lore.kernel.org/all/20260128074515.2028982-1-gerald.yang@canonical.com/\n>\n> [Test Plan]\n>\n> This can be easily reproduced by the following script:\n> mkdir -p mnt\n> dd if=/dev/zero of=ext4disk bs=1G count=2 oflag=direct\n> mkfs.ext4 ext4disk\n> tune2fs -o journal_data ext4disk\n> mount ext4disk mnt\n> fio --name=fiotest --rw=randwrite --bs=4k --runtime=3 --ioengine=libaio --iodepth=128 --numjobs=4 --filename=mnt/fiotest --filesize=1G --group_reporting\n> mount -o remount,ro ext4disk mnt\n> sync\n>\n> [Where problems could occur]\n>\n> When the call trace happens, there is no data lost, all the dirty data has been flushed to file system before remounting.\n> The fix is to make sure folio state is correct and update the xarray, so the writeback thread won't be trigger if there is no dirty data.\n> So if there is something really goes wrong, there still won't be data lost, even remount it to read-write mode again.\n>\n> Jan Kara (1):\n>   ext4: fix stale xarray tags after writeback\n>\n>  fs/ext4/page-io.c | 10 ++++++++--\n>  1 file changed, 8 insertions(+), 2 deletions(-)\n>\n> -- \n> 2.43.0\n>\n>\n> -- \n> kernel-team mailing list\n> kernel-team@lists.ubuntu.com\n> https://lists.ubuntu.com/mailman/listinfo/kernel-team","headers":{"Return-Path":"<kernel-team-bounces@lists.ubuntu.com>","X-Original-To":"incoming@patchwork.ozlabs.org","Delivered-To":"patchwork-incoming@legolas.ozlabs.org","Authentication-Results":["legolas.ozlabs.org;\n\tdkim=fail reason=\"signature verification failed\" (4096-bit key;\n unprotected) header.d=canonical.com header.i=@canonical.com\n header.a=rsa-sha256 header.s=20251003 header.b=IORtHp6+;\n\tdkim-atps=neutral","legolas.ozlabs.org;\n spf=pass (sender SPF authorized) smtp.mailfrom=lists.ubuntu.com\n (client-ip=185.125.189.65; helo=lists.ubuntu.com;\n envelope-from=kernel-team-bounces@lists.ubuntu.com;\n receiver=patchwork.ozlabs.org)"],"Received":["from lists.ubuntu.com (lists.ubuntu.com [185.125.189.65])\n\t(using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits))\n\t(No client certificate requested)\n\tby legolas.ozlabs.org (Postfix) with ESMTPS id 4ft2v50GVyz1yGb\n\tfor <incoming@patchwork.ozlabs.org>; Sat, 11 Apr 2026 15:54:57 +1000 (AEST)","from localhost ([127.0.0.1] helo=lists.ubuntu.com)\n\tby lists.ubuntu.com with esmtp (Exim 4.86_2)\n\t(envelope-from <kernel-team-bounces@lists.ubuntu.com>)\n\tid 1wBRIv-0005Xq-4q; Sat, 11 Apr 2026 05:54:49 +0000","from smtp-relay-internal-1.internal ([10.131.114.114]\n helo=smtp-relay-internal-1.canonical.com)\n by lists.ubuntu.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)\n (Exim 4.86_2) (envelope-from <mehmet.basaran@canonical.com>)\n id 1wBRIu-0005Xj-Iz\n for kernel-team@lists.ubuntu.com; Sat, 11 Apr 2026 05:54:48 +0000","from mail-wm1-f72.google.com (mail-wm1-f72.google.com\n [209.85.128.72])\n (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)\n key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest\n SHA256)\n (No client certificate requested)\n by smtp-relay-internal-1.canonical.com (Postfix) with ESMTPS id 7B2A53F16E\n for <kernel-team@lists.ubuntu.com>; Sat, 11 Apr 2026 05:54:48 +0000 (UTC)","by mail-wm1-f72.google.com with SMTP id\n 5b1f17b1804b1-488cc31ea57so16178415e9.3\n for <kernel-team@lists.ubuntu.com>; Fri, 10 Apr 2026 22:54:48 -0700 (PDT)","from localhost ([94.54.18.154]) by smtp.gmail.com with ESMTPSA id\n 5b1f17b1804b1-488d5888c12sm141516505e9.3.2026.04.10.22.54.46\n (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);\n Fri, 10 Apr 2026 22:54:46 -0700 (PDT)"],"DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed; d=canonical.com;\n s=20251003; t=1775886888;\n bh=3CM8t4XkfLLHzFSPVbZLQV6iWoSnZyluOxBZcKbRe5M=;\n h=From:To:Subject:In-Reply-To:References:Date:Message-ID:\n MIME-Version:Content-Type;\n b=IORtHp6+dTE+TfxI2aFKTkbH4ZlmGbzKwb5X4nLhVCqloWE6FGwwdhZyJAdnptjv8\n GsPv/tApntrVxSOJzypaEgXwxaDi8CDgS0FMdT2iL58PIb53JdHcT1DI+aweOjLOIu\n hD0NkLeLubV+/Okk8mxAtVEZRp0aW9ML2c/e1VpDO+aTS/wrONZjB9yMmQ9q4SNjQy\n 2lEG4DigphU8zMcBuN6v1+8NjsycgK+yiOr/S9ThETCCRrLeGBUylBjir79/bnziJ5\n +n6srG8c3+XOgCioPuCBLQ/yZF+DyZTe9ivn3winZfc3/2TjN1Np9dV0nIMUX7de4v\n mGLjh33Z7UC9DWPmjfCh36Zigv92BWnpTczOR1KsaGhbS4gQtF9iIF7/R5T0G2hQQ7\n tHODejsOc/rDc9Oy9GfM4ue4krxxUTVgG58IKlZzXq+HBAUIZXB7Bv/oL8aOxD8I0g\n tEHmLVEs9uCxx0UOvmycLSAU6ICU1sZ7yMJuMc1rPeazVCUiJvh9tmA/TBhSd352Tk\n Lxby/GhmJIvc7ty3E6e1bYNNVH+syQCfnHmRtrcmlg+T4XR06+kL3SJjzHajba16sh\n pEt3zRNtJU3acR8pZyoxBG5mAR2aPxU+icWonc/RnXkaq1qMQdjjA6Wr7HwjH+xphK\n o9P8Qjvto1BB9NvwOVEVGbYY=","X-Google-DKIM-Signature":"v=1; a=rsa-sha256; c=relaxed/relaxed;\n d=1e100.net; s=20251104; t=1775886888; x=1776491688;\n h=mime-version:message-id:date:references:in-reply-to:subject:to:from\n :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id\n :reply-to;\n bh=3CM8t4XkfLLHzFSPVbZLQV6iWoSnZyluOxBZcKbRe5M=;\n b=sdWUeWU6JRLyPyx5WyxgYOBdDwP7vf/LRnZA5R82J4Hku5O87qikQyjx4ctWYq8mON\n 2s8v7UL2HJqmRzOsFarOZvprfaNWMu1BdlKnvJ6/nXB5PMZx8mrhYYP+bHtC0+XQhy/S\n WuASRwpyHiMuD4IZg0OuwaaiV2gy2qm6tCSsAJC7QXj6RhXJZ+x7S+TyzMnHcLJRfjPO\n rM4QLWZZiZThan6gYkgL7885wvSyrH2+eK6ksBCVfHzK/j2ielaSHUbwVkw/uhoY1kbK\n 9BkMriOaE+HyMCIjhENKDLaKxHN0vVIUcvaCy+iTFrxWaPDP4PZOhL6GU8svq2EfZgI4\n QlTg==","X-Forwarded-Encrypted":"i=1;\n AJvYcCVy+vePiC+PXLuPR0QP0NREpP2tARXtZO+qGZagsnlXVHPPbhBot9YBq1sauN9ICbWH/sudlYua/Xnktg==@lists.ubuntu.com","X-Gm-Message-State":"AOJu0YyjCoJlCxghFZQZQm7VW0Kow353f15nX1qFs40ShzqofoMxLCV6\n E5b2Qose3LKjY25OIvQxYY4wWK7wtIZjhah59cTnMnA6bHDHU+3aBAonCRR6WDHw6PcmV1gVLlE\n mSyLIvqfnLzo3XN5/F3LjGTW2gaJKVr9TEwWby+2E6lp3PFcStru9HlF2M986h5WZ8YXibBWC5p\n PPXGry/w==","X-Gm-Gg":"AeBDiesWj38NBIVE67Ac9BZkngbEDZrDqNKZzbuLuaJhGQagYTuIvzqPKAvuD87VwnY\n 6kNaQn7epYuja3I/jFFze0AMi0yrtV/xY4xLxih9osq2938enwBu5PSMjYlZEpcNBUbK8lPYLRh\n 0wGNTHOcKWwAIypxF3caBRhQ6l7FVJIp7llyE9gJ90EGR2o7UlJkRMXbrhjWNet5vZA8zWqPyWr\n YX0jIFJtHexq3iOLB7Ej/awhY2Q/jOpIyygRdbGUOU1KUVyTKRnsisJFO8YK5/b+GN4vDbpbAh0\n h/xLio94NoEcEhZ3GsGvLxFiM7LhsDzlz5s03lQ4zSJgZLygKwSjLNps9zfffGPL61ZgtO45LMh\n EwpID1c738GjwJ7R8r5fCwtn3Ro4o","X-Received":["by 2002:a05:600c:a416:b0:488:7f69:4abf with SMTP id\n 5b1f17b1804b1-488d67f946bmr52541065e9.12.1775886887984;\n Fri, 10 Apr 2026 22:54:47 -0700 (PDT)","by 2002:a05:600c:a416:b0:488:7f69:4abf with SMTP id\n 5b1f17b1804b1-488d67f946bmr52541005e9.12.1775886887535;\n Fri, 10 Apr 2026 22:54:47 -0700 (PDT)"],"From":"Mehmet Basaran <mehmet.basaran@canonical.com>","To":"Gerald Yang <gerald.yang@canonical.com>, kernel-team@lists.ubuntu.com","Subject":"APPLIED: [SRU][N/Q][PATCH 0/1] Remount ext4 to readonly with\n data=journal mode may dump call trace","In-Reply-To":"<20260407092650.1094713-1-gerald.yang@canonical.com>","References":"<20260407092650.1094713-1-gerald.yang@canonical.com>","Date":"Sat, 11 Apr 2026 08:54:45 +0300","Message-ID":"<873412rqhm.fsf@gmail.com>","MIME-Version":"1.0","Content-Type":"multipart/mixed; boundary=\"=-=-=\"","X-BeenThere":"kernel-team@lists.ubuntu.com","X-Mailman-Version":"2.1.20","Precedence":"list","List-Id":"Kernel team discussions <kernel-team.lists.ubuntu.com>","List-Unsubscribe":"<https://lists.ubuntu.com/mailman/options/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=unsubscribe>","List-Archive":"<https://lists.ubuntu.com/archives/kernel-team>","List-Post":"<mailto:kernel-team@lists.ubuntu.com>","List-Help":"<mailto:kernel-team-request@lists.ubuntu.com?subject=help>","List-Subscribe":"<https://lists.ubuntu.com/mailman/listinfo/kernel-team>,\n <mailto:kernel-team-request@lists.ubuntu.com?subject=subscribe>","Errors-To":"kernel-team-bounces@lists.ubuntu.com","Sender":"\"kernel-team\" <kernel-team-bounces@lists.ubuntu.com>"}}]