public inbox for [email protected]
 help / color / mirror / Atom feed
* INFO: task hung in io_ring_exit_work
@ 2021-10-14  2:27 Hao Sun
  2021-10-14 10:00 ` Pavel Begunkov
  0 siblings, 1 reply; 4+ messages in thread
From: Hao Sun @ 2021-10-14  2:27 UTC (permalink / raw)
  To: Pavel Begunkov, Jens Axboe, io-uring; +Cc: Linux Kernel Mailing List

Hello,

When using Healer to fuzz the latest Linux kernel, the following crash
was triggered.

HEAD commit: 64570fbc14f8 Linux 5.15-rc5
git tree: upstream
console output:
https://drive.google.com/file/d/1JeHQP3cxmLK6WDSLxyOrUGLDujuTCXeU/view?usp=sharing
kernel config: https://drive.google.com/file/d/1em3xgUIMNN_-LUUdySzwN-UDPc3qiiKD/view?usp=sharing
Similar report from syzbot:
https://syzkaller.appspot.com/bug?id=db58a4022d476752fca3c46386b33ca799d3a7f0

Sorry, I don't have a reproducer for this crash, hope the symbolized
report can help.
If you fix this issue, please add the following tag to the commit:
Reported-by: Hao Sun <[email protected]>

INFO: task kworker/u10:0:24 blocked for more than 143 seconds.
      Not tainted 5.15.0-rc5 #3
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u10:0   state:D stack:24944 pid:   24 ppid:     2 flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 context_switch kernel/sched/core.c:4940 [inline]
 __schedule+0xcd9/0x2530 kernel/sched/core.c:6287
 schedule+0xd3/0x270 kernel/sched/core.c:6366
 schedule_timeout+0x5e5/0x890 kernel/time/timer.c:1857
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common kernel/sched/completion.c:106 [inline]
 wait_for_common kernel/sched/completion.c:117 [inline]
 wait_for_completion+0x17d/0x280 kernel/sched/completion.c:138
 io_ring_exit_work+0x530/0x1550 fs/io_uring.c:9442
 process_one_work+0x9df/0x16d0 kernel/workqueue.c:2297
 worker_thread+0x90/0xed0 kernel/workqueue.c:2444
 kthread+0x3e5/0x4d0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
INFO: lockdep is turned off.
NMI backtrace for cpu 0
CPU: 0 PID: 39 Comm: khungtaskd Not tainted 5.15.0-rc5 #3
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
1.13.0-1ubuntu1.1 04/01/2014
Call Trace:
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:105
 nmi_trigger_cpumask_backtrace+0x1e1/0x220 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:210 [inline]
 watchdog+0xcc8/0x1010 kernel/hung_task.c:295
 kthread+0x3e5/0x4d0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
Sending NMI from CPU 0 to CPUs 1-3:
NMI backtrace for cpu 1
CPU: 1 PID: 13884 Comm: syz-executor Not tainted 5.15.0-rc5 #3
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
1.13.0-1ubuntu1.1 04/01/2014
RIP: 0010:irqentry_enter+0x28/0x50 kernel/entry/common.c:380
Code: 00 00 f6 87 88 00 00 00 03 75 37 65 48 8b 04 25 40 f0 01 00 f6
40 2c 02 48 8b 3c 24 75 0f e8 1f f4 ff ff eb 00 e8 d8 87 49 f8 <31> c0
c3 e8 10 f4 ff ff e8 cb fc ff ff e8 c6 87 49 f8 b8 01 00 00
RSP: 0018:ffffc90009db7db0 EFLAGS: 00000046
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff888017765580
RDX: 0000000000000000 RSI: ffff888017765580 RDI: 0000000000000002
RBP: ffffc90009db7de8 R08: ffffffff8932db28 R09: 0000000000000000
R10: 0000000000000001 R11: fffffbfff1adb0b2 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000003 R15: 0000000000000000
FS:  00007ff54513e700(0000) GS:ffff888135c00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000003 CR3: 00000000149e3000 CR4: 0000000000350ee0
Call Trace:
 exc_page_fault+0x45/0x180 arch/x86/mm/fault.c:1538
 asm_exc_page_fault+0x1e/0x30 arch/x86/include/asm/idtentry.h:568
RIP: 0010:do_strncpy_from_user lib/strncpy_from_user.c:41 [inline]
RIP: 0010:strncpy_from_user+0x1e6/0x3f0 lib/strncpy_from_user.c:139
Code: 83 eb 08 4d 89 7c 2d 00 bf 07 00 00 00 48 83 c5 08 48 89 de e8
cb 40 7b fd 48 83 fb 07 0f 86 c4 01 00 00 e8 3c 3f 7b fd 31 c0 <4d> 8b
3c 2c 31 ff 89 c6 89 04 24 e8 8a 40 7b fd 8b 04 24 85 c0 0f
RSP: 0018:ffffc90009db7e90 EFLAGS: 00050246
RAX: 0000000000000000 RBX: 0000000000000fe0 RCX: ffff888017765580
RDX: 0000000000000000 RSI: ffff888017765580 RDI: 0000000000000002
RBP: 0000000000000000 R08: ffffffff83fb1f84 R09: 0000000000000007
R10: 0000000000000007 R11: fffff94000862c40 R12: 0000000000000003
R13: ffff88810c589120 R14: 0000000000000fe0 R15: 0000000000000fe3
 getname_flags fs/namei.c:149 [inline]
 getname_flags+0x117/0x5b0 fs/namei.c:128
 getname fs/namei.c:217 [inline]
 __do_sys_rename fs/namei.c:4825 [inline]
 __se_sys_rename fs/namei.c:4823 [inline]
 __x64_sys_rename+0x56/0xa0 fs/namei.c:4823
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x2000028a
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 98 4a 2a e9 2c b8 b6 4c 0f 05 <bf> 00
00 40 00 c4 a3 7b f0 c5 01 41 e2 e9 c4 22 e9 aa bb 3c 00 00
RSP: 002b:00007ff54513dbb8 EFLAGS: 00000203 ORIG_RAX: 0000000000000052
RAX: ffffffffffffffda RBX: 0000000000000009 RCX: 000000002000028a
RDX: 0000000000004c01 RSI: 0000000000000003 RDI: 0000000000400000
RBP: 000000000000008b R08: 0000000000000005 R09: 0000000000000006
R10: 0000000000000007 R11: 0000000000000203 R12: 000000000000000b
R13: 000000000000000c R14: 000000000000000d R15: 00007ff54513ddc0
NMI backtrace for cpu 2 skipped: idling at native_safe_halt
arch/x86/include/asm/irqflags.h:51 [inline]
NMI backtrace for cpu 2 skipped: idling at arch_safe_halt
arch/x86/include/asm/irqflags.h:89 [inline]
NMI backtrace for cpu 2 skipped: idling at default_idle+0xb/0x10
arch/x86/kernel/process.c:716
NMI backtrace for cpu 3
CPU: 3 PID: 3019 Comm: systemd-journal Not tainted 5.15.0-rc5 #3
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
1.13.0-1ubuntu1.1 04/01/2014
RIP: 0033:0x7ffc3d1c69b5
Code: 00 0f 84 b9 00 00 00 4c 63 cf 49 c1 e1 04 4d 01 c1 45 8b 10 41
f6 c2 01 0f 85 8d 00 00 00 41 8b 40 04 83 f8 01 75 6f 0f 01 f9 <66> 90
48 c1 e2 20 48 09 c2 48 85 d2 78 63 49 8b 48 08 49 8b 41 28
RSP: 002b:00007ffc3d110910 EFLAGS: 00000246
RAX: 000000007fa7dd4e RBX: 0000000000000007 RCX: 0000000000001003
RDX: 0000000000000096 RSI: 00007ffc3d110960 RDI: 0000000000000007
RBP: 00007ffc3d110930 R08: 00007ffc3d1c2080 R09: 00007ffc3d1c20f0
R10: 000000000000dd10 R11: 000000000000011d R12: 00007ffc3d1109a0
R13: 0000000000000001 R14: 0000000000000001 R15: 0005ce1974964533
FS:  00007f9157d9a8c0 GS:  0000000000000000
----------------
Code disassembly (best guess):
   0: 00 00                add    %al,(%rax)
   2: f6 87 88 00 00 00 03 testb  $0x3,0x88(%rdi)
   9: 75 37                jne    0x42
   b: 65 48 8b 04 25 40 f0 mov    %gs:0x1f040,%rax
  12: 01 00
  14: f6 40 2c 02          testb  $0x2,0x2c(%rax)
  18: 48 8b 3c 24          mov    (%rsp),%rdi
  1c: 75 0f                jne    0x2d
  1e: e8 1f f4 ff ff        callq  0xfffff442
  23: eb 00                jmp    0x25
  25: e8 d8 87 49 f8        callq  0xf8498802
* 2a: 31 c0                xor    %eax,%eax <-- trapping instruction
  2c: c3                    retq
  2d: e8 10 f4 ff ff        callq  0xfffff442
  32: e8 cb fc ff ff        callq  0xfffffd02
  37: e8 c6 87 49 f8        callq  0xf8498802
  3c: b8                    .byte 0xb8
  3d: 01 00                add    %eax,(%rax)%

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: INFO: task hung in io_ring_exit_work
  2021-10-14  2:27 Hao Sun
@ 2021-10-14 10:00 ` Pavel Begunkov
  0 siblings, 0 replies; 4+ messages in thread
From: Pavel Begunkov @ 2021-10-14 10:00 UTC (permalink / raw)
  To: Hao Sun, Jens Axboe, io-uring; +Cc: Linux Kernel Mailing List

On 10/14/21 03:27, Hao Sun wrote:
> Hello,
> 
> When using Healer to fuzz the latest Linux kernel, the following crash
> was triggered.
> 
> HEAD commit: 64570fbc14f8 Linux 5.15-rc5
> git tree: upstream
> console output:
> https://drive.google.com/file/d/1JeHQP3cxmLK6WDSLxyOrUGLDujuTCXeU/view?usp=sharing
> kernel config: https://drive.google.com/file/d/1em3xgUIMNN_-LUUdySzwN-UDPc3qiiKD/view?usp=sharing
> Similar report from syzbot:
> https://syzkaller.appspot.com/bug?id=db58a4022d476752fca3c46386b33ca799d3a7f0
> 
> Sorry, I don't have a reproducer for this crash, hope the symbolized
> report can help.
> If you fix this issue, please add the following tag to the commit:
> Reported-by: Hao Sun <[email protected]>

That's interesting, tws are not being run again. I'm afraid the
report doesn't help, but hopefully it'll be able to find a repro


> INFO: task kworker/u10:0:24 blocked for more than 143 seconds.
>        Not tainted 5.15.0-rc5 #3
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> task:kworker/u10:0   state:D stack:24944 pid:   24 ppid:     2 flags:0x00004000
> Workqueue: events_unbound io_ring_exit_work
> Call Trace:
>   context_switch kernel/sched/core.c:4940 [inline]
>   __schedule+0xcd9/0x2530 kernel/sched/core.c:6287
>   schedule+0xd3/0x270 kernel/sched/core.c:6366
>   schedule_timeout+0x5e5/0x890 kernel/time/timer.c:1857
>   do_wait_for_common kernel/sched/completion.c:85 [inline]
>   __wait_for_common kernel/sched/completion.c:106 [inline]
>   wait_for_common kernel/sched/completion.c:117 [inline]
>   wait_for_completion+0x17d/0x280 kernel/sched/completion.c:138
>   io_ring_exit_work+0x530/0x1550 fs/io_uring.c:9442
>   process_one_work+0x9df/0x16d0 kernel/workqueue.c:2297
>   worker_thread+0x90/0xed0 kernel/workqueue.c:2444
>   kthread+0x3e5/0x4d0 kernel/kthread.c:319
>   ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
> INFO: lockdep is turned off.
> NMI backtrace for cpu 0
> CPU: 0 PID: 39 Comm: khungtaskd Not tainted 5.15.0-rc5 #3
> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
> 1.13.0-1ubuntu1.1 04/01/2014
> Call Trace:
>   __dump_stack lib/dump_stack.c:88 [inline]
>   dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
>   nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:105
>   nmi_trigger_cpumask_backtrace+0x1e1/0x220 lib/nmi_backtrace.c:62
>   trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
>   check_hung_uninterruptible_tasks kernel/hung_task.c:210 [inline]
>   watchdog+0xcc8/0x1010 kernel/hung_task.c:295
>   kthread+0x3e5/0x4d0 kernel/kthread.c:319
>   ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
> Sending NMI from CPU 0 to CPUs 1-3:
> NMI backtrace for cpu 1
> CPU: 1 PID: 13884 Comm: syz-executor Not tainted 5.15.0-rc5 #3
> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
> 1.13.0-1ubuntu1.1 04/01/2014
> RIP: 0010:irqentry_enter+0x28/0x50 kernel/entry/common.c:380
> Code: 00 00 f6 87 88 00 00 00 03 75 37 65 48 8b 04 25 40 f0 01 00 f6
> 40 2c 02 48 8b 3c 24 75 0f e8 1f f4 ff ff eb 00 e8 d8 87 49 f8 <31> c0
> c3 e8 10 f4 ff ff e8 cb fc ff ff e8 c6 87 49 f8 b8 01 00 00
> RSP: 0018:ffffc90009db7db0 EFLAGS: 00000046
> RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff888017765580
> RDX: 0000000000000000 RSI: ffff888017765580 RDI: 0000000000000002
> RBP: ffffc90009db7de8 R08: ffffffff8932db28 R09: 0000000000000000
> R10: 0000000000000001 R11: fffffbfff1adb0b2 R12: 0000000000000000
> R13: 0000000000000000 R14: 0000000000000003 R15: 0000000000000000
> FS:  00007ff54513e700(0000) GS:ffff888135c00000(0000) knlGS:0000000000000000
> CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> CR2: 0000000000000003 CR3: 00000000149e3000 CR4: 0000000000350ee0
> Call Trace:
>   exc_page_fault+0x45/0x180 arch/x86/mm/fault.c:1538
>   asm_exc_page_fault+0x1e/0x30 arch/x86/include/asm/idtentry.h:568
> RIP: 0010:do_strncpy_from_user lib/strncpy_from_user.c:41 [inline]
> RIP: 0010:strncpy_from_user+0x1e6/0x3f0 lib/strncpy_from_user.c:139
> Code: 83 eb 08 4d 89 7c 2d 00 bf 07 00 00 00 48 83 c5 08 48 89 de e8
> cb 40 7b fd 48 83 fb 07 0f 86 c4 01 00 00 e8 3c 3f 7b fd 31 c0 <4d> 8b
> 3c 2c 31 ff 89 c6 89 04 24 e8 8a 40 7b fd 8b 04 24 85 c0 0f
> RSP: 0018:ffffc90009db7e90 EFLAGS: 00050246
> RAX: 0000000000000000 RBX: 0000000000000fe0 RCX: ffff888017765580
> RDX: 0000000000000000 RSI: ffff888017765580 RDI: 0000000000000002
> RBP: 0000000000000000 R08: ffffffff83fb1f84 R09: 0000000000000007
> R10: 0000000000000007 R11: fffff94000862c40 R12: 0000000000000003
> R13: ffff88810c589120 R14: 0000000000000fe0 R15: 0000000000000fe3
>   getname_flags fs/namei.c:149 [inline]
>   getname_flags+0x117/0x5b0 fs/namei.c:128
>   getname fs/namei.c:217 [inline]
>   __do_sys_rename fs/namei.c:4825 [inline]
>   __se_sys_rename fs/namei.c:4823 [inline]
>   __x64_sys_rename+0x56/0xa0 fs/namei.c:4823
>   do_syscall_x64 arch/x86/entry/common.c:50 [inline]
>   do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
>   entry_SYSCALL_64_after_hwframe+0x44/0xae
> RIP: 0033:0x2000028a
> Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
> 00 00 00 00 00 00 00 00 00 00 00 98 4a 2a e9 2c b8 b6 4c 0f 05 <bf> 00
> 00 40 00 c4 a3 7b f0 c5 01 41 e2 e9 c4 22 e9 aa bb 3c 00 00
> RSP: 002b:00007ff54513dbb8 EFLAGS: 00000203 ORIG_RAX: 0000000000000052
> RAX: ffffffffffffffda RBX: 0000000000000009 RCX: 000000002000028a
> RDX: 0000000000004c01 RSI: 0000000000000003 RDI: 0000000000400000
> RBP: 000000000000008b R08: 0000000000000005 R09: 0000000000000006
> R10: 0000000000000007 R11: 0000000000000203 R12: 000000000000000b
> R13: 000000000000000c R14: 000000000000000d R15: 00007ff54513ddc0
> NMI backtrace for cpu 2 skipped: idling at native_safe_halt
> arch/x86/include/asm/irqflags.h:51 [inline]
> NMI backtrace for cpu 2 skipped: idling at arch_safe_halt
> arch/x86/include/asm/irqflags.h:89 [inline]
> NMI backtrace for cpu 2 skipped: idling at default_idle+0xb/0x10
> arch/x86/kernel/process.c:716
> NMI backtrace for cpu 3
> CPU: 3 PID: 3019 Comm: systemd-journal Not tainted 5.15.0-rc5 #3
> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS
> 1.13.0-1ubuntu1.1 04/01/2014
> RIP: 0033:0x7ffc3d1c69b5
> Code: 00 0f 84 b9 00 00 00 4c 63 cf 49 c1 e1 04 4d 01 c1 45 8b 10 41
> f6 c2 01 0f 85 8d 00 00 00 41 8b 40 04 83 f8 01 75 6f 0f 01 f9 <66> 90
> 48 c1 e2 20 48 09 c2 48 85 d2 78 63 49 8b 48 08 49 8b 41 28
> RSP: 002b:00007ffc3d110910 EFLAGS: 00000246
> RAX: 000000007fa7dd4e RBX: 0000000000000007 RCX: 0000000000001003
> RDX: 0000000000000096 RSI: 00007ffc3d110960 RDI: 0000000000000007
> RBP: 00007ffc3d110930 R08: 00007ffc3d1c2080 R09: 00007ffc3d1c20f0
> R10: 000000000000dd10 R11: 000000000000011d R12: 00007ffc3d1109a0
> R13: 0000000000000001 R14: 0000000000000001 R15: 0005ce1974964533
> FS:  00007f9157d9a8c0 GS:  0000000000000000
> ----------------
> Code disassembly (best guess):
>     0: 00 00                add    %al,(%rax)
>     2: f6 87 88 00 00 00 03 testb  $0x3,0x88(%rdi)
>     9: 75 37                jne    0x42
>     b: 65 48 8b 04 25 40 f0 mov    %gs:0x1f040,%rax
>    12: 01 00
>    14: f6 40 2c 02          testb  $0x2,0x2c(%rax)
>    18: 48 8b 3c 24          mov    (%rsp),%rdi
>    1c: 75 0f                jne    0x2d
>    1e: e8 1f f4 ff ff        callq  0xfffff442
>    23: eb 00                jmp    0x25
>    25: e8 d8 87 49 f8        callq  0xf8498802
> * 2a: 31 c0                xor    %eax,%eax <-- trapping instruction
>    2c: c3                    retq
>    2d: e8 10 f4 ff ff        callq  0xfffff442
>    32: e8 cb fc ff ff        callq  0xfffffd02
>    37: e8 c6 87 49 f8        callq  0xf8498802
>    3c: b8                    .byte 0xb8
>    3d: 01 00                add    %eax,(%rax)%
> 

-- 
Pavel Begunkov

^ permalink raw reply	[flat|nested] 4+ messages in thread

* INFO: task hung in io_ring_exit_work
@ 2023-02-27  6:23 Sanan Hasanov
  2023-03-01 14:53 ` Jens Axboe
  0 siblings, 1 reply; 4+ messages in thread
From: Sanan Hasanov @ 2023-02-27  6:23 UTC (permalink / raw)
  To: [email protected], [email protected], [email protected],
	[email protected]
  Cc: [email protected], [email protected]

Good day, dear maintainers,

We found a bug using a modified kernel configuration file used by syzbot.

We enhanced the coverage of the configuration file using our tool, klocalizer.

Kernel Branch: 6.2.0-next-20230225
Kernel config: https://drive.google.com/file/d/1NS9N8rvftQ7BouImn2OVnC96qrNhAeuO/view?usp=share_link
C Reproducer: Unfortunately, there is no reproducer for this bug yet.

Thank you!

Best regards,
Sanan Hasanov

INFO: task kworker/u16:20:839 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:20  state:D stack:25504 pid:839   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:24:842 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:24  state:D stack:25472 pid:842   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:27:845 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:27  state:D stack:25120 pid:845   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:57:870 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:57  state:D stack:25120 pid:870   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:58:871 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:58  state:D stack:24624 pid:871   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:60:874 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:60  state:D stack:24784 pid:874   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:62:875 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:62  state:D stack:24864 pid:875   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:63:876 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:63  state:D stack:24272 pid:876   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:64:877 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:64  state:D stack:25008 pid:877   ppid:2      flags:0x00004000
Workqueue: events_unbound io_ring_exit_work
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 schedule_timeout+0x26e/0x2b0 kernel/time/timer.c:2143
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common+0x1ce/0x5d0 kernel/sched/completion.c:106
 io_ring_exit_work+0x543/0x13c0 io_uring/io_uring.c:3027
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
INFO: task kworker/u16:0:28836 blocked for more than 143 seconds.
      Not tainted 6.2.0-next-20230225 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/u16:0   state:D stack:25472 pid:28836 ppid:2      flags:0x00004000
Workqueue: loop2 loop_rootcg_workfn
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5304 [inline]
 __schedule+0x24bc/0x5a60 kernel/sched/core.c:6622
 schedule+0xe7/0x1b0 kernel/sched/core.c:6698
 io_schedule+0xbe/0x130 kernel/sched/core.c:8884
 folio_wait_bit_common+0x390/0x9b0 mm/filemap.c:1301
 __folio_lock mm/filemap.c:1664 [inline]
 folio_lock include/linux/pagemap.h:952 [inline]
 folio_lock include/linux/pagemap.h:948 [inline]
 __filemap_get_folio+0xb13/0xd20 mm/filemap.c:1936
 shmem_get_folio_gfp+0x41e/0x1960 mm/shmem.c:1880
 shmem_get_folio mm/shmem.c:2071 [inline]
 shmem_file_read_iter+0x569/0xa50 mm/shmem.c:2748
 call_read_iter include/linux/fs.h:1845 [inline]
 do_iter_readv_writev+0x2df/0x3b0 fs/read_write.c:733
 do_iter_read+0x2f2/0x750 fs/read_write.c:796
 vfs_iter_read+0x74/0xa0 fs/read_write.c:838
 lo_read_simple drivers/block/loop.c:290 [inline]
 do_req_filebacked drivers/block/loop.c:500 [inline]
 loop_handle_cmd drivers/block/loop.c:1879 [inline]
 loop_process_work+0x15a8/0x2130 drivers/block/loop.c:1914
 process_one_work+0x9ba/0x1820 kernel/workqueue.c:2390
 worker_thread+0x669/0x1090 kernel/workqueue.c:2537
 kthread+0x2e8/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings

Showing all locks held in the system:
1 lock held by rcu_tasks_kthre/12:
 #0: ffffffff8bf915f0 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x2e/0xd90 kernel/rcu/tasks.h:510
1 lock held by rcu_tasks_trace/13:
 #0: ffffffff8bf912f0 (rcu_tasks_trace.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x2e/0xd90 kernel/rcu/tasks.h:510
1 lock held by khungtaskd/59:
 #0: ffffffff8bf92140 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x55/0x340 kernel/locking/lockdep.c:6495
1 lock held by in:imklog/7366:
 #0: ffff88811488a168 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xe7/0x100 fs/file.c:1046
1 lock held by syz-fuzzer/7263:
2 locks held by kworker/u16:20/839:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90007487da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:24/842:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc900074b7da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:27/845:
 #0: 
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc900074e7da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:57/870:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc900076bfda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:58/871:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc900076cfda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:60/874:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc9000775fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:62/875:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc9000776fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:63/876:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc9000777fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:64/877:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc9000781fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:0/28836:
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff8880458e9938 ((wq_completion)loop2){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90009aa7da8 ((work_completion)(&lo->rootcg_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by syz-executor.2/6115:
 #0: ffff8881128c00e0 (&type->s_umount_key#73/1){+.+.}-{3:3}, at: alloc_super+0x22e/0xb60 fs/super.c:228
 #1: ffff8881128b5090 (&nilfs->ns_sem){++++}-{3:3}, at: init_nilfs+0x7d/0x1300 fs/nilfs2/the_nilfs.c:630
2 locks held by kworker/u16:1/6137:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a0fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:2/6138:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003887da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:3/6139:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a2fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:4/6140:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003677da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:5/6141:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003847da8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:6/6142:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a3fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:7/6143:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a4fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:8/6144:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a5fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:9/6145:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a6fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:10/6146:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a7fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365
2 locks held by kworker/u16:11/6147:
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: arch_atomic_long_set include/linux/atomic/atomic-long.h:41 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: atomic_long_set include/linux/atomic/atomic-instrumented.h:1280 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:639 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:666 [inline]
 #0: ffff888100081138 ((wq_completion)events_unbound){+.+.}-{0:0}, at: process_one_work+0x868/0x1820 kernel/workqueue.c:2361
 #1: ffffc90003a8fda8 ((work_completion)(&ctx->exit_work)){+.+.}-{0:0}, at: process_one_work+0x89c/0x1820 kernel/workqueue.c:2365

=============================================

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: INFO: task hung in io_ring_exit_work
  2023-02-27  6:23 INFO: task hung in io_ring_exit_work Sanan Hasanov
@ 2023-03-01 14:53 ` Jens Axboe
  0 siblings, 0 replies; 4+ messages in thread
From: Jens Axboe @ 2023-03-01 14:53 UTC (permalink / raw)
  To: Sanan Hasanov, [email protected], [email protected],
	[email protected]
  Cc: [email protected], [email protected]

On 2/26/23 11:23 PM, Sanan Hasanov wrote:
> Good day, dear maintainers,
> 
> We found a bug using a modified kernel configuration file used by syzbot.
> 
> We enhanced the coverage of the configuration file using our tool, klocalizer.
> 
> Kernel Branch: 6.2.0-next-20230225
> Kernel config: https://drive.google.com/file/d/1NS9N8rvftQ7BouImn2OVnC96qrNhAeuO/view?usp=share_link
> C Reproducer: Unfortunately, there is no reproducer for this bug yet.

Not sure what we're supposed to do with this, without a syzbot or
c reproducer? You can get into this condition if you SIGSTOP the
task so it can't complete its task_work, for example. But impossible
to glean anything from this report.

-- 
Jens Axboe



^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2023-03-01 14:54 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-02-27  6:23 INFO: task hung in io_ring_exit_work Sanan Hasanov
2023-03-01 14:53 ` Jens Axboe
  -- strict thread matches above, loose matches on Subject: below --
2021-10-14  2:27 Hao Sun
2021-10-14 10:00 ` Pavel Begunkov

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox