public inbox for [email protected]
 help / color / mirror / Atom feed
From: syzbot <[email protected]>
To: [email protected], [email protected],
	[email protected],  [email protected],
	[email protected]
Subject: Re: [syzbot] [io-uring?] kernel BUG in put_page
Date: Wed, 03 Apr 2024 12:06:04 -0700	[thread overview]
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>

Hello,

syzbot tried to test the proposed patch but the build/boot failed:

rd
[    8.809543][    T1] usbcore: registered new interface driver dln2
[    8.811777][    T1] usbcore: registered new interface driver pn533_usb
[    8.818634][    T1] nfcsim 0.2 initialized
[    8.819601][    T1] usbcore: registered new interface driver port100
[    8.821888][    T1] usbcore: registered new interface driver nfcmrvl
[    8.828017][    T1] Loading iSCSI transport class v2.0-870.
[    8.847616][    T1] virtio_scsi virtio0: 1/0/0 default/read/poll queues
[    8.857238][    T1] ------------[ cut here ]------------
[    8.858042][    T1] refcount_t: decrement hit 0; leaking memory.
[    8.859263][    T1] WARNING: CPU: 1 PID: 1 at lib/refcount.c:31 refcount_warn_saturate+0xfa/0x1d0
[    8.863740][    T1] Modules linked in:
[    8.864831][    T1] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 6.9.0-rc2-syzkaller-00062-g25d658afbb9f #0
[    8.867287][    T1] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
[    8.868833][    T1] RIP: 0010:refcount_warn_saturate+0xfa/0x1d0
[    8.869927][    T1] Code: b2 00 00 00 e8 67 f3 e9 fc 5b 5d c3 cc cc cc cc e8 5b f3 e9 fc c6 05 73 24 e8 0a 01 90 48 c7 c7 40 34 1f 8c e8 67 8e ac fc 90 <0f> 0b 90 90 eb d9 e8 3b f3 e9 fc c6 05 50 24 e8 0a 01 90 48 c7 c7
[    8.874169][    T1] RSP: 0000:ffffc90000066e18 EFLAGS: 00010246
[    8.875227][    T1] RAX: 2c4d17207a88ac00 RBX: ffff8881446fa13c RCX: ffff8880166d0000
[    8.876287][    T1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[    8.877447][    T1] RBP: 0000000000000004 R08: ffffffff8157ffc2 R09: fffffbfff1c39af8
[    8.878641][    T1] R10: dffffc0000000000 R11: fffffbfff1c39af8 R12: ffffea000504edc0
[    8.879942][    T1] R13: ffffea000504edc8 R14: 1ffffd4000a09db9 R15: 0000000000000000
[    8.881594][    T1] FS:  0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000
[    8.883506][    T1] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    8.884669][    T1] CR2: 0000000000000000 CR3: 000000000e134000 CR4: 00000000003506f0
[    8.885932][    T1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    8.887158][    T1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[    8.888416][    T1] Call Trace:
[    8.888893][    T1]  <TASK>
[    8.889405][    T1]  ? __warn+0x163/0x4e0
[    8.890173][    T1]  ? refcount_warn_saturate+0xfa/0x1d0
[    8.891099][    T1]  ? report_bug+0x2b3/0x500
[    8.891833][    T1]  ? refcount_warn_saturate+0xfa/0x1d0
[    8.892704][    T1]  ? handle_bug+0x3e/0x70
[    8.893508][    T1]  ? exc_invalid_op+0x1a/0x50
[    8.894358][    T1]  ? asm_exc_invalid_op+0x1a/0x20
[    8.895351][    T1]  ? __warn_printk+0x292/0x360
[    8.896090][    T1]  ? refcount_warn_saturate+0xfa/0x1d0
[    8.896832][    T1]  ? refcount_warn_saturate+0xf9/0x1d0
[    8.897742][    T1]  __free_pages_ok+0xc60/0xd90
[    8.898411][    T1]  make_alloc_exact+0xa3/0xf0
[    8.899052][    T1]  vring_alloc_queue_split+0x20a/0x600
[    8.900061][    T1]  ? __pfx_vring_alloc_queue_split+0x10/0x10
[    8.901034][    T1]  ? vp_find_vqs+0x4c/0x4e0
[    8.901695][    T1]  ? virtscsi_probe+0x3ea/0xf60
[    8.902445][    T1]  ? virtio_dev_probe+0x991/0xaf0
[    8.903285][    T1]  ? really_probe+0x2b8/0xad0
[    8.904128][    T1]  ? driver_probe_device+0x50/0x430
[    8.904872][    T1]  vring_create_virtqueue_split+0xc6/0x310
[    8.905969][    T1]  ? ret_from_fork+0x4b/0x80
[    8.906739][    T1]  ? __pfx_vring_create_virtqueue_split+0x10/0x10
[    8.907802][    T1]  vring_create_virtqueue+0xca/0x110
[    8.908537][    T1]  ? __pfx_vp_notify+0x10/0x10
[    8.909350][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.910582][    T1]  setup_vq+0xe9/0x2d0
[    8.911201][    T1]  ? __pfx_vp_notify+0x10/0x10
[    8.911948][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.913087][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.914107][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.915020][    T1]  vp_setup_vq+0xbf/0x330
[    8.915969][    T1]  ? __pfx_vp_config_changed+0x10/0x10
[    8.917767][    T1]  ? ioread16+0x2f/0x90
[    8.918376][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.919158][    T1]  vp_find_vqs_msix+0x8b2/0xc80
[    8.920114][    T1]  vp_find_vqs+0x4c/0x4e0
[    8.920765][    T1]  virtscsi_init+0x8db/0xd00
[    8.921424][    T1]  ? __pfx_virtscsi_init+0x10/0x10
[    8.922125][    T1]  ? __pfx_default_calc_sets+0x10/0x10
[    8.923108][    T1]  ? scsi_host_alloc+0xa57/0xea0
[    8.923930][    T1]  ? vp_get+0xfd/0x140
[    8.924553][    T1]  virtscsi_probe+0x3ea/0xf60
[    8.925375][    T1]  ? __pfx_virtscsi_probe+0x10/0x10
[    8.926277][    T1]  ? kernfs_add_one+0x156/0x8b0
[    8.926980][    T1]  ? virtio_no_restricted_mem_acc+0x9/0x10
[    8.927786][    T1]  ? virtio_features_ok+0x10c/0x270
[    8.928528][    T1]  virtio_dev_probe+0x991/0xaf0
[    8.929356][    T1]  ? __pfx_virtio_dev_probe+0x10/0x10
[    8.930386][    T1]  really_probe+0x2b8/0xad0
[    8.931050][    T1]  __driver_probe_device+0x1a2/0x390
[    8.931934][    T1]  driver_probe_device+0x50/0x430
[    8.932722][    T1]  __driver_attach+0x45f/0x710
[    8.933792][    T1]  ? __pfx___driver_attach+0x10/0x10
[    8.934513][    T1]  bus_for_each_dev+0x239/0x2b0
[    8.935198][    T1]  ? __pfx___driver_attach+0x10/0x10
[    8.935920][    T1]  ? __pfx_bus_for_each_dev+0x10/0x10
[    8.936707][    T1]  ? do_raw_spin_unlock+0x13c/0x8b0
[    8.937589][    T1]  bus_add_driver+0x347/0x620
[    8.938335][    T1]  driver_register+0x23a/0x320
[    8.939169][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    8.940184][    T1]  virtio_scsi_init+0x65/0xe0
[    8.940980][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    8.941836][    T1]  do_one_initcall+0x248/0x880
[    8.942709][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    8.943764][    T1]  ? __pfx_lockdep_hardirqs_on_prepare+0x10/0x10
[    8.944826][    T1]  ? __pfx_do_one_initcall+0x10/0x10
[    8.945830][    T1]  ? __pfx_parse_args+0x10/0x10
[    8.946758][    T1]  ? do_initcalls+0x1c/0x80
[    8.947503][    T1]  ? rcu_is_watching+0x15/0xb0
[    8.948308][    T1]  do_initcall_level+0x157/0x210
[    8.949064][    T1]  do_initcalls+0x3f/0x80
[    8.949957][    T1]  kernel_init_freeable+0x435/0x5d0
[    8.950799][    T1]  ? __pfx_kernel_init_freeable+0x10/0x10
[    8.951875][    T1]  ? __pfx_lockdep_hardirqs_on_prepare+0x10/0x10
[    8.952863][    T1]  ? __pfx_kernel_init+0x10/0x10
[    8.953577][    T1]  ? __pfx_kernel_init+0x10/0x10
[    8.954289][    T1]  ? __pfx_kernel_init+0x10/0x10
[    8.954998][    T1]  kernel_init+0x1d/0x2b0
[    8.955683][    T1]  ret_from_fork+0x4b/0x80
[    8.956316][    T1]  ? __pfx_kernel_init+0x10/0x10
[    8.957112][    T1]  ret_from_fork_asm+0x1a/0x30
[    8.957936][    T1]  </TASK>
[    8.958420][    T1] Kernel panic - not syncing: kernel: panic_on_warn set ...
[    8.959664][    T1] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 6.9.0-rc2-syzkaller-00062-g25d658afbb9f #0
[    8.959938][    T1] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
[    8.959938][    T1] Call Trace:
[    8.959938][    T1]  <TASK>
[    8.959938][    T1]  dump_stack_lvl+0x241/0x360
[    8.959938][    T1]  ? __pfx_dump_stack_lvl+0x10/0x10
[    8.959938][    T1]  ? __pfx__printk+0x10/0x10
[    8.959938][    T1]  ? _printk+0xd5/0x120
[    8.959938][    T1]  ? vscnprintf+0x5d/0x90
[    8.959938][    T1]  panic+0x349/0x860
[    8.959938][    T1]  ? __warn+0x172/0x4e0
[    8.959938][    T1]  ? __pfx_panic+0x10/0x10
[    8.959938][    T1]  ? show_trace_log_lvl+0x4e6/0x520
[    8.970055][    T1]  ? ret_from_fork_asm+0x1a/0x30
[    8.970055][    T1]  __warn+0x346/0x4e0
[    8.970055][    T1]  ? refcount_warn_saturate+0xfa/0x1d0
[    8.970055][    T1]  report_bug+0x2b3/0x500
[    8.970055][    T1]  ? refcount_warn_saturate+0xfa/0x1d0
[    8.970055][    T1]  handle_bug+0x3e/0x70
[    8.970055][    T1]  exc_invalid_op+0x1a/0x50
[    8.970055][    T1]  asm_exc_invalid_op+0x1a/0x20
[    8.970055][    T1] RIP: 0010:refcount_warn_saturate+0xfa/0x1d0
[    8.970055][    T1] Code: b2 00 00 00 e8 67 f3 e9 fc 5b 5d c3 cc cc cc cc e8 5b f3 e9 fc c6 05 73 24 e8 0a 01 90 48 c7 c7 40 34 1f 8c e8 67 8e ac fc 90 <0f> 0b 90 90 eb d9 e8 3b f3 e9 fc c6 05 50 24 e8 0a 01 90 48 c7 c7
[    8.979931][    T1] RSP: 0000:ffffc90000066e18 EFLAGS: 00010246
[    8.979931][    T1] RAX: 2c4d17207a88ac00 RBX: ffff8881446fa13c RCX: ffff8880166d0000
[    8.979931][    T1] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[    8.979931][    T1] RBP: 0000000000000004 R08: ffffffff8157ffc2 R09: fffffbfff1c39af8
[    8.979931][    T1] R10: dffffc0000000000 R11: fffffbfff1c39af8 R12: ffffea000504edc0
[    8.979931][    T1] R13: ffffea000504edc8 R14: 1ffffd4000a09db9 R15: 0000000000000000
[    8.979931][    T1]  ? __warn_printk+0x292/0x360
[    8.990056][    T1]  ? refcount_warn_saturate+0xf9/0x1d0
[    8.990056][    T1]  __free_pages_ok+0xc60/0xd90
[    8.990056][    T1]  make_alloc_exact+0xa3/0xf0
[    8.990056][    T1]  vring_alloc_queue_split+0x20a/0x600
[    8.990056][    T1]  ? __pfx_vring_alloc_queue_split+0x10/0x10
[    8.990056][    T1]  ? vp_find_vqs+0x4c/0x4e0
[    8.990056][    T1]  ? virtscsi_probe+0x3ea/0xf60
[    8.990056][    T1]  ? virtio_dev_probe+0x991/0xaf0
[    8.990056][    T1]  ? really_probe+0x2b8/0xad0
[    8.990056][    T1]  ? driver_probe_device+0x50/0x430
[    8.990056][    T1]  vring_create_virtqueue_split+0xc6/0x310
[    8.990056][    T1]  ? ret_from_fork+0x4b/0x80
[    8.999988][    T1]  ? __pfx_vring_create_virtqueue_split+0x10/0x10
[    8.999988][    T1]  vring_create_virtqueue+0xca/0x110
[    8.999988][    T1]  ? __pfx_vp_notify+0x10/0x10
[    8.999988][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.999988][    T1]  setup_vq+0xe9/0x2d0
[    8.999988][    T1]  ? __pfx_vp_notify+0x10/0x10
[    8.999988][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.999988][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.999988][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    8.999988][    T1]  vp_setup_vq+0xbf/0x330
[    8.999988][    T1]  ? __pfx_vp_config_changed+0x10/0x10
[    8.999988][    T1]  ? ioread16+0x2f/0x90
[    8.999988][    T1]  ? __pfx_virtscsi_ctrl_done+0x10/0x10
[    9.010034][    T1]  vp_find_vqs_msix+0x8b2/0xc80
[    9.010034][    T1]  vp_find_vqs+0x4c/0x4e0
[    9.010034][    T1]  virtscsi_init+0x8db/0xd00
[    9.010034][    T1]  ? __pfx_virtscsi_init+0x10/0x10
[    9.010034][    T1]  ? __pfx_default_calc_sets+0x10/0x10
[    9.010034][    T1]  ? scsi_host_alloc+0xa57/0xea0
[    9.010034][    T1]  ? vp_get+0xfd/0x140
[    9.010034][    T1]  virtscsi_probe+0x3ea/0xf60
[    9.010034][    T1]  ? __pfx_virtscsi_probe+0x10/0x10
[    9.010034][    T1]  ? kernfs_add_one+0x156/0x8b0
[    9.010034][    T1]  ? virtio_no_restricted_mem_acc+0x9/0x10
[    9.010034][    T1]  ? virtio_features_ok+0x10c/0x270
[    9.019933][    T1]  virtio_dev_probe+0x991/0xaf0
[    9.019933][    T1]  ? __pfx_virtio_dev_probe+0x10/0x10
[    9.019933][    T1]  really_probe+0x2b8/0xad0
[    9.019933][    T1]  __driver_probe_device+0x1a2/0x390
[    9.019933][    T1]  driver_probe_device+0x50/0x430
[    9.019933][    T1]  __driver_attach+0x45f/0x710
[    9.019933][    T1]  ? __pfx___driver_attach+0x10/0x10
[    9.019933][    T1]  bus_for_each_dev+0x239/0x2b0
[    9.019933][    T1]  ? __pfx___driver_attach+0x10/0x10
[    9.019933][    T1]  ? __pfx_bus_for_each_dev+0x10/0x10
[    9.019933][    T1]  ? do_raw_spin_unlock+0x13c/0x8b0
[    9.019933][    T1]  bus_add_driver+0x347/0x620
[    9.030102][    T1]  driver_register+0x23a/0x320
[    9.030102][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    9.030102][    T1]  virtio_scsi_init+0x65/0xe0
[    9.030102][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    9.030102][    T1]  do_one_initcall+0x248/0x880
[    9.030102][    T1]  ? __pfx_virtio_scsi_init+0x10/0x10
[    9.030102][    T1]  ? __pfx_lockdep_hardirqs_on_prepare+0x10/0x10
[    9.030102][    T1]  ? __pfx_do_one_initcall+0x10/0x10
[    9.030102][    T1]  ? __pfx_parse_args+0x10/0x10
[    9.039922][    T1]  ? do_initcalls+0x1c/0x80
[    9.039922][    T1]  ? rcu_is_watching+0x15/0xb0
[    9.039922][    T1]  do_initcall_level+0x157/0x210
[    9.039922][    T1]  do_initcalls+0x3f/0x80
[    9.039922][    T1]  kernel_init_freeable+0x435/0x5d0
[    9.039922][    T1]  ? __pfx_kernel_init_freeable+0x10/0x10
[    9.039922][    T1]  ? __pfx_lockdep_hardirqs_on_prepare+0x10/0x10
[    9.039922][    T1]  ? __pfx_kernel_init+0x10/0x10
[    9.039922][    T1]  ? __pfx_kernel_init+0x10/0x10
[    9.039922][    T1]  ? __pfx_kernel_init+0x10/0x10
[    9.039922][    T1]  kernel_init+0x1d/0x2b0
[    9.050013][    T1]  ret_from_fork+0x4b/0x80
[    9.050013][    T1]  ? __pfx_kernel_init+0x10/0x10
[    9.050013][    T1]  ret_from_fork_asm+0x1a/0x30
[    9.050013][    T1]  </TASK>
[    9.050013][    T1] Kernel Offset: disabled
[    9.050013][    T1] Rebooting in 86400 seconds..


syzkaller build log:
go env (err=<nil>)
GO111MODULE='auto'
GOARCH='amd64'
GOBIN=''
GOCACHE='/syzkaller/.cache/go-build'
GOENV='/syzkaller/.config/go/env'
GOEXE=''
GOEXPERIMENT=''
GOFLAGS=''
GOHOSTARCH='amd64'
GOHOSTOS='linux'
GOINSECURE=''
GOMODCACHE='/syzkaller/jobs-2/linux/gopath/pkg/mod'
GONOPROXY=''
GONOSUMDB=''
GOOS='linux'
GOPATH='/syzkaller/jobs-2/linux/gopath'
GOPRIVATE=''
GOPROXY='https://proxy.golang.org,direct'
GOROOT='/usr/local/go'
GOSUMDB='sum.golang.org'
GOTMPDIR=''
GOTOOLCHAIN='auto'
GOTOOLDIR='/usr/local/go/pkg/tool/linux_amd64'
GOVCS=''
GOVERSION='go1.21.4'
GCCGO='gccgo'
GOAMD64='v1'
AR='ar'
CC='gcc'
CXX='g++'
CGO_ENABLED='1'
GOMOD='/syzkaller/jobs-2/linux/gopath/src/github.com/google/syzkaller/go.mod'
GOWORK=''
CGO_CFLAGS='-O2 -g'
CGO_CPPFLAGS=''
CGO_CXXFLAGS='-O2 -g'
CGO_FFLAGS='-O2 -g'
CGO_LDFLAGS='-O2 -g'
PKG_CONFIG='pkg-config'
GOGCCFLAGS='-fPIC -m64 -pthread -Wl,--no-gc-sections -fmessage-length=0 -ffile-prefix-map=/tmp/go-build2770999391=/tmp/go-build -gno-record-gcc-switches'

git status (err=<nil>)
HEAD detached at 6baf50694
nothing to commit, working tree clean


tput: No value for $TERM and no -T specified
tput: No value for $TERM and no -T specified
Makefile:31: run command via tools/syz-env for best compatibility, see:
Makefile:32: https://github.com/google/syzkaller/blob/master/docs/contributing.md#using-syz-env
go list -f '{{.Stale}}' ./sys/syz-sysgen | grep -q false || go install ./sys/syz-sysgen
make .descriptions
tput: No value for $TERM and no -T specified
tput: No value for $TERM and no -T specified
Makefile:31: run command via tools/syz-env for best compatibility, see:
Makefile:32: https://github.com/google/syzkaller/blob/master/docs/contributing.md#using-syz-env
bin/syz-sysgen
touch .descriptions
GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=6baf506947ba27ed9ce775cf9351cb0886166083 -X 'github.com/google/syzkaller/prog.gitRevisionDate=20240329-215124'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-fuzzer github.com/google/syzkaller/syz-fuzzer
GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=6baf506947ba27ed9ce775cf9351cb0886166083 -X 'github.com/google/syzkaller/prog.gitRevisionDate=20240329-215124'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-execprog github.com/google/syzkaller/tools/syz-execprog
GOOS=linux GOARCH=amd64 go build "-ldflags=-s -w -X github.com/google/syzkaller/prog.GitRevision=6baf506947ba27ed9ce775cf9351cb0886166083 -X 'github.com/google/syzkaller/prog.gitRevisionDate=20240329-215124'" "-tags=syz_target syz_os_linux syz_arch_amd64 " -o ./bin/linux_amd64/syz-stress github.com/google/syzkaller/tools/syz-stress
mkdir -p ./bin/linux_amd64
gcc -o ./bin/linux_amd64/syz-executor executor/executor.cc \
	-m64 -O2 -pthread -Wall -Werror -Wparentheses -Wunused-const-variable -Wframe-larger-than=16384 -Wno-stringop-overflow -Wno-array-bounds -Wno-format-overflow -Wno-unused-but-set-variable -Wno-unused-command-line-argument -static-pie -fpermissive -w -DGOOS_linux=1 -DGOARCH_amd64=1 \
	-DHOSTGOOS_linux=1 -DGIT_REVISION=\"6baf506947ba27ed9ce775cf9351cb0886166083\"


Error text is too large and was truncated, full error text is at:
https://syzkaller.appspot.com/x/error.txt?x=148f06ad180000


Tested on:

commit:         25d658af io_uring/kbuf: remove dead define
git tree:       git://git.kernel.dk/linux.git for-6.10/io_uring
kernel config:  https://syzkaller.appspot.com/x/.config?x=51cdcd4a8f332569
dashboard link: https://syzkaller.appspot.com/bug?extid=324f30025b9b5d66fab9
compiler:       Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40

Note: no patches were applied.

      reply	other threads:[~2024-04-03 19:06 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-04-02  8:47 [syzbot] [io-uring?] kernel BUG in put_page syzbot
2024-04-02 18:51 ` Pavel Begunkov
2024-04-02 18:55   ` Jens Axboe
2024-04-02 19:36   ` Jens Axboe
2024-04-03 19:06     ` syzbot [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox