public inbox for io-uring@vger.kernel.org
 help / color / mirror / Atom feed
From: Ming Lei <ming.lei@redhat.com>
To: Pavel Begunkov <asml.silence@gmail.com>
Cc: io-uring@vger.kernel.org, axboe@kernel.dk,
	 Martin KaFai Lau <martin.lau@linux.dev>,
	bpf@vger.kernel.org,
	 Alexei Starovoitov <alexei.starovoitov@gmail.com>,
	Andrii Nakryiko <andrii@kernel.org>
Subject: Re: [PATCH v3 10/10] selftests/io_uring: add bpf io_uring selftests
Date: Sat, 22 Nov 2025 08:19:02 +0800	[thread overview]
Message-ID: <CAFj5m9KfmOvSQoj0rin+2gk34OqD-Bb0qqbXowyqwj16oFAseg@mail.gmail.com> (raw)
In-Reply-To: <1994a586-233a-44cd-813d-b95137c037f0@gmail.com>

On Sat, Nov 22, 2025 at 12:12 AM Pavel Begunkov <asml.silence@gmail.com> wrote:
>
> On 11/20/25 01:41, Ming Lei wrote:
> > On Wed, Nov 19, 2025 at 07:00:41PM +0000, Pavel Begunkov wrote:
> >> On 11/14/25 13:08, Ming Lei wrote:
> >>> On Thu, Nov 13, 2025 at 11:59:47AM +0000, Pavel Begunkov wrote:
> >> ...
> >>>> +  bpf_printk("queue nop request, data %lu\n", (unsigned long)reqs_to_run);
> >>>> +  sqe = &sqes[sq_hdr->tail & (SQ_ENTRIES - 1)];
> >>>> +  sqe->user_data = reqs_to_run;
> >>>> +  sq_hdr->tail++;
> >>>
> >>> Looks this way turns io_uring_enter() into pthread-unsafe, does it need to
> >>> be documented?
> >>
> >> Assuming you mean parallel io_uring_enter() calls modifying the SQ,
> >> it's not different from how it currently is. If you're sharing an
> >> io_uring, threads need to sync the use of SQ/CQ.
> >
> > Please see the example:
> >
> > thread_fn(struct io_uring *ring)
> > {
> >       while (true) {
> >               pthread_mutex_lock(sqe_mutex);
> >               sqe = io_uring_get_sqe(ring);
> >               io_uring_prep_op(sqe);
> >               pthread_mutex_unlock(sqe_mutex);
> >
> >               io_uring_enter(ring);
> >
> >               pthread_mutex_lock(cqe_mutex);
> >               io_uring_wait_cqe(ring, &cqe);
> >               io_uring_cqe_seen(ring, cqe);
> >               pthread_mutex_unlock(cqe_mutex);
> >       }
> > }
> >
> > `thread_fn` is supposed to work concurrently from >1 pthreads:
> >
> > 1) io_uring_enter() is claimed as pthread safe
> >
> > 2) because of userspace lock protection, there is single code path for
> > producing sqe for SQ at same time, and single code path for consuming sqe
> > from io_uring_enter().
> >
> > With bpf controlled io_uring patches, sqe can be produced from io_uring_enter(),
> > and cqe can be consumed in io_uring_enter() too, there will be race between
> > bpf prog(producing sqe, or consuming cqe) and userspace lock-protected
> > code block.
>
> BPF is attached by the same process/user that creates io_uring. The
> guarantees are same as before, the user code (which includes BPF)
> should protect from concurrent mutations.
>
> In this example, just extend the first critical section to
> io_uring_enter(). Concurrent io_uring_enter() will be serialised
> by a mutex anyway. But let me note, that sharing rings is not
> a great pattern in either case.

If io_uring_enter() needs to be serialised, it becomes pthread-unsafe,
that is why I mentioned this should be documented, because it is one
very big difference introduced in bpf controlled ring.

Thanks,


  reply	other threads:[~2025-11-22  0:19 UTC|newest]

Thread overview: 22+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-11-13 11:59 [PATCH v3 00/10] BPF controlled io_uring Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 01/10] io_uring: rename the wait queue entry field Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 02/10] io_uring: simplify io_cqring_wait_schedule results Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 03/10] io_uring: export __io_run_local_work Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 04/10] io_uring: extract waiting parameters into a struct Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 05/10] io_uring/bpf: add stubs for bpf struct_ops Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 06/10] io_uring/bpf: add handle events callback Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 07/10] io_uring/bpf: implement struct_ops registration Pavel Begunkov
2025-11-24  3:44   ` Ming Lei
2025-11-24 13:12     ` Pavel Begunkov
2025-11-24 14:29       ` Ming Lei
2025-11-25 12:46         ` Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 08/10] io_uring/bpf: add basic kfunc helpers Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 09/10] selftests/io_uring: update mini liburing Pavel Begunkov
2025-11-13 11:59 ` [PATCH v3 10/10] selftests/io_uring: add bpf io_uring selftests Pavel Begunkov
2025-11-14 13:08   ` Ming Lei
2025-11-19 19:00     ` Pavel Begunkov
2025-11-20  1:41       ` Ming Lei
2025-11-21 16:12         ` Pavel Begunkov
2025-11-22  0:19           ` Ming Lei [this message]
2025-11-24 11:57             ` Pavel Begunkov
2025-11-24 13:28               ` Ming Lei

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAFj5m9KfmOvSQoj0rin+2gk34OqD-Bb0qqbXowyqwj16oFAseg@mail.gmail.com \
    --to=ming.lei@redhat.com \
    --cc=alexei.starovoitov@gmail.com \
    --cc=andrii@kernel.org \
    --cc=asml.silence@gmail.com \
    --cc=axboe@kernel.dk \
    --cc=bpf@vger.kernel.org \
    --cc=io-uring@vger.kernel.org \
    --cc=martin.lau@linux.dev \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox