From: Bernd Schubert <bernd@bsbernd.com>
To: Joanne Koong <joannelkoong@gmail.com>,
axboe@kernel.dk, miklos@szeredi.hu
Cc: bschubert@ddn.com, csander@purestorage.com, krisman@suse.de,
io-uring@vger.kernel.org, asml.silence@gmail.com,
xiaobing.li@samsung.com, safinaskar@gmail.com,
linux-fsdevel@vger.kernel.org
Subject: Re: [PATCH v4 25/25] docs: fuse: add io-uring bufring and zero-copy documentation
Date: Tue, 3 Feb 2026 19:56:04 +0100 [thread overview]
Message-ID: <4b609081-89e9-41b7-bea2-b3fa4e8b9e3e@bsbernd.com> (raw)
In-Reply-To: <20260116233044.1532965-26-joannelkoong@gmail.com>
On 1/17/26 00:30, Joanne Koong wrote:
> Add documentation for fuse over io-uring usage of kernel-managed
> bufrings and zero-copy.
>
> Signed-off-by: Joanne Koong <joannelkoong@gmail.com>
> ---
> .../filesystems/fuse/fuse-io-uring.rst | 59 ++++++++++++++++++-
> 1 file changed, 58 insertions(+), 1 deletion(-)
>
> diff --git a/Documentation/filesystems/fuse/fuse-io-uring.rst b/Documentation/filesystems/fuse/fuse-io-uring.rst
> index d73dd0dbd238..11c244b63d25 100644
> --- a/Documentation/filesystems/fuse/fuse-io-uring.rst
> +++ b/Documentation/filesystems/fuse/fuse-io-uring.rst
> @@ -95,5 +95,62 @@ Sending requests with CQEs
> | <fuse_unlink() |
> | <sys_unlink() |
>
> +Kernel-managed buffer rings
> +===========================
>
> -
> +Kernel-managed buffer rings have two main advantages:
> +
> +* eliminates the overhead of pinning/unpinning user pages and translating
> + virtual addresses for every server-kernel interaction
> +* reduces buffer memory allocation requirements
> +
> +In order to use buffer rings, the server must preregister the following:
> +
> +* a fixed buffer at index 0. This is where the headers will reside
> +* a kernel-managed buffer ring. This is where the payload will reside
Would you mind to add the actual liburing call for this? I think it
would be helpful for anyone who wants to implement it.
> +
> +At a high-level, this is how fuse uses buffer rings:
> +
> +* The server registers a kernel-managed buffer ring. In the kernel this
> + allocates the pages needed for the buffers and vmaps them. The server
> + obtains the virtual address for the buffers through an mmap call on the ring
> + fd.
> +* When there is a request from a client, fuse will select a buffer from the
> + ring if there is any payload that needs to be copied, copy over the payload
> + to the selected buffer, and copy over the headers to the fixed buffer at
> + index 0, at the buffer id that corresponds to the server (which the server
> + needs to specify through sqe->buf_index).
> +* The server obtains a cqe representing the request. The cqe flag will have
> + IORING_CQE_F_BUFFER set if a selected buffer was used for the payload. The
> + buffer id is stashed in cqe->flags (through IORING_CQE_BUFFER_SHIFT). The
> + server can directly access the payload by using that buffer id to calculate
> + the offset into the virtual address obtained for the buffers.
> +* The server processes the request and then sends a
> + FUSE_URING_CMD_COMMIT_AND_FETCH sqe with the reply.
> +* When the kernel handles the sqe, it will process the reply and if there is a
> + next request, it will reuse the same selected buffer for the request. If
> + there is no next request, it will recycle the buffer back to the ring.
> +
> +Zero-copy
> +=========
> +
> +Fuse io-uring zero-copy allows the server to directly read from / write to the
> +client's pages and bypass any intermediary buffer copies. This is only allowed
> +on privileged servers.
> +
> +In order to use zero-copy, the server must pregister the following:
> +
> +* a sparse buffer for every entry in the queue. This is where the client's
> + pages will reside
> +* a fixed buffer at index queue_depth (tailing the sparse buffer).
> + This is where the headers will reside
> +* a kernel-managed buffer ring. This is where any non-zero-copied payload (eg
> + out headers) will reside
> +
> +When the client issues a read/write, fuse stores the client's underlying pages
> +in the sparse buffer entry corresponding to the ent in the queue. The server
> +can then issue reads/writes on these pages through io_uring rw operations.
> +Please note that the server is not able to directly access these pages, it
> +must go through the io-uring interface to read/write to them. The pages are
> +unregistered once the server replies to the request. Non-zero-copyable
> +payload (if needed) is placed in a buffer from the kernel-managed buffer ring.
next prev parent reply other threads:[~2026-02-03 18:56 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-16 23:30 [PATCH v4 00/25] fuse/io-uring: add kernel-managed buffer rings and zero-copy Joanne Koong
2026-01-16 23:30 ` [PATCH v4 01/25] io_uring/kbuf: refactor io_buf_pbuf_register() logic into generic helpers Joanne Koong
2026-01-16 23:30 ` [PATCH v4 02/25] io_uring/kbuf: rename io_unregister_pbuf_ring() to io_unregister_buf_ring() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 03/25] io_uring/kbuf: add support for kernel-managed buffer rings Joanne Koong
2026-01-16 23:30 ` [PATCH v4 04/25] io_uring/kbuf: add mmap " Joanne Koong
2026-01-16 23:30 ` [PATCH v4 05/25] io_uring/kbuf: support kernel-managed buffer rings in buffer selection Joanne Koong
2026-01-16 23:30 ` [PATCH v4 06/25] io_uring/kbuf: add buffer ring pinning/unpinning Joanne Koong
2026-02-03 18:52 ` Bernd Schubert
2026-01-16 23:30 ` [PATCH v4 07/25] io_uring/kbuf: add recycling for kernel managed buffer rings Joanne Koong
2026-02-03 18:44 ` Bernd Schubert
2026-01-16 23:30 ` [PATCH v4 08/25] io_uring: add io_uring_fixed_index_get() and io_uring_fixed_index_put() Joanne Koong
2026-01-22 21:02 ` Caleb Sander Mateos
2026-01-27 20:05 ` Joanne Koong
2026-01-16 23:30 ` [PATCH v4 09/25] io_uring/kbuf: add io_uring_is_kmbuf_ring() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 10/25] io_uring/kbuf: export io_ring_buffer_select() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 11/25] io_uring/kbuf: return buffer id in buffer selection Joanne Koong
2026-01-16 23:30 ` [PATCH v4 12/25] io_uring/cmd: set selected buffer index in __io_uring_cmd_done() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 13/25] fuse: refactor io-uring logic for getting next fuse request Joanne Koong
2026-01-16 23:30 ` [PATCH v4 14/25] fuse: refactor io-uring header copying to ring Joanne Koong
2026-01-16 23:30 ` [PATCH v4 15/25] fuse: refactor io-uring header copying from ring Joanne Koong
2026-01-27 23:11 ` Bernd Schubert
2026-01-16 23:30 ` [PATCH v4 16/25] fuse: use enum types for header copying Joanne Koong
2026-01-16 23:30 ` [PATCH v4 17/25] fuse: refactor setting up copy state for payload copying Joanne Koong
2026-01-16 23:30 ` [PATCH v4 18/25] fuse: support buffer copying for kernel addresses Joanne Koong
2026-01-27 23:39 ` Bernd Schubert
2026-01-28 0:23 ` Joanne Koong
2026-01-28 21:14 ` Bernd Schubert
2026-01-29 1:16 ` Joanne Koong
2026-01-16 23:30 ` [PATCH v4 19/25] fuse: add io-uring kernel-managed buffer ring Joanne Koong
2026-01-17 5:28 ` kernel test robot
2026-01-28 21:44 ` Bernd Schubert
2026-01-29 1:15 ` Joanne Koong
2026-01-16 23:30 ` [PATCH v4 20/25] io_uring/rsrc: rename io_buffer_register_bvec()/io_buffer_unregister_bvec() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 21/25] io_uring/rsrc: split io_buffer_register_request() logic Joanne Koong
2026-01-16 23:30 ` [PATCH v4 22/25] io_uring/rsrc: Allow buffer release callback to be optional Joanne Koong
2026-01-16 23:30 ` [PATCH v4 23/25] io_uring/rsrc: add io_buffer_register_bvec() Joanne Koong
2026-01-16 23:30 ` [PATCH v4 24/25] fuse: add zero-copy over io-uring Joanne Koong
2026-01-16 23:30 ` [PATCH v4 25/25] docs: fuse: add io-uring bufring and zero-copy documentation Joanne Koong
2026-02-03 18:56 ` Bernd Schubert [this message]
2026-01-27 20:12 ` [PATCH v4 00/25] fuse/io-uring: add kernel-managed buffer rings and zero-copy Joanne Koong
2026-01-27 22:44 ` Bernd Schubert
2026-01-27 23:27 ` Joanne Koong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4b609081-89e9-41b7-bea2-b3fa4e8b9e3e@bsbernd.com \
--to=bernd@bsbernd.com \
--cc=asml.silence@gmail.com \
--cc=axboe@kernel.dk \
--cc=bschubert@ddn.com \
--cc=csander@purestorage.com \
--cc=io-uring@vger.kernel.org \
--cc=joannelkoong@gmail.com \
--cc=krisman@suse.de \
--cc=linux-fsdevel@vger.kernel.org \
--cc=miklos@szeredi.hu \
--cc=safinaskar@gmail.com \
--cc=xiaobing.li@samsung.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox