[GIT PULL] io_uring updates for 6.12-rc1

[Jens Axboe <axboe@kernel.dk>]

Hi Linus,

Here are the main io_uring changes for the 6.12 merge window. There will
be a followup one that adds discard support, but since that depends on
both this branch and the block branch, it'll be sent post both of those.

This pull request contains:

- NAPI fixes and cleanups (Pavel, Olivier)

- Add support for absolute timeouts (Pavel)

- Fixes for io-wq/sqpoll affinities (Felix)

- Efficiency improvements for dealing with huge pages (Chenliang)

- Support for a minwait mode, where the application essentially has two
  timouts - one smaller one that defines the batch timeout, and the
  overall large one similar to what we had before. This enables
  efficient use of batching based on count + timeout, while still working
  well with periods of less intensive workloads.

- Use ITER_UBUF for single segment sends

- Add support for incremental buffer consumption. Right now each
  operation will always consume a full buffer. With incremental
  consumption, a recv/read operation only consumes the part of the
  buffer that it needs to satisfy the operation.

- Add support for GCOV for io_uring, to help retain a high coverage of
  test to code ratio.

- Fix regression with ocfs2, where an odd -EOPNOTSUPP wasn't correctly
  converted to a blocking retry.

- Add support for cloning registered buffers from one ring to another.

- Misc cleanups (Anuj, me)

Please pull!


The following changes since commit 5be63fc19fcaa4c236b307420483578a56986a37:

  Linux 6.11-rc5 (2024-08-25 19:07:11 +1200)

are available in the Git repository at:

  git://git.kernel.dk/linux.git tags/for-6.12/io_uring-20240913

for you to fetch changes up to 7cc2a6eadcd7a5aa36ac63e6659f5c6138c7f4d2:

  io_uring: add IORING_REGISTER_COPY_BUFFERS method (2024-09-12 10:14:15 -0600)

----------------------------------------------------------------
for-6.12/io_uring-20240913

----------------------------------------------------------------
Anuj Gupta (2):
      io_uring: add new line after variable declaration
      io_uring: remove unused rsrc_put_fn

Chenliang Li (2):
      io_uring/rsrc: store folio shift and mask into imu
      io_uring/rsrc: enable multi-hugepage buffer coalescing

Felix Moessbauer (3):
      io_uring/sqpoll: do not allow pinning outside of cpuset
      io_uring/io-wq: do not allow pinning outside of cpuset
      io_uring/io-wq: inherit cpuset of cgroup in io worker

Jens Axboe (22):
      io_uring/kbuf: use 'bl' directly rather than req->buf_list
      io_uring/net: use ITER_UBUF for single segment send maps
      io_uring/kbuf: turn io_buffer_list booleans into flags
      io_uring: encapsulate extraneous wait flags into a separate struct
      io_uring: move schedule wait logic into helper
      io_uring: implement our own schedule timeout handling
      io_uring: add support for batch wait timeout
      io_uring: wire up min batch wake timeout
      io_uring/kbuf: shrink nr_iovs/mode in struct buf_sel_arg
      io_uring/kbuf: add io_kbuf_commit() helper
      io_uring/kbuf: move io_ring_head_to_buf() to kbuf.h
      Revert "io_uring: Require zeroed sqe->len on provided-buffers send"
      io_uring/kbuf: pass in 'len' argument for buffer commit
      io_uring/kbuf: add support for incremental buffer consumption
      io_uring: add GCOV_PROFILE_URING Kconfig option
      io_uring/eventfd: move refs to refcount_t
      io_uring/rw: treat -EOPNOTSUPP for IOCB_NOWAIT like -EAGAIN
      io_uring/rw: drop -EOPNOTSUPP check in __io_complete_rw_common()
      io_uring/rsrc: clear 'slot' entry upfront
      io_uring/rsrc: add reference count to struct io_mapped_ubuf
      io_uring/register: provide helper to get io_ring_ctx from 'fd'
      io_uring: add IORING_REGISTER_COPY_BUFFERS method

Olivier Langlois (2):
      io_uring: add napi busy settings to the fdinfo output
      io_uring: micro optimization of __io_sq_thread() condition

Pavel Begunkov (4):
      io_uring/napi: refactor __io_napi_busy_loop()
      io_uring/napi: postpone napi timeout adjustment
      io_uring: add absolute mode wait timeouts
      io_uring: user registered clockid for wait timeouts

 include/linux/io_uring_types.h |   3 +
 include/uapi/linux/io_uring.h  |  42 ++++++-
 init/Kconfig                   |  13 +++
 io_uring/Makefile              |   4 +
 io_uring/eventfd.c             |  13 ++-
 io_uring/fdinfo.c              |  14 ++-
 io_uring/io-wq.c               |  25 ++++-
 io_uring/io_uring.c            | 212 ++++++++++++++++++++++++++---------
 io_uring/io_uring.h            |  12 ++
 io_uring/kbuf.c                |  96 ++++++++--------
 io_uring/kbuf.h                |  94 +++++++++++-----
 io_uring/napi.c                |  35 ++----
 io_uring/napi.h                |  16 ---
 io_uring/net.c                 |  27 +++--
 io_uring/register.c            |  91 +++++++++++----
 io_uring/register.h            |   1 +
 io_uring/rsrc.c                | 245 ++++++++++++++++++++++++++++++++++-------
 io_uring/rsrc.h                |  14 ++-
 io_uring/rw.c                  |  19 +++-
 io_uring/sqpoll.c              |   7 +-
 20 files changed, 723 insertions(+), 260 deletions(-)

-- 
Jens Axboe