From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pj1-f50.google.com (mail-pj1-f50.google.com [209.85.216.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A2EE82D5940 for ; Fri, 6 Mar 2026 00:33:16 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.216.50 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772757199; cv=none; b=tdSXwaOIDvv7OZK23eZGUh7BWWri+/m+54MbPGzp7kO/ryQ3tlrdlMhzTbDAePyebhp8DQWrK7Bk0WIar6Qe8wCkw9JbsOj/mA1NSs4AmlyZOsKflRKBqS9n8n44/zOTUsI19bK4n93Dg3azOiVDSQJaleZ7OI2x4dzco0cP0/8= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1772757199; c=relaxed/simple; bh=eW6ykhDFNFYwGikdfaT7YCllrHLJjuK6FvFK7TmvP68=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=NzL79yl0MjCxGSOdpo+yP8wHDZaS2zDuKUmozSIsee78DcQ6P7JE5B0eJH5t6qd3/+LGYyHolQowh8sNrmyxhR4GlwJTrM8bxGhsdamaPTjA38C9Sdt6/VinOPplTv9V6hV2O05cDjd5uVZz+fnXnF5oRg3ZKLDAw4KhVjlVWns= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=EpFwsdb7; arc=none smtp.client-ip=209.85.216.50 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="EpFwsdb7" Received: by mail-pj1-f50.google.com with SMTP id 98e67ed59e1d1-359866a1d02so4616144a91.0 for ; Thu, 05 Mar 2026 16:33:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1772757196; x=1773361996; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=n/OEXSm1HqdjrqxJhFVvNBTSrMNAOmq7g1Suj3CR0ZY=; b=EpFwsdb79H5Adqe/ZhbfRH123T78MRD2BNClE2PL0p2mR638li58tn4mLl1IaRnY33 utcIkcaAaKCrZMlDJT0v4+hRJXc4wuxelRcX1Q+T5u2CkdCLLDGC2TyO9DIewVgOshq0 syGCsTI3tOMyTOcSYBk8uXY9ehoaXVK31/5tJQykwVHq+RgbQ534i+rBDRowJq+77VbS NZK4/X8QgLB4eBcCuRmKTwtMftOvc937SifzMJtE8sjabPjLMZnWHP81h6Cjy3kJOai9 810SAWmAmusdDzyAv1MCorbpgf9pOSFDrOyxvDXErqL1FZ8hgOHFdfStHgmFk6mS+VL3 IrfQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1772757196; x=1773361996; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=n/OEXSm1HqdjrqxJhFVvNBTSrMNAOmq7g1Suj3CR0ZY=; b=fI6I+hx4aRhqN8menHFZT/QeHcb25n7NxyAUrGjMFyooRVSgA0uovDGM4bTRYSpgPD pLz6MEMSMoDZ0KmdYxRfF+qtA5DMrHVqST+foSvfZ4zBvK3yfisuk6nIbSpR2YoJBfRL KGkP/VSWI0Xy6zfCBwsTYhP5OIwVEyJVgWFHIR1yrqQ2K33W7zBSAHb6BYWdGKXakgKF hEPL/KNCBoc4IJqBe0NS2n/XBUa7oliIODf8xL5RyKW/q6jb5zJuyONlrEMa+hejFkGy FUlGBeCQQaxBkzLfEI3Cc4ZjAYGoR3LX5PY1ZSbN0JCxoH4Iy0Ztvm2VvUvVDk3JZosf XCpw== X-Forwarded-Encrypted: i=1; AJvYcCXMc7g0WY9+HfjVwTHB7gXE1+l4RDbElPesE+KisHa5T9arALhIfdAda6/EjCW8uK/67Yxymq0vqA==@vger.kernel.org X-Gm-Message-State: AOJu0YxH6YBN9THJE0bZp3sYjsRNDjhBRTcAdGeovPwr73iBfp2cL+NA XuvANQT0f9BrLa0zhrs2LhACxcgxw/Z3Ee2tgihsxm80k5HQhv9hnGFa X-Gm-Gg: ATEYQzz13cEcgrpN6kwn46O53C+IvTGE3B24Cs5/R/uIikzCqqqM1Wd/YTUv/6uhqrU SFolkZquLupELG9t2bPaShnpnVy46JlyccvyRo1Lw5Wjpqk2k2TVj0U1xsp6frQ62P9zxD5jNZL 8gbYSGnbJVSjdlfnZX499tCWLhPzpLq+AX1f+xYCkl7nOHVZ0jKHQrZ2gsccSZTd6D0ugz/0n3d 5f8sqtQ5/ZQvChYq6icAu6vNpbU08CNjnZK14wHkOomV2YmC8VPPUXmO4+BEfGuo5NFcKwe5kvt FRG0vGE7luj3r+TiDGtwctSixNC7nBnLbzM9mhtSGJQ9og46xpaHRP5Nhc75gJwsh0mk+In+bBA BO+MW1fZyakjkLMk+635oqG6OIEtLfDWgt9buzRTmX0kI96MjwuDqlRFDROS07yLZ7x2kTAGSNk hXKzWFooYW0uMk1PyRWg== X-Received: by 2002:a17:90b:2883:b0:359:7d76:5ead with SMTP id 98e67ed59e1d1-359be21a363mr264407a91.3.1772757195912; Thu, 05 Mar 2026 16:33:15 -0800 (PST) Received: from localhost ([2a03:2880:ff:72::]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-359b2d56347sm3472198a91.9.2026.03.05.16.33.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 05 Mar 2026 16:33:15 -0800 (PST) From: Joanne Koong To: axboe@kernel.dk Cc: hch@infradead.org, asml.silence@gmail.com, bernd@bsbernd.com, csander@purestorage.com, krisman@suse.de, linux-fsdevel@vger.kernel.org, io-uring@vger.kernel.org Subject: [PATCH v3 5/8] io_uring/kbuf: add recycling for kernel managed buffer rings Date: Thu, 5 Mar 2026 16:32:21 -0800 Message-ID: <20260306003224.3620942-6-joannelkoong@gmail.com> X-Mailer: git-send-email 2.47.3 In-Reply-To: <20260306003224.3620942-1-joannelkoong@gmail.com> References: <20260306003224.3620942-1-joannelkoong@gmail.com> Precedence: bulk X-Mailing-List: io-uring@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Add an interface for buffers to be recycled back into a kernel-managed buffer ring. Signed-off-by: Joanne Koong --- include/linux/io_uring/cmd.h | 11 +++++++++ io_uring/kbuf.c | 48 ++++++++++++++++++++++++++++++++++++ 2 files changed, 59 insertions(+) diff --git a/include/linux/io_uring/cmd.h b/include/linux/io_uring/cmd.h index 505a5b13e57c..dabe0cd3fe38 100644 --- a/include/linux/io_uring/cmd.h +++ b/include/linux/io_uring/cmd.h @@ -95,6 +95,10 @@ int io_uring_buf_ring_pin(struct io_uring_cmd *cmd, unsigned buf_group, unsigned issue_flags, struct io_buffer_list **out_bl); int io_uring_buf_ring_unpin(struct io_uring_cmd *cmd, unsigned buf_group, unsigned issue_flags); + +int io_uring_kmbuf_recycle(struct io_uring_cmd *cmd, unsigned int buf_group, + u64 addr, unsigned int len, unsigned int bid, + unsigned int issue_flags); #else static inline int io_uring_cmd_import_fixed(u64 ubuf, unsigned long len, int rw, @@ -150,6 +154,13 @@ static inline int io_uring_buf_ring_unpin(struct io_uring_cmd *cmd, { return -EOPNOTSUPP; } +static inline int io_uring_kmbuf_recycle(struct io_uring_cmd *cmd, + unsigned int buf_group, u64 addr, + unsigned int len, unsigned int bid, + unsigned int issue_flags) +{ + return -EOPNOTSUPP; +} #endif static inline struct io_uring_cmd *io_uring_cmd_from_tw(struct io_tw_req tw_req) diff --git a/io_uring/kbuf.c b/io_uring/kbuf.c index 9a681241c8b3..1497326694d0 100644 --- a/io_uring/kbuf.c +++ b/io_uring/kbuf.c @@ -102,6 +102,54 @@ void io_kbuf_drop_legacy(struct io_kiocb *req) req->kbuf = NULL; } +int io_uring_kmbuf_recycle(struct io_uring_cmd *cmd, unsigned int buf_group, + u64 addr, unsigned int len, unsigned int bid, + unsigned int issue_flags) +{ + struct io_kiocb *req = cmd_to_io_kiocb(cmd); + struct io_ring_ctx *ctx = req->ctx; + struct io_uring_buf_ring *br; + struct io_uring_buf *buf; + struct io_buffer_list *bl; + unsigned int required_flags; + int ret = -EINVAL; + + if (WARN_ON_ONCE(req->flags & REQ_F_BUFFERS_COMMIT)) + return ret; + + io_ring_submit_lock(ctx, issue_flags); + + bl = io_buffer_get_list(ctx, buf_group); + + if (!bl) + goto err; + + required_flags = IOBL_BUF_RING | IOBL_KERNEL_MANAGED; + if (WARN_ON_ONCE((bl->flags & required_flags) != required_flags)) + goto err; + + br = bl->buf_ring; + + if (WARN_ON_ONCE((__u16)(br->tail - bl->head) >= bl->nr_entries)) + goto err; + + buf = &br->bufs[(br->tail) & bl->mask]; + + buf->addr = addr; + buf->len = len; + buf->bid = bid; + + req->flags &= ~REQ_F_BUFFER_RING; + + br->tail++; + ret = 0; + +err: + io_ring_submit_unlock(ctx, issue_flags); + return ret; +} +EXPORT_SYMBOL_GPL(io_uring_kmbuf_recycle); + bool io_kbuf_recycle_legacy(struct io_kiocb *req, unsigned issue_flags) { struct io_ring_ctx *ctx = req->ctx; -- 2.47.3