public inbox for [email protected]
 help / color / mirror / Atom feed
From: Bernd Schubert <[email protected]>
To: David Wei <[email protected]>, Miklos Szeredi <[email protected]>
Cc: Jens Axboe <[email protected]>,
	Pavel Begunkov <[email protected]>,
	"[email protected]" <[email protected]>,
	"[email protected]" <[email protected]>,
	Joanne Koong <[email protected]>,
	Amir Goldstein <[email protected]>,
	Ming Lei <[email protected]>,
	Josef Bacik <[email protected]>
Subject: Re: [PATCH RFC v4 00/15] fuse: fuse-over-io-uring
Date: Mon, 4 Nov 2024 23:02:48 +0000	[thread overview]
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>

On 11/4/24 09:24, Bernd Schubert wrote:
> Hi David,
> 
> On 10/23/24 00:10, David Wei wrote:
>> [You don't often get email from [email protected]. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]
>>
>> On 2024-10-15 17:05, Bernd Schubert wrote:
>>> RFCv1 and RFCv2 have been tested with multiple xfstest runs in a VM
>>> (32 cores) with a kernel that has several debug options
>>> enabled (like KASAN and MSAN). RFCv3 is not that well tested yet.
>>> O_DIRECT is currently not working well with /dev/fuse and
>>> also these patches, a patch has been submitted to fix that (although
>>> the approach is refused)
>>> https://www.spinics.net/lists/linux-fsdevel/msg280028.html
>>
>> Hi Bernd, I applied this patch and the associated libfuse patch at:
>>
>> https://github.com/bsbernd/libfuse/tree/aligned-writes
>>
>> I have a simple Python FUSE client that is still returning EINVAL for
>> write():
>>
>> with open(sys.argv[1], 'r+b') as f:
>>     mmapped_file = mmap.mmap(f.fileno(), 0)
>>     shm = shared_memory.SharedMemory(create=True, size=mmapped_file.size())
>>     shm.buf[:mmapped_file.size()] = mmapped_file[:]
>>     fd = os.open("/home/vmuser/scratch/dest/out", O_RDWR|O_CREAT|O_DIRECT)
>>     with open(fd, 'w+b') as f2:
>>         f2.write(bytes(shm.buf))
>>     mmapped_file.close()
>>     shm.unlink()
>>     shm.close()
>>
>> I'll keep looking at this but letting you know in case it's something
>> obvious again.
> 
> the 'aligned-writes' libfuse branch would need another kernel patch. Please
> hold on a little bit, I hope to send out a new version later today or
> tomorrow that separates headers from payload - alignment is guaranteed. 
> 

If you are very brave, you could try out this (sorry, still on 6.10)


https://github.com/bsbernd/linux/tree/fuse-uring-for-6.10-rfc5
https://github.com/bsbernd/libfuse/tree/uring


Right now #fuse-uring-for-6.10-rfc5 is rather similar to
fuse-uring-for-6.10-rfc4, with two additional patches to
separate headers from payload. The head commit, which
updates fuse-io-uring is going to be rebased into the
other commits tomorrow.

Also, I just noticed a tear down issue, when the daemon
is killed while IO is going on - busy inodes on sb shutdown.
Some fuse requests are probably not correctly released, I
guess that is also already present on rfcv4. Will look into
it in the morning.


Thanks,
Bernd

      reply	other threads:[~2024-11-04 23:02 UTC|newest]

Thread overview: 36+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-10-16  0:05 [PATCH RFC v4 00/15] fuse: fuse-over-io-uring Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 01/15] fuse: rename to fuse_dev_end_requests and make non-static Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 02/15] fuse: Move fuse_get_dev to header file Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 03/15] fuse: Move request bits Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 04/15] fuse: Add fuse-io-uring design documentation Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 05/15] fuse: {uring} Handle SQEs - register commands Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 06/15] fuse: Make fuse_copy non static Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 07/15] fuse: Add buffer offset for uring into fuse_copy_state Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 08/15] fuse: {uring} Add uring sqe commit and fetch support Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 09/15] fuse: {uring} Handle teardown of ring entries Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 10/15] fuse: {uring} Add a ring queue and send method Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 11/15] fuse: {uring} Allow to queue to the ring Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 12/15] io_uring/cmd: let cmds to know about dying task Bernd Schubert
2024-11-04  0:28   ` Pavel Begunkov
2024-11-04 22:15     ` Bernd Schubert
2024-11-05  1:08       ` Pavel Begunkov
2024-11-05 23:02         ` Bernd Schubert
2024-11-06  0:14           ` Pavel Begunkov
2024-11-06 19:28             ` Bernd Schubert
2024-11-06  4:44           ` Ming Lei
2024-11-06 19:34             ` Bernd Schubert
2024-11-07 16:11               ` Pavel Begunkov
2024-10-16  0:05 ` [PATCH RFC v4 13/15] fuse: {uring} Handle IO_URING_F_TASK_DEAD Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 14/15] fuse: {io-uring} Prevent mount point hang on fuse-server termination Bernd Schubert
2024-10-16  0:05 ` [PATCH RFC v4 15/15] fuse: enable fuse-over-io-uring Bernd Schubert
2024-10-16  0:08 ` [PATCH RFC v4 00/15] fuse: fuse-over-io-uring Bernd Schubert
2024-10-21  4:06 ` David Wei
2024-10-21 11:47   ` Bernd Schubert
2024-10-21 20:57     ` David Wei
2024-10-22 10:24       ` Bernd Schubert
2024-10-22 12:46         ` Bernd Schubert
2024-10-22 17:10           ` David Wei
2024-10-22 17:12         ` David Wei
2024-10-22 22:10 ` David Wei
2024-11-04  8:24   ` Bernd Schubert
2024-11-04 23:02     ` Bernd Schubert [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    [email protected] \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox