From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server-vie001.gnuweeb.org X-Spam-Level: X-Spam-Status: No, score=-1.2 required=5.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,URIBL_DBL_BLOCKED_OPENDNS, URIBL_ZEN_BLOCKED_OPENDNS autolearn=ham autolearn_force=no version=3.4.6 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gnuweeb.org; s=new2025; t=1753077881; bh=KnUck0Bkslwp9lb7S9GWRj9NI6nLQ26IsIl/bbwscrQ=; h=MIME-Version:References:In-Reply-To:From:Date:Message-ID:Subject: To:Cc:Content-Type:Content-Transfer-Encoding:Message-ID:Date:From: Reply-To:Subject:To:Cc:In-Reply-To:References:Resent-Date: Resent-From:Resent-To:Resent-Cc:User-Agent:Content-Type: Content-Transfer-Encoding; b=vOWN20u3mVjkunNhYnp69cwWYjIO/5Kfh8ZqDd01FV4ZmOGxNxEZ8GxEP1nvPHqDm AOGnp+xv7lEktY+u46AxKmtjyQ4M9mQ/JxGIxXhInqzKxRK1tHu5lUFJM7yzYqMh7R cLX46aSlg/2DLTUknRyQkcjUcqHeSNIgdaNSJBjHHzxp74l59pfY+XiVV90Bpk0Gp7 PooARThvcBif+GDS7/xBBjXFGVYiZxddkoncPy9lgR1KefcLl8T5RCxnK44plczRU2 plG7+Bi+IsVr+sD79fYi0L0e8t5k57K1DtZEn86HtiYqidTUKqS7sm92X9z/vWwl4t tsIz/3ErmmWSw== Received: from mail-pl1-f180.google.com (mail-pl1-f180.google.com [209.85.214.180]) by server-vie001.gnuweeb.org (Postfix) with ESMTPSA id 4D2672109A4B for ; Mon, 21 Jul 2025 06:04:41 +0000 (UTC) Received: by mail-pl1-f180.google.com with SMTP id d9443c01a7336-23c8f179e1bso38893235ad.1 for ; Sun, 20 Jul 2025 23:04:41 -0700 (PDT) X-Gm-Message-State: AOJu0YzeVahbAfKZatXsc31ejE+0DU8IeF1lBdzojqFqa3tMFAVeB1r+ uy3yB4HSCRAC/eJW3nF7QRnEIb7mFLeKOSkIo1y65Loe2owH+De40oOrDecaGduIxPmZMHRVe4n OaP9IYIXKkdcynzCRigyO3gw2v2aI4Rw= X-Google-Smtp-Source: AGHT+IHGn2kWHLCODVDiPdyQliCCjUY79/HJ0mo8p/rRbkOS/KMR/j8RPjngs/d8qJWymIIHmsC66RKN8GLp0afnBwI= X-Received: by 2002:a17:903:41c7:b0:234:b422:7120 with SMTP id d9443c01a7336-23e25693682mr203582995ad.9.1753077879674; Sun, 20 Jul 2025 23:04:39 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Alviro Iskandar Setiawan Date: Mon, 21 Jul 2025 13:04:28 +0700 X-Gmail-Original-Message-ID: X-Gm-Features: Ac12FXxqmapDN_XEFEnUOcoOjSKLIp4jKqkD55b4zZYAWC6iHVyhFaP8I4oZwCI Message-ID: Subject: Re: Feedback on New Kafka Project To: Xiaorui Wang Cc: "GNU/Weeb Mailing List" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Id: On Mon, July 20, 2025 at 10:11=E2=80=AFAM Xiaorui Wang wrote: > Hello Alviro > > I observed your interest in a number of open source projects, so I wanted= to share a relevant open source project I'm working on. > > AutoMQ is a Kafka solution developed on object storage. This provides a n= umber of key benefits: > > - 10x more cost-effective than Apache Kafka. > - Partition reassignment 800x faster than Kafka. > - 5x higher throughput in catch-up read. > > I'm excited to let you know that AutoMQ has successfully simplified the o= peration and maintenance of Apache Kafka for Grab.com, which has greatly lo= wered their cloud expenditures. > > Is this something that could be beneficial? I'd love to hear any feedback= you might have! > > (If this isn't a good fit, don't worry =E2=80=93 I won't reach out again!= )) > > Thanks, > Xiaorui > github.com/automq/automq That sounds seriously impressive. It would be great if you can show a comparison of your benchmark result of Apache Kafka vs AutoMQ. Does it also utilize the recent shiny kernel feature, io_uring? I think integrating io_uring could be a cool way to boost I/O performance even further, especially with your network and object storage setup. Curious to hear your thoughts on that. io_uring will likely be the next big thing. We are still early... --=20 Software Engineer & ITPM Officer Alviro Iskandar Setiawan