Received: by 2002:a25:e74b:0:0:0:0:0 with SMTP id e72csp299103ybh; Wed, 15 Jul 2020 02:13:04 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyxgLGvBdOtEmRaV3rNkQhnnAmKAGy1VeQOnGGDyU4ac1fTiZXpd6ZNkwyzX0R3VhQ/eZXx X-Received: by 2002:a17:906:700f:: with SMTP id n15mr8755460ejj.390.1594804384233; Wed, 15 Jul 2020 02:13:04 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1594804384; cv=none; d=google.com; s=arc-20160816; b=F6krfcEOFwAqhFbIG1oIj6xEQ32RVn+3+VLfnB2lJbhGG5J7QGmu2SXq7bomZLLN5n ABb18kWU7ICdo71DoeLItdQSForisDUVgYrFFXOQqteQ8HiM8EHMaCXQ1yhaEj0x7UaW P4GZkgO6iAFcYVA0d52Qxf4zwwefbSDrH+LRhLoqCqN6YPyzA/bWwcWWac/iA5xLAKos vW9+YjGNWuYwLnSWAYOicDPlNBsf/2deSUsE8HeJiYuPTgk50KiwVtTiTnnWv3waEgv4 mmGdEPDzNZqFdZUa9gPKgrzUkqbD84FsIo93vCfSLZKj1nkE49zdneKGC1ZYJ4mFl7l2 HCfg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=J4RPEf69RMf6fMrFPs7gvn650I5l4fPXkmLiZzrYicg=; b=RLLQRha74ZrVsFhSFsHFdjDUmMxtN8aZrjFG6jM74oyMty1UkBmM6gZaBPW/tE5XDL N4B3hhfU+gcTTqauDseku3M1TZoV/k5LOLSAjvCDTgXhSfQ0kRRekFFcDxuGqU49IytM gcgh27BX3QypVapp0td/RLj2pghwrtylZgHPBeeR4JNvtRryfizkxFeaDSOwMO0bOWNS 0GzUqLZfzCnfCvOQ3tiWJ73+8IwWR4p+9DA4s6mj/vRrG7Ch/bDyevG+ey31gdXo5N7l xJns2MLfRGvqbiAVjmipRMR1Q5eGP79vhtwSXqcSWtij1VpPwthvcXRcB+WQyJieOfb0 zl0w== ARC-Authentication-Results: i=1; mx.google.com; dkim=temperror (no key for signature) header.i=@szeredi.hu header.s=google header.b=joTTxszS; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id p13si921431edh.504.2020.07.15.02.12.41; Wed, 15 Jul 2020 02:13:04 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=temperror (no key for signature) header.i=@szeredi.hu header.s=google header.b=joTTxszS; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729373AbgGOIlg (ORCPT + 99 others); Wed, 15 Jul 2020 04:41:36 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54168 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729351AbgGOIle (ORCPT ); Wed, 15 Jul 2020 04:41:34 -0400 Received: from mail-ed1-x541.google.com (mail-ed1-x541.google.com [IPv6:2a00:1450:4864:20::541]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 9541AC061755 for ; Wed, 15 Jul 2020 01:41:34 -0700 (PDT) Received: by mail-ed1-x541.google.com with SMTP id a1so978017edt.10 for ; Wed, 15 Jul 2020 01:41:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=szeredi.hu; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=J4RPEf69RMf6fMrFPs7gvn650I5l4fPXkmLiZzrYicg=; b=joTTxszSLFMvayIfPbb55BXWK7XCzUWZDla2m5tAeog6qXLfmJE5dj+uRo2NBF9wZ/ F7i8zd8hr0+Qxym6zB6l97h72NSaZ/5NKdHBEnj5J1feDVUpr1YfOMLXfk4KLNiTdWYK 3mrklvsXTJ1W+NqzIijFYhkfbdrl3pBNpY49Y= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=J4RPEf69RMf6fMrFPs7gvn650I5l4fPXkmLiZzrYicg=; b=IRL+mcNPmxS9kqepwtARjrQzuKpqbdvhFAnudGXGVAE8VMaI+e1G1RsrwwbqS0+o2w TzQiJ5Fi0FWOxh5MrELOFD74ZmrPDXDUCiPTXo6ySdRbmJuH0xFVZJp5m1ZkPjzP2TB5 8bNqVQgUlyBEXJUgww74gyqpRrLzVRJfawHIifjwCYUUuxkSFDi1EfVO7f7n9lZsGNNY OPhY0+wR0zV6fKmZDRdGRROSWM0eITckFB5CffD7Gqg1b7GliNpN63mgx+lpzy3e7ME0 JPDZ9bb2cTE8Ya8DRVE7DHPgth8mmH7XOHy3lez7KuQhIRXGIxaVZI+vfh0DcQK58GY5 xbbw== X-Gm-Message-State: AOAM53026iFMdKMAC3jjJ0IbNnw1CWYB7U7EPgKyaf6YJFt9czjfdRVT TQrWujSHY1GWjAM2twbQXumQ5Ft+yrwPfWH3mZd7OA== X-Received: by 2002:a05:6402:1687:: with SMTP id a7mr8448226edv.358.1594802493290; Wed, 15 Jul 2020 01:41:33 -0700 (PDT) MIME-Version: 1.0 References: <20200705115021.GA1227929@kroah.com> <20200714065110.GA8047@amd> <4e92b851-ce9a-e2f6-3f9a-a4d47219d320@gmail.com> <7584d754-2044-a892-cf29-65259b9c4eb1@gmail.com> In-Reply-To: <7584d754-2044-a892-cf29-65259b9c4eb1@gmail.com> From: Miklos Szeredi Date: Wed, 15 Jul 2020 10:41:22 +0200 Message-ID: Subject: Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster To: Pavel Begunkov Cc: Pavel Machek , Greg KH , Jan Ziak <0xe2.0x9a.0x9b@gmail.com>, Linux API , linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-man , Michael Kerrisk , shuah@kernel.org, Al Viro , io-uring@vger.kernel.org Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Jul 15, 2020 at 10:33 AM Pavel Begunkov wrote: > > On 14/07/2020 14:55, Miklos Szeredi wrote: > > On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov wrote: > >> > >> On 14/07/2020 11:07, Miklos Szeredi wrote: > >>> On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: > >>>> > >>>> Hi! > >>>> > >>>>>> At first, I thought that the proposed system call is capable of > >>>>>> reading *multiple* small files using a single system call - which > >>>>>> would help increase HDD/SSD queue utilization and increase IOPS (I/O > >>>>>> operations per second) - but that isn't the case and the proposed > >>>>>> system call can read just a single file. > >>>>> > >>>>> If you want to do this for multple files, use io_ring, that's what it > >>>>> was designed for. I think Jens was going to be adding support for the > >>>>> open/read/close pattern to it as well, after some other more pressing > >>>>> features/fixes were finished. > >>>> > >>>> What about... just using io_uring for single file, too? I'm pretty > >>>> sure it can be wrapped in a library that is simple to use, avoiding > >>>> need for new syscall. > >>> > >>> Just wondering: is there a plan to add strace support to io_uring? > >>> And I don't just mean the syscalls associated with io_uring, but > >>> tracing the ring itself. > >> > >> What kind of support do you mean? io_uring is asynchronous in nature > >> with all intrinsic tracing/debugging/etc. problems of such APIs. > >> And there are a lot of handy trace points, are those not enough? > >> > >> Though, this can be an interesting project to rethink how async > >> APIs are worked with. > > > > Yeah, it's an interesting problem. The uring has the same events, as > > far as I understand, that are recorded in a multithreaded strace > > output (syscall entry, syscall exit); nothing more is needed> > > I do think this needs to be integrated into strace(1), otherwise the > > usefulness of that tool (which I think is *very* high) would go down > > drastically as io_uring usage goes up. > > Not touching the topic of usefulness of strace + io_uring, but I'd rather > have a tool that solves a problem, than a problem that created and honed > for a tool. Sorry, I'm not getting the metaphor. Can you please elaborate? Thanks, Miklos