Received: by 2002:a25:8b91:0:0:0:0:0 with SMTP id j17csp1283170ybl; Fri, 31 Jan 2020 18:11:54 -0800 (PST) X-Google-Smtp-Source: APXvYqyp+QgPUlykN/dN1IcFUivE15PzPNue+FmZm+U7b+WNWh9YfRwfOgtPQRrvNQLR2J+Ipyi0 X-Received: by 2002:a9d:7757:: with SMTP id t23mr10167119otl.315.1580523113958; Fri, 31 Jan 2020 18:11:53 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1580523113; cv=none; d=google.com; s=arc-20160816; b=Mh/1wK66qE4+/4d77UJGcA5jRCLu+/mel4Wb/GpoV0UTZY1Kb8syXhZL/NugngQMny sIRo0Y4v2NK88ZNWX6YaLL7gtX4jr8qMjx4pSeLLIm9zKmEJLGtnVk/qc5cLQQ9lyu+f OieZGNkc2IFXU0ckPokzlW1cIHUu+SPEF/nu2TpXQYgF4X0/ckKGPX/Pc7vM5lKFpSaV Uzl5d2SUoK3qbWQShdesDja13m62UmbhxyfOZft8AzohKYEzzgwGM58N2+i/BycO/3A2 7mWzUDOJUSs2Q3x5pgERkqb95oNwXxE3TDzbu7adfIrfLR5hJP+1HjNsUVq/cXDmrF33 VtAg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:to:subject:dkim-signature; bh=k93QIXrlhVKvP7ezICOk3caRM5BxpPtO926JL6CGXc4=; b=gWLMCHBf4fdfEiV5J0qT/pGUhoHrbPdH1i5wdAGS+bul3neVXWWc+LvQxHkV2fyxch a5IcDo9rQ3fteNXxhc1sPZ109D0UA3gras8hE3z+zTCsMRu42Xs6SSWVZe48QbUBchNc lorBOG+UBiPTH0yYUwypZpr2w5NpTnmjAbje6V1rxeXKnKQffmuhQZKw4J8E24ho6K0l UDJLjY1/Q2YMDaAO7NauPD2NDi23bS69rTTP4Mbo01raJLwIeV10zHCJRkY5gNwqm2gp C3R9gaqQov9yaAnXvb5IqWHBqnjx76lKm9U0nnW0Zcp4prcbGTVYUqYRMhvkYJnJyMAt KdEw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=WzJTUP5Y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id 73si5006182oii.60.2020.01.31.18.11.40; Fri, 31 Jan 2020 18:11:53 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=WzJTUP5Y; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726698AbgBACKq (ORCPT + 99 others); Fri, 31 Jan 2020 21:10:46 -0500 Received: from mail-pl1-f195.google.com ([209.85.214.195]:37872 "EHLO mail-pl1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726548AbgBACKq (ORCPT ); Fri, 31 Jan 2020 21:10:46 -0500 Received: by mail-pl1-f195.google.com with SMTP id c23so3530388plz.4 for ; Fri, 31 Jan 2020 18:10:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=k93QIXrlhVKvP7ezICOk3caRM5BxpPtO926JL6CGXc4=; b=WzJTUP5Yd/yOi2pp6mKUiEg5Y0sTCDhOnWOow3LVm9HbMEo9yewdTOGRujYdJMrLHC di0stniZHIsZSf1ca98dPzIpwRLgU03JMXkzIp8zlJwynW6ovU+Na1fb8lQH3loT/Uis 6mfdncX2AadVERJvdPfCHeILLUGXLDmq89+uQMQ7niNSP0mkLjOjfd4OrJUYM7kdwso/ sBpoyFEA7ZXyvd2q5awC8NsO9PQIPEA7rAAcSfvkLeso2K51Hh7m8okJ1WN7z6RnBJJK Dc9wD6CjrBAnQ6fS/3e7+Gn4bkL5n9HU9Ba+lZJ+aW2mXqe8CkBiAKewUtey/GD66djp /EtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=k93QIXrlhVKvP7ezICOk3caRM5BxpPtO926JL6CGXc4=; b=EVxtRH1/V8NxgPMBbNyZc8LOD0F+PDwxDju2bkXZlmL6eeLwli4nodoiFDYF5c/dJm VOMoxxGdRVMONLfWiJdxGZcwB4GWpZOOLk2njZfpLcFnfrbj+dWHDF6lhGKVrweiHuke P+wCBE+p6nvWcZl6R0LTUgpbRJIbEoZ3yN7jrWgjiZevfFT0b23PtbYzSZXQYunzS3ZC eWjbK25/yRT8RyTbHWjCzTGM2P6Wsdf1q0I0jHF4okecTiFZ5wkjyeCLYXy73UeLNCW8 LeNWi8dK1rrhJxDNDaG1LHdbzCE+f6GjQomrYrj24kUhmFia1UF6gH20JfetfluElBaX jkUg== X-Gm-Message-State: APjAAAUgEE4NNcRlnb2UD9VGPinvr2hCGissduzwFn1i4eEziCmUlmm2 a7ycdM5s2UsFdDKop1hHzcMVuRJmRbQ= X-Received: by 2002:a17:90a:a385:: with SMTP id x5mr5223992pjp.102.1580523044195; Fri, 31 Jan 2020 18:10:44 -0800 (PST) Received: from [192.168.1.188] ([66.219.217.145]) by smtp.gmail.com with ESMTPSA id p17sm11327441pfn.31.2020.01.31.18.10.43 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 31 Jan 2020 18:10:43 -0800 (PST) Subject: Re: [PATCH v3 0/6] add persistent submission state To: Pavel Begunkov , io-uring@vger.kernel.org, linux-kernel@vger.kernel.org References: <6492ccd2-e829-df13-ab6e-e62590375fd1@kernel.dk> <199731e7-ca3f-ea6c-0813-6aa5dec6fa66@gmail.com> <18b43ead-0056-f975-a6ed-35fb645461e9@gmail.com> From: Jens Axboe Message-ID: <1124e9e0-cf3b-767e-40a5-57297e5ec17b@kernel.dk> Date: Fri, 31 Jan 2020 19:10:41 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: <18b43ead-0056-f975-a6ed-35fb645461e9@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 1/31/20 5:31 PM, Pavel Begunkov wrote: > On 01/02/2020 01:32, Pavel Begunkov wrote: >> On 01/02/2020 01:22, Jens Axboe wrote: >>> On 1/31/20 3:15 PM, Pavel Begunkov wrote: >>>> Apart from unrelated first patch, this persues two goals: >>>> >>>> 1. start preparing io_uring to move resources handling into >>>> opcode specific functions >>>> >>>> 2. make the first step towards long-standing optimisation ideas >>>> >>>> Basically, it makes struct io_submit_state embedded into ctx, so >>>> easily accessible and persistent, and then plays a bit around that. >>> >>> Do you have any perf/latency numbers for this? Just curious if we >>> see any improvements on that front, cross submit persistence of >>> alloc caches should be a nice sync win, for example, or even >>> for peak iops by not having to replenish the pool for each batch. >>> >>> I can try and run some here too. >>> >> >> I tested the first version, but my drive is too slow, so it was only nops and >> hence no offloading. Honestly, there waren't statistically significant results. >> I'll rerun anyway. >> >> I have a plan to reuse it for a tricky optimisation, but thinking twice, I can >> just stash it until everything is done. That's not the first thing in TODO and >> will take a while. >> > > I've got numbers, but there is nothing really interesting. Throughput is > insignificantly better with the patches, but I'd need much more experiments > across reboots to confirm that. > > Let's postpone the patchset for later Sounds fine to me, no need to do it unless it's a nice cleanup, and/or provides some nice improvements. It would be great to see the splice stuff revamped, though :-) -- Jens Axboe