Received: by 2002:a25:683:0:0:0:0:0 with SMTP id 125csp2503224ybg; Fri, 5 Jun 2020 15:51:54 -0700 (PDT) X-Google-Smtp-Source: ABdhPJz1Myo/8nYOyxZMBY3B4N5iXnjA/R+qRNIy6XF/l+6Q6ByikZrJuoHjhPcoEvtZczXrK8BG X-Received: by 2002:a50:b082:: with SMTP id j2mr11624368edd.201.1591397514443; Fri, 05 Jun 2020 15:51:54 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1591397514; cv=none; d=google.com; s=arc-20160816; b=W0f5LnrVyt5YH1U+EX+FtgClU2x4hhb4KKwKkMaabRyPR6/2tzkyl6QpdeF+47eUD/ YpyVMgI+JSOI7tjf1M5+jyGC50Sq9KGZxIvnrJUvgV3igZknpr/EeG14Lh1TzRc2GXsk 4ZUPVMom4woNEdYI6W9VCSQ0po5djZNh4H73v5BPFX0Rx6gKtNg4DNdcqu4YFnX6isxZ 7InITryc5AJPKiWdF77ylysO76QV7+MyUJJR9JWLjcL+CcCD/Jj1qCIGHLZa79epmjhF ddFgKLi9arYe1Ziwq+8cMvNcPZ62injNikQcGC8JkWeJpEvFt3+JuoODHLDt5gYR00Mg /9cA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=FsXyHeejFFCHLuSs92j2aDN2Io/JQ2E6kep2zpjuyz8=; b=jN+wEB4Jov2KieOUxszisYbSJbKP30UbwtuWxmMu7PGc51RpggVj+dZYB9DkP7SBX3 ZuGzfe+QdJkvqLYjD47pObL7C73ZKHzMXERmOFOzA7GA7QquLMP9sLpIvR3j3EsdJ0yr ap22SgfZ318E9F0LIz3omV4sCeTbG0kMK+zH/k2UR+7DNJi02EI5o6Dmkt6TFwuHZQBx YraJXolflJ4C5N6zK9/EZKBWP8GLWC4ZSUMT/Q71YL8dDhgXbeJ9HrwJtvSSb2G9uzoV IqASD/G2xdq2QjH5THE5SQjOfFdacL64VnKu/GIIUVh95gA63/PRT0jmCYu/wt8+xFGw 5BkA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=StWmTEru; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [23.128.96.18]) by mx.google.com with ESMTP id 89si4272557edo.209.2020.06.05.15.51.31; Fri, 05 Jun 2020 15:51:54 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) client-ip=23.128.96.18; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=StWmTEru; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 23.128.96.18 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728347AbgFEWt2 (ORCPT + 99 others); Fri, 5 Jun 2020 18:49:28 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:44622 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728013AbgFEWt2 (ORCPT ); Fri, 5 Jun 2020 18:49:28 -0400 Received: from mail-pj1-x1044.google.com (mail-pj1-x1044.google.com [IPv6:2607:f8b0:4864:20::1044]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 5503EC08C5C4 for ; Fri, 5 Jun 2020 15:49:28 -0700 (PDT) Received: by mail-pj1-x1044.google.com with SMTP id k2so3240420pjs.2 for ; Fri, 05 Jun 2020 15:49:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=FsXyHeejFFCHLuSs92j2aDN2Io/JQ2E6kep2zpjuyz8=; b=StWmTEruf+tFcVK0xLcr4hcabCL/ilrkqMd+zy3U8C3YcQv/1hHn9cfosi48b/3sSa OcQAJtJA92CboLd0FTNyRubN9nyufg9mcY/c6CmuLOLKq7lvQa+w56iaoeHs9R3CASm2 lxao6pqS/3p5G5EVj4JbsV3Ax5arLcKw3KkwwJvGYUgXXmZ5zYG9QYKegfoNfwcTr8+U aJnJLnPAZK/ph6SwL/F7UuAv56biUpB7ZXn7P46gU883uewb/PCstGhEa0U6XlLV2yzl lm68FFscv7V2cldH7qV9t8a8C9QJ5rHH/o17pFLTPdIoiXh4+3ZRqismCYIzPFCvhMwv xmtQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=FsXyHeejFFCHLuSs92j2aDN2Io/JQ2E6kep2zpjuyz8=; b=r+58fbPkwPzyToyjatqSyhdFJZIG3eOD72yNCOoMqr1JpXy5mPaLPSJtFm9G9IY8td XX2QgIjduphRNPOjPJkrCBeh4UVWaUolyFKPjM4HwymBfvlh4IdpLsRaCl+TznGYWAFF 0H7eGuqggISJ0ZfdRNiJhj1O4Z35TypuKwlcYsvT2NmIUu7J5HjOWaSF+a1d39cRweK0 zVNQuitJeDdKlRxeTh5cAKpZde9x9YC169cg5LUr8kobfQpeM7bzyEdSLeB6Qux6+qTb OK0D0vV+piGBDEnJX5lE1qU1WLDZM6CCRf/5fm4vWzYuVrP9wyjLJoRdl1LSus3XKYpt xB9Q== X-Gm-Message-State: AOAM531y5nNKJP+XsRRDLC74x8nsiPEvzrDZvkx+W5wup3YkTPee5fVv YbVtVDyyPwI/Vc3dcYpuZWVf5g== X-Received: by 2002:a17:90a:c717:: with SMTP id o23mr5384687pjt.195.1591397367704; Fri, 05 Jun 2020 15:49:27 -0700 (PDT) Received: from [192.168.1.188] ([66.219.217.173]) by smtp.gmail.com with ESMTPSA id q185sm549854pfb.82.2020.06.05.15.49.26 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 05 Jun 2020 15:49:27 -0700 (PDT) Subject: Re: [PATCHSET v5 0/12] Add support for async buffered reads To: Andres Freund Cc: io-uring@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, akpm@linux-foundation.org References: <20200526195123.29053-1-axboe@kernel.dk> <20200604005916.niy2mejjcsx4sv6t@alap3.anarazel.de> <6eeff14f-befc-a5cc-08da-cb77f811fbdf@kernel.dk> <20200605202028.d57nklzpeolukni7@alap3.anarazel.de> <20200605203613.ogfilu2edcsfpme4@alap3.anarazel.de> <75bfe993-008d-71ce-7637-369f130bd984@kernel.dk> <3539a454-5321-0bdc-b59c-06f60cc64b56@kernel.dk> <34aadc75-5b8a-331e-e149-45e1547b543e@kernel.dk> <20200605223044.tnh7qsox7zg5uk53@alap3.anarazel.de> <20200605223635.6xesl7u4lxszvico@alap3.anarazel.de> From: Jens Axboe Message-ID: <0e5b7a2d-eb0e-16e6-cc9f-c2ca5fe8cb92@kernel.dk> Date: Fri, 5 Jun 2020 16:49:24 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <20200605223635.6xesl7u4lxszvico@alap3.anarazel.de> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 6/5/20 4:36 PM, Andres Freund wrote: > Hi, > > On 2020-06-05 15:30:44 -0700, Andres Freund wrote: >> On 2020-06-05 15:21:34 -0600, Jens Axboe wrote: >>>>> I can reproduce this, and I see what it is. I'll send out a patch soonish. >>>> >>>> Thinko, can you try with this on top? >>> >>> Sorry that was incomplete, please use this one! >> >> That seems to fix it! Yay. >> >> >> Bulk buffered reads somehow don't quite seem to be performing that well >> though, looking into it. Could be on the pg side too. > > While looking into that, I played with setting > /sys//queue/read_ahead_kb to 0 and noticed that seems to result in > all/most IO done in workers. Is that to be expected? Yes that's expected, if we have to fallback to ->readpage(), then it'll go to a worker. read-ahead is what drives the async nature of it, as we issue the range (plus more, depending on RA window) as read-ahead for the normal read, then wait for it. -- Jens Axboe