Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754449AbcKUNNS (ORCPT ); Mon, 21 Nov 2016 08:13:18 -0500 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:48884 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753966AbcKUNNQ (ORCPT ); Mon, 21 Nov 2016 08:13:16 -0500 Subject: Re: [PATCH] mm: don't cap request size based on read-ahead setting To: Hillf Danton , References: <1479498073-8657-1-git-send-email-axboe@fb.com> <00f001d243b1$f489a720$dd9cf560$@alibaba-inc.com> CC: , , , From: Jens Axboe Message-ID: <2c4651e5-dcab-6cda-cc8c-ad0b9350a240@fb.com> Date: Mon, 21 Nov 2016 06:12:56 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <00f001d243b1$f489a720$dd9cf560$@alibaba-inc.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [66.29.164.166] X-ClientProxiedBy: BN6PR03CA0023.namprd03.prod.outlook.com (10.168.230.161) To BN6PR15MB1188.namprd15.prod.outlook.com (10.172.205.142) X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;2:ThRwsWEuqPCnjuDZXhNFMCwo24OsSBwu8yLPg0tf6v85ILVF8KwuUFIhOaZQxuSmCJ3bmNM/nPAQ0iutFnCaTEHlYZGvwmNi6oyyTFcIpcxY0tpjJTC4mnve/QSh1KxyX9Do1dC0MtFM8I9361yN9sWO1AaPstJ2FrdUO97Pf4o=;3:eYC2yE6gIyIg1WiW13gGn8mX9DtEscaCbcyAFbZWc1a5ihbeLKgoZdo8fgxronVne326YG6askFlgAUgBMwS+8wB+jnHP8dc2zYj48o81vunDkJv6E6jnCUhPQ7jWT99PVox0nJ8JsKovCUxv+dg9kmRxVGJ+tSrwv6WOuqmMqw= X-MS-Office365-Filtering-Correlation-Id: ec6be0b6-12bf-4ad1-7c02-08d412101f0b X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:BN6PR15MB1188; X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;25:RXNifnbXmJH8Z5gLvLAJFulopOHJBmhJPEuHgytpvrpr1vxpN/E4819Oe2pYTYcDw7Gi5APdmLk+i4kqAvOL27fXuj3NvJAF9qFh1gXtwsAxa15a/I79bbP8mjeovugiPTUhEsX82vWahUrDaADlOSKbENz1+3VOFtrV4R4xX7P84iOd7zWWY/L4ZMODxqoHrswHYZ646xoojZxlnqZ6t1IwEDAM8xPcSlMrbZrNzmx6cJKd1JHIOo5q+PQU4TeCyBC+CLwEX4x/3ZsUtnzFPOdQoUFPx0mAaHqE77OPDLhrHTdJ+hZ8MaoqJjYOZu1IB97l2qYzODiH74UVO7lyh2MW9HZhsqSBrUY+suknRNo1DeH9PyRIZLRiswjaSgCT4hc0J8ZIkhnHh8B5phQVegJ1YKspmjsUK6UCQphOONlXfPtsDVdgalnxr0K1KbRTYJe7qmzUwB8r92e/wMBJ3gWIhT/n0pTrOKIDA72U99osM6xsge02PnLjMT55Ag6X5SWfqfowo0enao99rxtjYWBCsRPK6ZBFNbLyGk1EQp5BRLZBEOSqJ9kR/zpFzt7yGyyLC36RoNGpogimgMSpX4exnccEK/M8gkt4OBJjtNMd1Mq5lwnudp/st5zzsmXWwv7ZvmmKhFn7NPBnYIC5HCwvztRzulVGSgBfIJopyzMX1nTtQ44z0zrMepRXiTgnHqOzlw/S7F8pDCWI+fBtEwdpkTj1gNodtWAblnbTAGwhU/G67usM21J4l2mLGSnMa+fTZpjfdBgpjyUW+5iKUQ== X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;31:m/q6SZm9k5VeY4Yj5aHpG/usT/V4ToGfmEjDly4zRYbbjWbZb8JS/GBcj4vfka5yZfTsSAkxepBT1NULvy8ezf4X3UEbCqIp1NGTIyBStJlrhiTc8esQzDPFwDQAf1GkiFqXsVfcZOQScQIzUin+t/sbE8bUfkazoT/J+l5aNjsK+Np785ZRBbwDQJPYCPepk38CiIpz3TGybZJdtDRl/0Ps9evyZkKKjFTc6/bJ2ROLlJXmTwE7NNRI0cxzfeHHKqQu+B1lXKSJ4rdSpb46whouJnuGxHAYOeUzBCvLYFg=;20:t2BE9VvvdOSA0UbkjyTWBtdQ8Uff5C6PDHD5ciX8SoS4KKlg7QWzt+VxBQy6c40Lal71zmjOWZHyTFxqPHKwO+H2arSrQc9ErwTle7/DHJ7BhqW9k3FGGsvSSZWCXy3pHlhF5eerh/06HSgYcXKUE46iV233jj9PW9s2uvCb904ptl7hN9CSARoecXNPS3LPqCTGEw8XZinrI1mTfE0hUZ4FVllcfskbcY5Sb4ya02ao+gpBVOysFDEPkbLtw7QR X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6060326)(6040307)(6045199)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6061324)(6041248);SRVR:BN6PR15MB1188;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1188; X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;4:6CseTyYbKp+LQH4mrdtowE+ALtj3edD5InA8ph3cc1JHRojgUVtjO9+V4x6W+ICE/8h/bFwmdl4r39GkVeeQLBWFz1axkKgwUA7UAjNwaRMN5BAjovxhozT4ylMvdujPvODRob2nNzIplq437t8fj9FYzRX+Mgzb+QlDE9yf0WD6xz8QY8brz2UgmJbn/2v2A4NBvY/GiWIlmasb/TorGKkDDY7LeywqR5zPP80Hd5kQDjnZbaTfMnGF/G90fZmNWT1CGnj2K9WVNV9MICyt43bkN8KJhezGSC5Pliiu+8GoVO4Fq2c+CKPPTAmHlf4kIdI8i2u3tEaB96R1rMzM4c6sSJwPz+HsWZVEAwww6O1SEvFAoIxXtg9EntJsdR1FY7wbaA7Wq2u8oCPA6pn4HeUKEhfeMADFmndNgPWenYH8P95QqfGHGkM12q7teqMJZgRvIRE2jLZpHyCcDuw0ZQ5V95HP2OFnh2nB5l02B/I= X-Forefront-PRVS: 01334458E5 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6049001)(6009001)(7916002)(377454003)(189002)(24454002)(199003)(305945005)(42186005)(47776003)(65806001)(66066001)(65956001)(8676002)(83506001)(77096005)(105586002)(117156001)(31686004)(64126003)(38730400001)(33646002)(106356001)(229853002)(4001350100001)(50466002)(189998001)(7846002)(230700001)(7736002)(5001770100001)(92566002)(97736004)(101416001)(68736007)(5660300001)(2906002)(54356999)(50986999)(76176999)(86362001)(81166006)(81156014)(6666003)(4326007)(65826007)(23746002)(31696002)(36756003)(3846002)(6116002)(2950100002);DIR:OUT;SFP:1102;SCL:1;SRVR:BN6PR15MB1188;H:[192.168.1.176];FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BN6PR15MB1188;23:RTzcZKlp3d7ZGA12D3LE9t8iOPAec2Taok4+k?= =?Windows-1252?Q?ebtzAPCTZaTMZT/wGmRRjLoT8kycXX8Sbl66F6LQ158VhCeunEWJpHXk?= =?Windows-1252?Q?gjCEvAmYm+lWhpCnVm6GhsdpRy+iRHOHzMT688BRcD69MHF0oJTjQcOV?= =?Windows-1252?Q?6SClUFIqfCUTUGe/oxPhitWZe4mO/ENM3cJqbEAO39//lPh90wqy9Zdk?= =?Windows-1252?Q?T3u++ZRnxGJrX5uv1X8dpmT8z+5KjUnNZ3tpJduwpB4v+eNVCrg2QRGB?= =?Windows-1252?Q?aaFAMgBf25yD1rcraiW8nLduDd+JiAjJdDUHftFsDiStBi7HRpVg0F5X?= =?Windows-1252?Q?ZC7IpK4ij/PtM/RvDK6Zpw2P9e1X65VAceu8IGhRlPwzyrlpP2MZASiJ?= =?Windows-1252?Q?hiMKk2GABk8PiWcza5KH0nCkYB72pEedA0L7vqBSPK/7MTGQqH0fRu25?= =?Windows-1252?Q?E0kGNn3JufCrLxL1PZ1btMi+hsF1ux0Dd/yPO5DZau5tBRS2Fer2mFAZ?= =?Windows-1252?Q?WJVOZUhhyIQPVJe0iywBo975qKjORcmpbNkVTRcyrPv3WWw8eREbbV33?= =?Windows-1252?Q?xcit5BJuVdl4WxpEl1C0MyN2h46+/toXdOmrHYNuT5TWcgR60qz4TKCI?= =?Windows-1252?Q?5nf6c0BgryphfjOe7YUEuBDlUqPNcq/xfsVKlNns2BmEpK2zUeFgtFUL?= =?Windows-1252?Q?Nde9y+/L1xsmKsSkFo5CuXssM/gKTmLWG73sbfCJR1hWCQRZyMrVRx2T?= =?Windows-1252?Q?OV2L7S9V+uic31tKJzxN/rHaaZHOgQ7yE3U1ZeZRabCHPnmcqnsqBslP?= =?Windows-1252?Q?wGWEB+ZrIUukTpQ9HIuSURLot2l0m2ADluhlRcPDlzOKh5aUOa2lSofX?= =?Windows-1252?Q?oRWlN267ztehyIh7b0F798FUsPHh0nmK4vBnoH50L+rOR/4Gywf3pgYd?= =?Windows-1252?Q?j4Ut0nU1KUTCjsFmXPW9gFmd/izACkp7Fa+mz6uc55a4fNff4lvP+Yyg?= =?Windows-1252?Q?F8JcY60J1BzrEhOK4I34FUvFcALeVhm5iYwXnVjKXkLGZr2NJBoIWIke?= =?Windows-1252?Q?3Pgb03HDhx9/MkTFuAct+CwKCaOFDpcs7WbX1nsvjn674geaz1VfK8+W?= =?Windows-1252?Q?UCPWIx9hgaX7D85/OOb/rDqmine/11O688ek/oqNrDzcPv11mb25kI41?= =?Windows-1252?Q?ywJQwn9MqcKdN1FGisraVlG5hNFfA1pDQJ4VCwrc30anAoi6VXcobqcT?= =?Windows-1252?Q?Q9Vr9CMq4DamXt/bP3gHTJchBot49SywtIaBwvU4yugjuyW3LAu0Hi1u?= =?Windows-1252?Q?15EJMXjiQbkqqe6uN+jQLmTdAReegAUeAprAgbz3C0KgJUARPZLzoSgi?= =?Windows-1252?Q?rW3JkioVsoyncShvTrZqgPL/EoJPhhZ5ewP6SnX5n27WYHxHGhL6KQ?= =?Windows-1252?Q?=3D?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;6:XGA1o9ESjupCJIGNqS0Yew1BFKRZ0tpsY7yu3sjzJ09lAPHd8k2mrEtPgBKGRDzswrVulFagIPJY13k7gx10nIYXLiWKYq/lv+tLa6iZ6+FMoJCqBcKOJfG5vigfZHwYrdSnPtLcDATa0//iwf/66HjUegUXV1FnbJfBHiyrKI3fdIxeYv4t7Jx0F8HbTGu7lL4bA8c9K2/gCVnaCaRbhRDoWb3j/2ji/L8X5HwWqvlq3ZCoe8demsoINfk9PXQBPvQaCL/r0Gjrul6j5GVgUsymtQSxczH7tUwJwdQtFcuvufYTIXbUis6JVSwXT9SylSPLZF0Z7VBf+H0g5yk96YaE7RNATuL2XRSRuUT2uAE=;5:h+8ViRo5kH+qj6Dc4xv+Jhha3PSf9MsRekcJO5D2ChdlSQyk10nbVi3I0gFa+Ejp+SqPFnMrcyS4tVmBvWwWlUNxR+5ELyOJESpIiebIxGp9u/TDeJ2wKSBqftBSm1+LwJlQmzKFUq37CIzKvnxDlg==;24:lIONoH6HtM8ZHI2gs2V8ruNr6GW8zZtmLx+W3WnWo0Zjxu/fz6PVjePi8QBxP8x0XJC2v07+e2rgaekcbF/5Vr9FvECGmLY/jFulgx8JCjw= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;7:RTOMXo3OGsxn6vGezsclryN4f21SRDKFTJYlIemN2x6CYrodxrmIfmWMpJwqidBEvI4rldNCF2CJtL7pyUl6VJ1fbRTYg/U3vE1Swdf8l4hBr72K1flVBKAooE7tf12a3UfaeZfoGOiTWjagukF90q9h3NmlwsFkoZ18thYpLJjMQZmdC2lhO/kEfnFfCuB5FckESN0PYovdFi6uZWFa2emPBznjJEktTsutdIfeM8fc9Tn1+u6wdcH+b38wDWoImXad0AQ2EHwg3puOdls+zaSATj89kEqbRgvQA6P3OoqtAXSF40gtMLroiYkEOAp7E5PoBaQUafYnEPP0eSOZ+87pL6rCoybsWoNgt2359/w=;20:auOwpq1fk0fvbr8zsNBxr/iNiMZLCLFU2+4JM5hpme+FqbHzku+qp+lLnLA9uddkzVPkKWTtSop62EzQyxtXD/jGQpTlUmSlEJkidwI0Us2r+FR26O9nWi6DNaTMgGUf0w9bXUfpxqdq0fTYa1X6c61Ff8x+C+/KwvGBqUv0s8E= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2016 13:13:00.7338 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR15MB1188 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-11-21_10:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 1070 Lines: 27 On 11/20/2016 09:44 PM, Hillf Danton wrote: > On Saturday, November 19, 2016 3:41 AM Jens Axboe wrote: >> We ran into a funky issue, where someone doing 256K buffered reads saw >> 128K requests at the device level. Turns out it is read-ahead capping >> the request size, since we use 128K as the default setting. This doesn't >> make a lot of sense - if someone is issuing 256K reads, they should see >> 256K reads, regardless of the read-ahead setting, if the underlying >> device can support a 256K read in a single command. >> > Is it also making any sense to see 4M reads to meet 4M requests if > the underlying device can support 4M IO? Depends on the device, but yes. Big raid set? You definitely want larger requests. Which is why we have the distinction between max hardware and kernel IO size. By default we limit the soft IO size to 1280k for a block device. See also: commit d2be537c3ba3568acd79cd178327b842e60d035e Author: Jeff Moyer Date: Thu Aug 13 14:57:57 2015 -0400 block: bump BLK_DEF_MAX_SECTORS to 2560 -- Jens Axboe