Received: by 2002:a25:31c3:0:0:0:0:0 with SMTP id x186csp3695483ybx; Sat, 9 Nov 2019 02:10:38 -0800 (PST) X-Google-Smtp-Source: APXvYqxdBFpyk8yn2maXf9YEEUdfx/vl74RYTtZVG8ouGj/ZTpee0KKnnLsxIheEntuo3Fq0GS2u X-Received: by 2002:a05:6402:1b04:: with SMTP id by4mr15513928edb.218.1573294238474; Sat, 09 Nov 2019 02:10:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1573294238; cv=none; d=google.com; s=arc-20160816; b=BaHYYo7IClXQPCz6fDdp/to35Yi49AMh8LMiw+mnTod+iLvEOHqaExuZkdZPtOmGEZ /Tnh6Qp27LMf629JpS09NzHLEIp+FXo4q8pE3/venZG8xfAbo3SagorDUx3o32OgMTaR jE6l5J9+bWY0H2Yg06rEeRsOO2nMNwpJxyhf1U5a0MMEnJ/uPNj6Jik14BgcZ1b8EsQU 1aw0YTya2g43L/Iw53GYgsCFxm5czpUZUdkbiiTIje6DZpfa2wOZOEFQ7I3OMBaa5rWs xfANGkE6wukY4cixuoQ11GnwhiA8+pGJajOduTLW+nx53PWxqgmHd8WHQVMuTwy9SKcI 2zjw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-disposition :content-transfer-encoding:user-agent:in-reply-to:mime-version :references:message-id:subject:cc:to:from:date:dkim-signature; bh=COvRkfB7QtwqnVTHt3MVS0PoIAM0aB4odeSnRONVuV8=; b=a+mjjXCOfhjUi51KYEl4i7xdHXi9J7BJvyv2ZSBZ6IDJJnCy8Cbenb+YXZuIIvRIW+ ERhnb7oCEkE3qvtv7PJrNniN3ERmHDnbqaMrslsxE5OemGbRR76fsljTfyHJCELzJDj7 y8D+COpei4tMza+kozU80xwWfE5jhmlj85Mnr9D3jGdnzItlW+H+wt6ToMc6T+4cugy3 g8473mmgtkyijydyHbGHBRcEDicn/x9FhjrMtNHYmDftUnlZnbPRdahmKfCRZl663ZS+ 2xfX9El1xLLAGDQ7b+RkkAY+E1eRsxvodPr/O9AZGukE2dJCpXrcFBa/UDNGLm6aEYAm yEzA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="a/dnkGGX"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f13si6503393eda.288.2019.11.09.02.10.14; Sat, 09 Nov 2019 02:10:38 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b="a/dnkGGX"; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726405AbfKIKJa (ORCPT + 99 others); Sat, 9 Nov 2019 05:09:30 -0500 Received: from us-smtp-delivery-1.mimecast.com ([205.139.110.120]:45658 "EHLO us-smtp-1.mimecast.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726275AbfKIKJ3 (ORCPT ); Sat, 9 Nov 2019 05:09:29 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1573294166; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=COvRkfB7QtwqnVTHt3MVS0PoIAM0aB4odeSnRONVuV8=; b=a/dnkGGXeDohiETrWs6K8iDPIyzoUiDM9EwW51XGixdyOVzS6OMbbL/0rT+QCc0uav8fdM aiYC/eUo+0buaZbqUkmlDvfkvsfFDbkFzfC6KJpRPXhWNA9CNYgBCnwQt5vvUTpQu9nMOr ejQvUzMWd1k7lqS++fo6XLXHMfUJTpM= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-338-Hi_ndLc_MxiC1ic0MmTclQ-1; Sat, 09 Nov 2019 05:09:24 -0500 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id BCE591800D7D; Sat, 9 Nov 2019 10:09:22 +0000 (UTC) Received: from ming.t460p (ovpn-8-23.pek2.redhat.com [10.72.8.23]) by smtp.corp.redhat.com (Postfix) with ESMTPS id F31EA5D9E2; Sat, 9 Nov 2019 10:09:09 +0000 (UTC) Date: Sat, 9 Nov 2019 18:09:03 +0800 From: Ming Lei To: Damien Le Moal Cc: Andrea Vai , Alan Stern , Jens Axboe , Johannes Thumshirn , USB list , SCSI development list , Himanshu Madhani , Hannes Reinecke , Omar Sandoval , "Martin K. Petersen" , Greg KH , Hans Holmberg , Kernel development list Subject: Re: Slow I/O on USB media after commit f664a3cc17b7d0a2bc3b3ab96181e1029b0ec0e6 Message-ID: <20191109100903.GA7696@ming.t460p> References: MIME-Version: 1.0 In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-MC-Unique: Hi_ndLc_MxiC1ic0MmTclQ-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Nov 08, 2019 at 08:42:53AM +0000, Damien Le Moal wrote: > On 2019/11/08 4:00, Andrea Vai wrote: > > [Sorry for the duplicate message, it didn't reach the lists due to > > html formatting] > > Il giorno gio 7 nov 2019 alle ore 08:54 Damien Le Moal > > ha scritto: > >> > >> On 2019/11/07 16:04, Andrea Vai wrote: > >>> Il giorno mer, 06/11/2019 alle 22.13 +0000, Damien Le Moal ha scritto= : > >>>> > >>>> > >>>> Please simply try your write tests after doing this: > >>>> > >>>> echo mq-deadline > /sys/block/ >>>> disk>/queue/scheduler > >>>> > >>>> And confirm that mq-deadline is selected with: > >>>> > >>>> cat /sys/block//queue/scheduler > >>>> [mq-deadline] kyber bfq none > >>> > >>> ok, which kernel should I test with this: the fresh git cloned, or th= e > >>> one just patched with Alan's patch, or doesn't matter which one? > >> > >> Probably all of them to see if there are any differences. > >=20 > > with both kernels, the output of > > cat /sys/block/sdh/queue/schedule > >=20 > > already contains [mq-deadline]: is it correct to assume that the echo > > command and the subsequent testing is useless? What to do now? >=20 > Probably, yes. Have you obtained a blktrace of the workload during these > tests ? Any significant difference in the IO pattern (IO size and > randomness) and IO timing (any device idle time where the device has no > command to process) ? Asking because the problem may be above the block > layer, with the file system for instance. You may get the IO pattern via the previous trace=20 https://lore.kernel.org/linux-usb/20190710024439.GA2621@ming.t460p/ IMO, if it is related write order, one possibility could be that the queue lock is killed in .make_request_fn(). Thanks, Ming