Received: by 2002:ac0:a5b6:0:0:0:0:0 with SMTP id m51-v6csp2279666imm; Thu, 14 Jun 2018 11:34:52 -0700 (PDT) X-Google-Smtp-Source: ADUXVKJ1FcPdfn8asqOYjfqVWLlKC1GWLLiWnM5VPOquwCPYtP83rW582eQt6Sbuju7diz3/tNJu X-Received: by 2002:a63:7b51:: with SMTP id k17-v6mr3244318pgn.55.1529001292251; Thu, 14 Jun 2018 11:34:52 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529001292; cv=none; d=google.com; s=arc-20160816; b=ibCKVSDFVk0Ak8R4muPigjwem8KYzRLV2PnA/1E5LJUVb6hL9Zahg76Yyn8cvYP3PL uGNOVvpDQf9a+Q8JDnerrHvR0EUJhKOFS1M/Lg1S2oec4yKV2Beo19dQDP/cqWtpt85r /7HKI+hetsciF2RT66zPKftfQjTvrV+sjZEvn3YZGjztgxQ5+J9z9SlikkEpNT5VHcpK q9JCr7Qi1PXaKTXaZ3cPh/cmrvG5+k6tZdDQBdihIE5o4E+hTbjxGBvwH8IFjg21bvI5 EirUxblNO/8YGsZdA/5dYLk+tlLiDOcqeeQbQnxhmJiX5AsDuRpPQrsecL/4Os1cMAmv SrGQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:user-agent:references :message-id:in-reply-to:subject:cc:to:from:date :arc-authentication-results; bh=kQ9CGQrBAfGvwAEmzqmGWZ/s3QiNWQFR53P0Ehof97I=; b=aYYgeqmwW4rghetdTwh41e7DSp2CiJhibLBVmpoQ3Z9lpN7V8x9rVGAUU8om4+8Vlm 9mcJin4C42pbH9+ywY9VuFqdWCIWpGqRuCzZjykNVZNMAKtBef3U3OpMx2A1nb8vapK9 8/M2teR7XyhHkycyzidhUVhQ6dnttpFVPSE49uxyPsHkAgObKNiqGHCthGcpy3VJHeKM KQCl2/0gLGuiXiw9wiJ6zeCdAVRHsbQAObR0ooF7hqjA6bogfYDEeF9xYoWS8e9USWpM DX8rf0RpFx/2xRtsEYVSB1Tv8R/yN214NyDhoN+G70b47fSzBsCCWU9ZImnnVATlpAN6 dcOg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id u14-v6si5932931pfa.28.2018.06.14.11.34.37; Thu, 14 Jun 2018 11:34:52 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754892AbeFNSeN (ORCPT + 99 others); Thu, 14 Jun 2018 14:34:13 -0400 Received: from mx3-rdu2.redhat.com ([66.187.233.73]:35632 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1754660AbeFNSeM (ORCPT ); Thu, 14 Jun 2018 14:34:12 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.rdu2.redhat.com [10.11.54.3]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id CD2C59BA9B; Thu, 14 Jun 2018 18:34:11 +0000 (UTC) Received: from file01.intranet.prod.int.rdu2.redhat.com (file01.intranet.prod.int.rdu2.redhat.com [10.11.5.7]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 13C1811166F2; Thu, 14 Jun 2018 18:34:07 +0000 (UTC) Received: from file01.intranet.prod.int.rdu2.redhat.com (localhost [127.0.0.1]) by file01.intranet.prod.int.rdu2.redhat.com (8.14.4/8.14.4) with ESMTP id w5EIY7ur032001; Thu, 14 Jun 2018 14:34:07 -0400 Received: from localhost (mpatocka@localhost) by file01.intranet.prod.int.rdu2.redhat.com (8.14.4/8.14.4/Submit) with ESMTP id w5EIY6Ux031997; Thu, 14 Jun 2018 14:34:06 -0400 X-Authentication-Warning: file01.intranet.prod.int.rdu2.redhat.com: mpatocka owned process doing -bs Date: Thu, 14 Jun 2018 14:34:06 -0400 (EDT) From: Mikulas Patocka X-X-Sender: mpatocka@file01.intranet.prod.int.rdu2.redhat.com To: Michal Hocko cc: jing xia , Mike Snitzer , agk@redhat.com, dm-devel@redhat.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org Subject: Re: dm bufio: Reduce dm_bufio_lock contention In-Reply-To: <20180614073153.GB9371@dhcp22.suse.cz> Message-ID: References: <1528790608-19557-1-git-send-email-jing.xia@unisoc.com> <20180612212007.GA22717@redhat.com> <20180614073153.GB9371@dhcp22.suse.cz> User-Agent: Alpine 2.02 (LRH 1266 2009-07-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Scanned-By: MIMEDefang 2.78 on 10.11.54.3 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 14 Jun 2018 18:34:11 +0000 (UTC) X-Greylist: inspected by milter-greylist-4.5.16 (mx1.redhat.com [10.11.55.1]); Thu, 14 Jun 2018 18:34:11 +0000 (UTC) for IP:'10.11.54.3' DOMAIN:'int-mx03.intmail.prod.int.rdu2.redhat.com' HELO:'smtp.corp.redhat.com' FROM:'mpatocka@redhat.com' RCPT:'' Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, 14 Jun 2018, Michal Hocko wrote: > On Thu 14-06-18 15:18:58, jing xia wrote: > [...] > > PID: 22920 TASK: ffffffc0120f1a00 CPU: 1 COMMAND: "kworker/u8:2" > > #0 [ffffffc0282af3d0] __switch_to at ffffff8008085e48 > > #1 [ffffffc0282af3f0] __schedule at ffffff8008850cc8 > > #2 [ffffffc0282af450] schedule at ffffff8008850f4c > > #3 [ffffffc0282af470] schedule_timeout at ffffff8008853a0c > > #4 [ffffffc0282af520] schedule_timeout_uninterruptible at ffffff8008853aa8 > > #5 [ffffffc0282af530] wait_iff_congested at ffffff8008181b40 > > This trace doesn't provide the full picture unfortunately. Waiting in > the direct reclaim means that the underlying bdi is congested. The real > question is why it doesn't flush IO in time. I pointed this out two years ago and you just refused to fix it: http://lkml.iu.edu/hypermail/linux/kernel/1608.1/04507.html I'm sure you'll come up with another creative excuse why GFP_NORETRY allocations need incur deliberate 100ms delays in block device drivers. Mikulas > > #6 [ffffffc0282af5b0] shrink_inactive_list at ffffff8008177c80 > > #7 [ffffffc0282af680] shrink_lruvec at ffffff8008178510 > > #8 [ffffffc0282af790] mem_cgroup_shrink_node_zone at ffffff80081793bc > > #9 [ffffffc0282af840] mem_cgroup_soft_limit_reclaim at ffffff80081b6040 > > #10 [ffffffc0282af8f0] do_try_to_free_pages at ffffff8008178b6c > > #11 [ffffffc0282af990] try_to_free_pages at ffffff8008178f3c > > #12 [ffffffc0282afa30] __perform_reclaim at ffffff8008169130 > > #13 [ffffffc0282afab0] __alloc_pages_nodemask at ffffff800816c9b8 > > #14 [ffffffc0282afbd0] __get_free_pages at ffffff800816cd6c > > #15 [ffffffc0282afbe0] alloc_buffer at ffffff8008591a94 > > #16 [ffffffc0282afc20] __bufio_new at ffffff8008592e94 > > #17 [ffffffc0282afc70] dm_bufio_prefetch at ffffff8008593198 > > #18 [ffffffc0282afd20] verity_prefetch_io at ffffff8008598384 > > #19 [ffffffc0282afd70] process_one_work at ffffff80080b5b3c > > #20 [ffffffc0282afdc0] worker_thread at ffffff80080b64fc > > #21 [ffffffc0282afe20] kthread at ffffff80080bae34 > > > > > Mikulas > > -- > Michal Hocko > SUSE Labs >