Received: by 2002:a05:7412:2a8a:b0:fc:a2b0:25d7 with SMTP id u10csp506539rdh; Wed, 7 Feb 2024 10:58:16 -0800 (PST) X-Google-Smtp-Source: AGHT+IEEkBq9NU+LfBh9Mmy6ZCoVmGhKff/HQE4viiKzHe17hDfNoBsks4cNank0NlD+fPBWdmQT X-Received: by 2002:a17:906:830d:b0:a36:5c45:1e09 with SMTP id j13-20020a170906830d00b00a365c451e09mr456380ejx.31.1707332296586; Wed, 07 Feb 2024 10:58:16 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1707332296; cv=pass; d=google.com; s=arc-20160816; b=zjN7r5YMRNBoPyuC+RCRWHwrS0h5KB3s5S7Eic708iFanIH6N1xiO29gd0dhGRE1QV yqCqzOBQUAs127NyCO9WpvT/6S4AHs65Z31Q1o2twobBh7l3GPdrXh97NWs2LNqSUGn8 ykYFvUu+u5a77vQpI5zbllsczMpLBJ0wbNSw451h+arlTp7nXy4kRdOx4zaD2Rca6+Ab ZZdGiA4nPOfR1DrWvMzf+NP0vVziW3GG01QClN4mdjuKgoJn2c5go0lDt0zswXc3plDX ynXrJOZuPHeajEs1mW6T+Rh0EXnnDOXRVJIJI4ecVZx9OzsYZJUmlqiOuh2GtDkpMjgX h95A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=in-reply-to:content-disposition:mime-version:list-unsubscribe :list-subscribe:list-id:precedence:references:message-id:subject:cc :to:from:date:sender:dkim-signature; bh=nq0e4pOcA//e/KkGEcUuu94EhWD+e4sWk9MIHyJok5U=; fh=bnLv8f7EcxjbRaAHWOnPu8lmlRtUUS1lxeFe+6N++VE=; b=BM2tbYY6CWR0qkmkYfzOTXDf6XEjOzUNJ2VLjB08/ZkCX8GmjSjLMi2b+ynglWKLtb 7Tn+QU1AqvTtJTYNx/l7U9ezbyQSLWcsst+0N4C4i4rClTo3/+uIJcgm6KCL7NrmarKk NFzMk2JExvA51uwWKWA4Z1yxCKwSv15O1/PYzWf/pGaf1ojnWIf5mUTYdEx2GS8ih/7x yFAyvbV6QtuEaPDpDvs3/od2RH0EPB1qhjBv6S6wueeZJPF99Wq7C6S9chaEtSFSc3qC ubw9ZUrTNHuKFuAV3HBKiAQvsZ/9kgyjJBYa25nyJUn7BbpHvZeq8ap5yt7RmsVtwiR9 O81A==; dara=google.com ARC-Authentication-Results: i=2; mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=jIM8ZpIc; arc=pass (i=1 spf=pass spfdomain=gmail.com dkim=pass dkdomain=gmail.com); spf=pass (google.com: domain of linux-kernel+bounces-56964-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-56964-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org X-Forwarded-Encrypted: i=2; AJvYcCUqWrrSmuOLivDm+YPGcrVFtYk2Pdex+0YKw4foRAcIZP4uJjNRHNwRUjH0T5h2oGM9JUQcmnrF81Fyy21P/ZbTJBQ6RQJWOtkwbErDZg== Return-Path: Received: from am.mirrors.kernel.org (am.mirrors.kernel.org. [147.75.80.249]) by mx.google.com with ESMTPS id kk3-20020a170907766300b00a38285ad843si1209700ejc.554.2024.02.07.10.58.16 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 07 Feb 2024 10:58:16 -0800 (PST) Received-SPF: pass (google.com: domain of linux-kernel+bounces-56964-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) client-ip=147.75.80.249; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=jIM8ZpIc; arc=pass (i=1 spf=pass spfdomain=gmail.com dkim=pass dkdomain=gmail.com); spf=pass (google.com: domain of linux-kernel+bounces-56964-linux.lists.archive=gmail.com@vger.kernel.org designates 147.75.80.249 as permitted sender) smtp.mailfrom="linux-kernel+bounces-56964-linux.lists.archive=gmail.com@vger.kernel.org"; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: from smtp.subspace.kernel.org (wormhole.subspace.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by am.mirrors.kernel.org (Postfix) with ESMTPS id 576AE1F2604A for ; Wed, 7 Feb 2024 18:58:16 +0000 (UTC) Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by smtp.subspace.kernel.org (Postfix) with ESMTP id CCBD785269; Wed, 7 Feb 2024 18:58:06 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="jIM8ZpIc" Received: from mail-pg1-f175.google.com (mail-pg1-f175.google.com [209.85.215.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 925AE84FCC; Wed, 7 Feb 2024 18:58:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.215.175 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707332286; cv=none; b=Rq4UjJU844ewQSkbnNDxBBZIxCj8Sb1oq+m/sNJfF4hllPFnqjMaYrh8k3QNhZirod7J1ZVLkjtfWNJVKZmmRsZ1R1FsNSkGMKFvinjFNmvDjXNg6C1stA9ByxVb/XlT5EZvTY9wKbzAYMKFBoh4sYItXu286wjdGzUgbRsp4Co= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1707332286; c=relaxed/simple; bh=pAOj+DSJjz+jvCbGKZ44IvbjjglxWKMYA2+il8mYawo=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=P5ZJXAxPUoIepW2pLV0VpA1xtE5wWp0fTyiDpU688JLgdk+mtAka7BBgp0A3GGRDQpK9QzaxHTCYKrTI3i+aIP0WP+rUZL4nkCLpbzFE6yQwavBYHHlfPC1UQaQXOMQaSeVtNuvPwDMRc1HbgupQ1fPNvPD+yX8GhjjdxxvsINk= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=jIM8ZpIc; arc=none smtp.client-ip=209.85.215.175 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Received: by mail-pg1-f175.google.com with SMTP id 41be03b00d2f7-5d8b519e438so821915a12.1; Wed, 07 Feb 2024 10:58:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707332284; x=1707937084; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=nq0e4pOcA//e/KkGEcUuu94EhWD+e4sWk9MIHyJok5U=; b=jIM8ZpIcVNoZ3L9flfBLte7UlQsJtdJBe85SplOGCbdZ7ajVTyPLE7FjkwniQkt13G f0Dd4Qcm71RyHrWn31P3YrNYxqtF2k8EmBUFfxmEVx96nhm+aldgT3k3DQqzuxHzBE/u ryOzqgFWQEDR3326+uqpDyyFahh7Fu0NV4gWBSEF+v8GJZi6h3/4FrdOZ7g0N9FLIMa2 PASlRdMnjlkCsXgIGQ/nhxvaMR++13kVJqNT307ExUppdnx7k3nNTNRzhD/BovOnUSmw 6JFGmcYohDkuCkUI7BMYzghCyzh7FDXp2haNXR0MH931qfrX9u/+pToZ8JtZsBQ4R83q Itaw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707332284; x=1707937084; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=nq0e4pOcA//e/KkGEcUuu94EhWD+e4sWk9MIHyJok5U=; b=BfeaIYJmTqrHzJSoxu0jjIHlq3wbGhsjjcr+Z/SXBdZYg4X5T/ktnQKA6JvWkrrkbg uIbJ8TYGCkw5e8PAcSMiDU0hbrWjk+pwfipreAMC1ar6bcnCLLNHsPZLjjTIuhXRz02s g5KDYDDGTI0l0IHYLk2vlePI3Id2BDLjtVK2uNRCGEbs9Q2SNkq6YC36nOEyrEGKszCk IZJfUMjjNM3bSPT+/o9b2CrOfrkqU7CyEGwHk3SZh/cQDRajiplhzSm8dv7c/iGYze+A Ck5x0+oJUoPtpQxvd3jRBZFZB0hpMUz8ESIJKRkV6zcy003xk0PADw2zXvvLE3ukXn2R Cqpg== X-Gm-Message-State: AOJu0Yzz6xJiWILOmHDaduM2gcmnUZZe1qIJ7LNEAYoGRCEJ5mXfu3JS 25emQC4m2gmmgJcBfAiyu3dHfx4M2b22VSAo8l9c5IHTPNr/c5K6 X-Received: by 2002:a05:6a20:e115:b0:19c:6a60:b433 with SMTP id kr21-20020a056a20e11500b0019c6a60b433mr6774647pzb.3.1707332283658; Wed, 07 Feb 2024 10:58:03 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCWYuIp9BWufSitnIyIH4En+BA2qY7vSL4td8JDn4aiFmRGgjot/RSULtT7k/Qkvi9ei3uqUbAaBcfR5tRF0kTpUuID7lLqJH0FlPyEeXUnrLUlaRaA0L8m1ntPvwljRgOHp2unUl7Y0rfKs3UD8AsiBblTlEjMyFd/id75DwqTdj54ZYyAobf7hR8+V6x/DRigcFnS09vLtx6RfQp7lH7n8AVpDQtpBYQ0hsOZsAdFQdDt2vx819zc0o+n78DNtg7NwRzgmCGidM+b4zTCmNhjnay+e4Yhrr21bvR5SjXH7Time5rpFw91/etESICon0Q/iQs/tNjJH1EXYiAsY1YJPSa0XpSCirC3b393y0/N98+/j/ljLVVRbmnxrDdM= Received: from localhost ([2620:10d:c090:400::4:3c45]) by smtp.gmail.com with ESMTPSA id m4-20020a632604000000b005dbe22202fbsm1984724pgm.42.2024.02.07.10.58.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 07 Feb 2024 10:58:03 -0800 (PST) Sender: Tejun Heo Date: Wed, 7 Feb 2024 08:58:01 -1000 From: Tejun Heo To: Marek Szyprowski Cc: "Rafael J. Wysocki" , "Rafael J. Wysocki" , Linux PM , Ulf Hansson , Nathan Chancellor , LKML , Stanislaw Gruszka , Lai Jiangshan , Naohiro.Aota@wdc.com, kernel-team@meta.com Subject: Re: [PATCH v1] PM: sleep: Restore asynchronous device resume optimization Message-ID: References: <10423008.nUPlyArG6x@kreacher> <708a65cc-79ec-44a6-8454-a93d0f3114c3@samsung.com> <4a043533-009f-4db9-b107-c8374be28d2b@samsung.com> <2f125955-8c7c-465c-938c-8768f7ca360b@samsung.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <2f125955-8c7c-465c-938c-8768f7ca360b@samsung.com> On Wed, Feb 07, 2024 at 07:55:51PM +0100, Marek Szyprowski wrote: > On 07.02.2024 17:39, Tejun Heo wrote: > > On Wed, Feb 07, 2024 at 12:25:46PM +0100, Rafael J. Wysocki wrote: > >> The other one is that what happens during async resume does not meet > >> the assumptions of commit 5797b1c18919 (for example, it can easily > >> produce a chain of interdependent work items longer than 8) and so it > >> breaks things. > > Ah, that's fascinating. But aren't CPUs all brought up online before devices > > are resumed? If so, the max_active should already be way higher than the > > WQ_DFL_MIN_ACTIVE. Also, are these multi node NUMA machines? Otherwise, it > > really shouldn't affect anything. One easy way to verify would be just > > bumping up WQ_DFL_MIN_ACTIVE and see what happens. > > I've increased WQ_DFL_MIN_ACTIVE from 8 to 32 and all the system > suspend/resume issues went away. :) Ah, okay, that's surprising. Lemme look at the code again. I gotta be missing something. Thanks. -- tejun