Received: by 2002:a25:7ec1:0:0:0:0:0 with SMTP id z184csp74265ybc; Mon, 18 Nov 2019 20:36:28 -0800 (PST) X-Google-Smtp-Source: APXvYqx09tA3YJIFjHDZGmKA2HGVfcZs6tflJf5RaiKV2XveNc+/1JBBmeMmZi+8H7jN0g/mrcBA X-Received: by 2002:a17:906:7c5:: with SMTP id m5mr31719915ejc.231.1574138188816; Mon, 18 Nov 2019 20:36:28 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1574138188; cv=none; d=google.com; s=arc-20160816; b=GMMXmTJp9SgWyyxb0rlRPcnaCYo4uxLNEDZ6WTX4dn+VJLxreaN88c0AInfZ8Mv3PO jA5VEycFeCNtOTEWTrQur7H6rPg3BnO4Cuk2cql0cjlqRwoeEXSfEpROXdOeqcpzb333 AbYsd9iA9Vn7AzHL4z8WfehBEMQK7a3yKuDfpRBVP28VIITkSwkC/h6DFF2AaRFSojwp YJ03r69spPIRrZI19MOmHU6hNsF/4sLmSwwXLkdfhHSnz2sqiKj0m72snl9uXFfbjDye GgQOEVhdovoZQ5IXc2bHT59Cz75j29gnWHOi41X1RcnR1uxOJgz4ZwX7FsOASlxjI2pG MNkQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:references:cc:to:from:subject:dkim-signature; bh=rkdEpR62sDVJxgsklhz1UnFEmVbcNibLh8/QnTcfFDc=; b=wWWm11IH8IKZEolfpxNUFaq6HU4W+yuxvMf7mmzeBMMfir8G65uzCw5vI+XN4mTSgC lAgERsr7QbLyAYyjFX9TsLWPpxqn+9Emh/58zA4J+38/BFq+4KBXjvCYHErjvzDiQ+wn iH9Aks31VWQHdKHk8MrMtlJ5A5csaDWm/fxNQWUa4HXTh9ieianuUqbujPZ3+WHhdFVW Xia4MXUgtAXypF6VqptRtpeueHbK0t+Mmj7IcZ84vf9c/e6Do5D5K9yMnNqJlBl88Fyz 7ss9oQ3rpZf/Gx+9YrAUIYO3CYHvJ6+e/2b1G8n4L4oLVEiwjPfaugxDTUcupUwR+SgJ Sv0g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=QxRyOWEA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id f25si13045476ejw.85.2019.11.18.20.36.05; Mon, 18 Nov 2019 20:36:28 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@kernel-dk.20150623.gappssmtp.com header.s=20150623 header.b=QxRyOWEA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727582AbfKSEe2 (ORCPT + 99 others); Mon, 18 Nov 2019 23:34:28 -0500 Received: from mail-pl1-f169.google.com ([209.85.214.169]:42667 "EHLO mail-pl1-f169.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727217AbfKSEe2 (ORCPT ); Mon, 18 Nov 2019 23:34:28 -0500 Received: by mail-pl1-f169.google.com with SMTP id j12so11033411plt.9 for ; Mon, 18 Nov 2019 20:34:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20150623.gappssmtp.com; s=20150623; h=subject:from:to:cc:references:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=rkdEpR62sDVJxgsklhz1UnFEmVbcNibLh8/QnTcfFDc=; b=QxRyOWEATY2cC2tVR5io3QZcV+0POPsUjI9K7u3AsC/BnxcStwWEfJUlXHl0Vi791Q Io6aVIdnaAJRnpxHlJEpBsiNM58/23Ti/xY5Ge5bZp80Z0bCNHXJtcFtHdbiDZenPI09 PKFZNRtVzPyhTH/hzpAn0eFyDgIcZyTbRgiMdIYuOqaMSVnEoyAlU5RDlhVmnlGGLMAW j2nw7EU7CUklvXki/4UaU2nPoGgjr+laZc020JOvx3acdSInUg46Qu6OC5UXAJF9LXdS kmSfLrmPjbYJBiFx0vHl43XvtDqbJEVpR8AGeGRQbXBHGq41ywd0nP0brZuC6EyE47IC brHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=rkdEpR62sDVJxgsklhz1UnFEmVbcNibLh8/QnTcfFDc=; b=Eo6wa6/eB38fLarUVIh+aiYIZk840utHp0RrjTxycPKVj+hhuITJ1BpG9+KATQKFSV I1haVqBgHTQZ3k6AcHLRczIaneNfKuDoENrSKrdI4Ky2PFCMv7cXvR+jfgIDyEZ8EOcm osWPOS93vpyyA8vi+nFFM2sCZ6trE9VhRAIWUHnKyagXzVxvVavNkKle/lD9U050SDIv nzlI4DI8RnekiYk00QCJcScMjsI6af/TXil7MFXw54ZTBnJVD26UBCIcH/JoL3iyhNDZ IIJj0rRCWqiY5fw9rVx4xw0qY1Vr0rHozRl9zu7lVqJX4pjRLdQysIOxREMJ/3oeNVwm +ZrQ== X-Gm-Message-State: APjAAAXIcD+/OCfzzyIZ1qF1ml5GqQoQvCjdRjnTSeGDjSIfxgvikikC yTrdOlBqm1xyfwDiPhFZnkPUAg== X-Received: by 2002:a17:90a:22a6:: with SMTP id s35mr3454079pjc.3.1574138067544; Mon, 18 Nov 2019 20:34:27 -0800 (PST) Received: from [192.168.1.188] ([66.219.217.79]) by smtp.gmail.com with ESMTPSA id s2sm21838748pgv.48.2019.11.18.20.34.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 18 Nov 2019 20:34:26 -0800 (PST) Subject: Re: INFO: task hung in io_wq_destroy From: Jens Axboe To: Eric Biggers Cc: syzbot , andriy.shevchenko@linux.intel.com, davem@davemloft.net, f.fainelli@gmail.com, gregkh@linuxfoundation.org, idosch@mellanox.com, kimbrownkd@gmail.com, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, netdev@vger.kernel.org, petrm@mellanox.com, syzkaller-bugs@googlegroups.com, tglx@linutronix.de, viro@zeniv.linux.org.uk, wanghai26@huawei.com, yuehaibing@huawei.com References: <000000000000f86a4f0595fdb152@google.com> <20191119022330.GC3147@sol.localdomain> Message-ID: Date: Mon, 18 Nov 2019 21:34:22 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 11/18/19 8:15 PM, Jens Axboe wrote: > On 11/18/19 7:23 PM, Eric Biggers wrote: >> Hi Jens, >> >> On Mon, Oct 28, 2019 at 03:00:08PM -0600, Jens Axboe wrote: >>> This is fixed in my for-next branch for a few days at least, unfortunately >>> linux-next is still on the old one. Next version should be better. >> >> This is still occurring on linux-next. Here's a report on next-20191115 from >> https://syzkaller.appspot.com/text?tag=CrashReport&x=16fa3d1ce00000 > > Hmm, I'll take a look. Looking at the reproducer, it's got a massive > sleep at the end. I take it this triggers before that time actually > passes? Because that's around 11.5 days of sleep. > > No luck reproducing this so far, I'll try on linux-next. I see what it is - if the io-wq is setup and torn down before the manager thread is started, then we won't create the workers we already expected. The manager thread will exit without doing anything, but teardown will wait for the expected workers to exit before being allowed to proceed. That never happens. I've got a patch for this, but I'll test it a bit and send it out tomorrow. -- Jens Axboe