Received: by 2002:ac0:aed5:0:0:0:0:0 with SMTP id t21csp1435669imb; Sat, 2 Mar 2019 15:35:32 -0800 (PST) X-Google-Smtp-Source: APXvYqztwMuPAWIy94d00Yn5E7JzvRdyYUjYoG9DSjcuHViVkSvMztXKcPRejV0gTyilyOFTAuD7 X-Received: by 2002:a17:902:104:: with SMTP id 4mr12695522plb.62.1551569732101; Sat, 02 Mar 2019 15:35:32 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1551569732; cv=none; d=google.com; s=arc-20160816; b=kQAm0vg/tN4I9PWEoiKVqg3IeYTZFuo3u5NTIbYWd7zlPMYdp2XpZ6CRSBHF5mQxDJ y8YbPCFRgiSD5WjB2ZBPRwj8YAQE2PsCYAvJS/E/pfSvlN+yzlWicR2RBCw8vOpfFw1Y x9NHrQxx6FY5tiSJz1FBscOJtbiW7qsGk8Unzh/9RW8xG29Xss4LCMxg/OXjZI9ASu6+ DpeVfjqvBTo1vcoMUtvqsjfeksCqR65lYmutresqoe0mhen4GfsoGIN8goqUbSWP0ipn jWsY9bluOcDqZw5yMjaNDpD0nGdppdNj8CIhbca9xFfHrLvE64ezSpsJ/ZOOHErLf5UU JNTA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding:to:subject :message-id:date:from:mime-version:dkim-signature; bh=xvAAARodJC33XZbh124XRYNJ3TqKZUFQn/o8TTEXTTw=; b=r8zEUGn+ma8vOHztZBOrfdpnDTU8nzlrsg0XnN7qhH7NO9Xtk0GsAxWlEaXfXyNbVJ ulVb4lVCnHA2RdiWUj1eJUB4w+L23k6O+RxRqcF3x7yg/r7dkEc33faDkwVodfVAPurH 5ab929trx98es7ZZhTgKyIdJcFnZGtexvLLAojNQ52YoGeIlqBBybfrTAkVv8RoVA0W3 2VZQVLQhAZx+e503LdFNYxAn1JJyiS24UzFEEIHjg3dC7FTRstoL8yr1cVSsTs9iRGMY ygWiock0gTZJIHT6dHSZYEgnRbciWWuWp9w3kWhAX0zkp+5CIBcD0k5rllp4Euz3R1Gq Dvqg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=QXyaoNnA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id r14si1660245pls.306.2019.03.02.15.35.01; Sat, 02 Mar 2019 15:35:32 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=QXyaoNnA; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726826AbfCBXe1 (ORCPT + 99 others); Sat, 2 Mar 2019 18:34:27 -0500 Received: from mail-io1-f48.google.com ([209.85.166.48]:45604 "EHLO mail-io1-f48.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726592AbfCBXe1 (ORCPT ); Sat, 2 Mar 2019 18:34:27 -0500 Received: by mail-io1-f48.google.com with SMTP id x9so1213642iog.12; Sat, 02 Mar 2019 15:34:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to :content-transfer-encoding; bh=xvAAARodJC33XZbh124XRYNJ3TqKZUFQn/o8TTEXTTw=; b=QXyaoNnAysfPr6ZIw6l9nJ8gy0pdCHgbsGVJzB1XDIFCWBSzVZxeZr3SxqnuSooP7A OBAukGp1AvP6y4b4EMLZgVbtionWqTG5Nqggs5qdr6mnK1nyI4phmGi+ERl6rWaoaIbP iZtXPZDH712qG2ydDzyvfXD6HPLLJVnCWQ99xCJSBKCys/RDgWWdY8B/2CK7y4wmuXnG 6WREV2xVtpVxWhmwKxVBvAFvNATRqEyeU9CeFSdb02xkzFcn9uJLm4wVVmw6kY3NsS0Z sLyyT/4t9RxeRUenRhbbrPQFLuDGgV7+N7C2GN6b5xB6GIN5nfEc3fkYkUuoqDvN7gHd aD+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-transfer-encoding; bh=xvAAARodJC33XZbh124XRYNJ3TqKZUFQn/o8TTEXTTw=; b=hYGmS0encJmhnLZSXoDEVfV1ZKNle+l+O/7KCOojrlZOfrkSrXZY95QXTzLDNxDljS 9GSCAN17rJpNbGEDwEYTrmf5+kHKs3VIctBzb09iAQtpk0MT4mrut8FHNr6frSoeqYQh 4t0iAIauFCCyn16JqggniUhRcEagrnYy4E0Rrp4at8u3SANoOYd1uzhEybtwU5zHwZaK oAsZIF2d9V7jqWr4vTGtAxcE/xsI53qc/J1UkkMwIQCN3xt/usu++P3mFKvjcgtodf2N vVBAaFyTOMSeaseNTok279nn7Bn1kXRxDbmKetw0JHSUpIdMy10OHJHKiQjebVV3mpnm U4bA== X-Gm-Message-State: APjAAAUlPaeW3Ot/SFmAjsx25DwARhLSV+LNpONz4qIQSRUXjvO5+9lp boF57fXb1gY8zTpCZce3w51vXilk9nQhRciNXd8= X-Received: by 2002:a6b:e219:: with SMTP id z25mr6149814ioc.116.1551569666078; Sat, 02 Mar 2019 15:34:26 -0800 (PST) MIME-Version: 1.0 From: Alexander Duyck Date: Sat, 2 Mar 2019 15:34:15 -0800 Message-ID: Subject: x86 VM Boot hang with latest linux-next To: snitzer@redhat.com, linux-next@vger.kernel.org, LKML , dm-devel@redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org So I have been seeing an issue with an intermittent boot hang on my x86 KVM VM with the latest linux-next and have bisected it down to the following commit: 1efa3bb79d3de8ca1b7f6770313a1fc0bebe25c7 is the first bad commit commit 1efa3bb79d3de8ca1b7f6770313a1fc0bebe25c7 Author: Mike Snitzer Date: Fri Feb 22 11:23:01 2019 -0500 dm: must allocate dm_noclone for stacked noclone devices Otherwise various lvm2 testsuite tests fail because the lower layers of the stacked noclone device aren't updated to allocate a new 'struct dm_clone' that reflects the upper layer bio that was issued to it. Fixes: 97a89458020b38 ("dm: improve noclone bio support") Reported-by: Mikulas Patocka Signed-off-by: Mike Snitzer What I am seeing is in about 3 out of 4 boots the startup just hangs at the filesystem check stage with the following message: [ OK ] Reached target Local File Systems (Pre). Starting File System Check on /dev/=E2=80=A6127-ad57-426f-bb45-363= 950544c0c... [ **] (1 of 2) A start job is running for=E2=80=A6n on device 252:2 (19s= / no limit) I did some googling and it looks like a similar issue has been reported for s390. Based on the request for data there I have the following info: [root@localhost ~]# dmsetup ls --tree fedora-swap (253:1) =E2=94=94=E2=94=80 (252:2) fedora-root (253:0) =E2=94=94=E2=94=80 (252:2) [root@localhost ~]# dmsetup table fedora-swap: 0 4194304 linear 252:2 2048 fedora-root: 0 31457280 linear 252:2 4196352