Return-Path: <linux-kernel-owner@vger.kernel.org>
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
	id S1754349AbcCYVHW (ORCPT <rfc822;w@1wt.eu>);
	Fri, 25 Mar 2016 17:07:22 -0400
Received: from mail.crc.id.au ([203.56.246.92]:42030 "EHLO mail.crc.id.au"
	rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP
	id S1753855AbcCYVHU (ORCPT <rfc822;linux-kernel@vger.kernel.org>);
	Fri, 25 Mar 2016 17:07:20 -0400
Subject: Re: 4.4: INFO: rcu_sched self-detected stall on CPU
To: Boris Ostrovsky <boris.ostrovsky@oracle.com>,
        xen-devel <xen-devel@lists.xenproject.org>,
        linux-kernel@vger.kernel.org
References: <56F4A816.3050505@crc.id.au> <56F52DBF.5080006@oracle.com>
 <56F545B1.8080609@crc.id.au> <56F54EE0.6030004@oracle.com>
 <56F56172.9020805@crc.id.au> <56F5653B.1090700@oracle.com>
Cc: "gregkh@linuxfoundation.org" <gregkh@linuxfoundation.org>
From: Steven Haigh <netwiz@crc.id.au>
Message-ID: <56F5A87A.8000903@crc.id.au>
Date: Sat, 26 Mar 2016 08:07:06 +1100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101
 Thunderbird/38.7.0
MIME-Version: 1.0
In-Reply-To: <56F5653B.1090700@oracle.com>
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="4gW7paTkrHm0BRkvWcMqvXMha9ksnFtS2"
Sender: linux-kernel-owner@vger.kernel.org
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
Content-Length: 3515
Lines: 91

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--4gW7paTkrHm0BRkvWcMqvXMha9ksnFtS2
Content-Type: multipart/mixed; boundary="wQAB0pw3x7FFDPDdLWdDDU646RBaXV0JE"
From: Steven Haigh <netwiz@crc.id.au>
To: Boris Ostrovsky <boris.ostrovsky@oracle.com>,
 xen-devel <xen-devel@lists.xenproject.org>, linux-kernel@vger.kernel.org
Cc: "gregkh@linuxfoundation.org" <gregkh@linuxfoundation.org>
Message-ID: <56F5A87A.8000903@crc.id.au>
Subject: Re: 4.4: INFO: rcu_sched self-detected stall on CPU
References: <56F4A816.3050505@crc.id.au> <56F52DBF.5080006@oracle.com>
 <56F545B1.8080609@crc.id.au> <56F54EE0.6030004@oracle.com>
 <56F56172.9020805@crc.id.au> <56F5653B.1090700@oracle.com>
In-Reply-To: <56F5653B.1090700@oracle.com>

--wQAB0pw3x7FFDPDdLWdDDU646RBaXV0JE
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 26/03/2016 3:20 AM, Boris Ostrovsky wrote:
> On 03/25/2016 12:04 PM, Steven Haigh wrote:
>> It may not actually be the full logs. Once the system gets really upse=
t,
>> you can't run anything - as such, grabbing anything from dmesg is not
>> possible.
>>
>> The logs provided above is all that gets spat out to the syslog server=
=2E
>>
>> I'll try tinkering with a few things to see if I can get more output -=

>> but right now, that's all I've been able to achieve. So far, my only
>> ideas are to remove the 'quiet' options from the kernel command line -=

>> but I'm not sure how much that would help.
>>
>> Suggestions gladly accepted on this front.
>=20
> You probably want to run connected to guest serial console ("
> serial=3D'pty' " in guest config file and something like 'loglevel=3D7
> console=3Dtty0 console=3DttyS0,38400n8' on guest kernel commandline). A=
nd
> start the guest with 'xl create -c <cfg>' or connect later with 'xl
> console <domainID>'.

Ok thanks, I've booted the DomU with:

$ cat /proc/cmdline
root=3DUUID=3D63ade949-ee67-4afb-8fe7-ecd96faa15e2 ro enforcemodulesig=3D=
1
selinux=3D0 fsck.repair=3Dyes loglevel=3D7 console=3Dtty0 console=3DttyS0=
,38400n8

I've left a screen session attached to the console (via xl console) and
I'll see if that turns anything up. As this seems to be rather
unpredictable when it happens, it may take a day or two to get anything.
I just hope its more than the syslog output :)

--=20
Steven Haigh

Email: netwiz@crc.id.au
Web: https://www.crc.id.au
Phone: (03) 9001 6090 - 0412 935 897


--wQAB0pw3x7FFDPDdLWdDDU646RBaXV0JE--

--4gW7paTkrHm0BRkvWcMqvXMha9ksnFtS2
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBCAAGBQJW9aiCAAoJEEGvNdV6fTHc0xEP/RoKN53IZVxMV0xc14Ku0VhP
6oabgbO2SUIlHqPSvoJPrSvV4UuonqpFIkr1fmcw99a/IRFD03s3WIBtF0on6Qp8
pGqfzbXFljmDkgvvZ1JtNeb0GeLfNuekL2EJvJILHZIveqWrr+dbhTOfEQJF2Ewn
e+oLr5pExFHXr66+w7/TnW34IJ/C3yglchrVzrFd6MA4u5B94FC6Vghk274+wkE8
blkc/0aWC3tcvrMdAC023+7OjEZuLBtB+B0QCCbKychVem4yj7lTESNOUsN74hnp
DHxgHnAWAiYS5I3VIuOBsVWKMmFBBshOw1J7i8IY5OnxsuCY0DLFc+HxoGACDACj
wLO2QiGdlmU2KJ7QNFyEYqQO1L9OZ5SYOwFLHhy+ifeDIgiS5ok7BRAQLWpK0pCy
/HrqTdwMthaD6rEfdTWYrCcAlr2uq8SkFiH3O/sBZdVCJfCvu75RhBeTEQvX0p6w
rkK5J3FrL827FdRTEnUicVmtYgSECru+6qQYXJ0/ElYUVOTLBGimi7Tmw1zOP4KT
bMV+7SqS+PghrjRSv+uRvVbMESvcWy7KzwW9jIe1bQfchsEQZXQPpz3IjiQwD4ji
zImnQ4GT93ymMUc3n3s9xXMnV3i1h8mOkuH+4ts2w4X4Fir9A5R2LsozL32ID7km
XLvdoWKhIeqPz0feqA85
=8eKw
-----END PGP SIGNATURE-----

--4gW7paTkrHm0BRkvWcMqvXMha9ksnFtS2--