Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752758AbdCTCPM (ORCPT ); Sun, 19 Mar 2017 22:15:12 -0400 Received: from mx1.redhat.com ([209.132.183.28]:43108 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752169AbdCTCPF (ORCPT ); Sun, 19 Mar 2017 22:15:05 -0400 DMARC-Filter: OpenDMARC Filter v1.3.2 mx1.redhat.com 85B95C05AA43 Authentication-Results: ext-mx08.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com Authentication-Results: ext-mx08.extmail.prod.ext.phx2.redhat.com; spf=pass smtp.mailfrom=xpang@redhat.com DKIM-Filter: OpenDKIM Filter v2.11.0 mx1.redhat.com 85B95C05AA43 Reply-To: xlpang@redhat.com Subject: Re: [PATCH] kexec: Update vmcoreinfo after crash happened References: <1489666587-24103-1-git-send-email-xlpang@redhat.com> <20170316122730.GB23625@x1> <58CA86D2.70800@redhat.com> <20170316131809.GC23625@x1> <58CA95EA.1040807@redhat.com> <20170318192328.31dc1fde@hananiah.suse.cz> To: Petr Tesarik Cc: Baoquan He , kexec@lists.infradead.org, xlpang@redhat.com, linux-kernel@vger.kernel.org, Eric Biederman , akpm@linux-foundation.org, Dave Young From: Xunlei Pang Message-ID: <58CF3BC6.3060808@redhat.com> Date: Mon, 20 Mar 2017 10:17:42 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <20170318192328.31dc1fde@hananiah.suse.cz> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.32]); Mon, 20 Mar 2017 02:14:59 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 3311 Lines: 71 On 03/19/2017 at 02:23 AM, Petr Tesarik wrote: > On Thu, 16 Mar 2017 21:40:58 +0800 > Xunlei Pang wrote: > >> On 03/16/2017 at 09:18 PM, Baoquan He wrote: >>> On 03/16/17 at 08:36pm, Xunlei Pang wrote: >>>> On 03/16/2017 at 08:27 PM, Baoquan He wrote: >>>>> Hi Xunlei, >>>>> >>>>> Did you really see this ever happened? Because the vmcore size estimate >>>>> feature, namely --mem-usage option of makedumpfile, depends on the >>>>> vmcoreinfo in 1st kernel, your change will break it. >>>> Hi Baoquan, >>>> >>>> I can reproduce it using a kernel module which modifies the vmcoreinfo, >>>> so it's a problem can actually happen. >>>> >>>>> If not, it could be not good to change that. >>>> That's a good point, then I guess we can keep the crash_save_vmcoreinfo_init(), >>>> and store again all the vmcoreinfo after crash. What do you think? >>> Well, then it will make makedumpfile segfault happen too when execute >>> below command in 1st kernel if it existed: >>> makedumpfile --mem-usage /proc/kcore >> Yes, if the initial vmcoreinfo data was modified before "makedumpfile --mem-usage", it might happen, >> after all the system is going something wrong. And that's why we deploy kdump service at the very >> beginning when the system has a low possibility of going wrong. >> >> But we have to guarantee kdump vmcore can be generated correctly as possible as it can. >> >>> So we still need to face that problem and need fix it. vmcoreinfo_note >>> is in kernel data area, how does module intrude into this area? And can >>> we fix the module code? >>> >> Bugs always exist in products, we can't know what will happen and fix all the errors, >> that's why we need kdump. >> >> I think the following update should guarantee the correct vmcoreinfo for kdump. > I'm still not convinced. I would probably have more trust in a clean > kernel (after boot) than a kernel that has already crashed (presumably > because of a serious bug). How can be reliability improved by running > more code in unsafe environment? Correct, I realized that, so used crc32 to protect the original data, but since Eric left a more reasonable idea, I will try that later. > > If some code overwrites reserved areas (such as vmcoreinfo), then it's > seriously buggy. And in my opinion, it is more difficult to identify > such bugs if they are masked by re-initializing vmcoreinfo after crash. > In fact, if makedumpfile in the kexec'ed kernel complains that it > didn't find valid VMCOREINFO content, that's already a hint. > > As a side note, if you're debugging a vmcoreinfo corruption, it's > possible to use a standalone VMCOREINFO file with makedumpfile, so you > can pre-generate it and save it in the kdump initrd. > > In short, I don't see a compelling case for this change. E.g. 1) wrong code overwrites vmcoreinfo_data; 2) further crashes the system; 3) trigger kdump, then we obviously will fail to recognize the crash context correctly due to the corrupted vmcoreinfo. Everyone will get confused if met such unfortunate customer-side issue. Although it's corner case, if it's easy to fix, then I think we better do it. Now except for vmcoreinfo, all the crash data is well protected (including cpu note which is fully updated in the crash path, thus its correctness is guaranteed). Regards, Xunlei