Received: by 10.192.165.148 with SMTP id m20csp5363618imm; Tue, 1 May 2018 13:42:56 -0700 (PDT) X-Google-Smtp-Source: AB8JxZrkKA4RCb1yx32HtP665hsT1fIt1Rbi33tbQgBp+kdbI2fITKamr1O2aukplccgcrAQCo6W X-Received: by 2002:a17:902:7841:: with SMTP id e1-v6mr17805400pln.197.1525207376094; Tue, 01 May 2018 13:42:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1525207376; cv=none; d=google.com; s=arc-20160816; b=Nk+iWt6tAPeJxpT4mEio3hLxTkvvhov9EH4P+i3w7e6hzOiLeEkdXHm5f5vux6ZdzM 5uIUAmLDk7CPYzZzHSn01lmjuxBIOVYWBf4NtQRqZoXO7bntPxZtrtkg+67DdlT7bDlT re2KVxhNloHqaDxhVxupIvIArF93L63BmObCVZec8owtWV0PWcbDYv5KzSWEd8Urys0m gS9i5JQC9mCZTxncNe275pFvholEU5v5crUmE0Ae8rTTWXZNNXLj/nC3it7FBDqPlo7K 4r6SgowmhHJQ6YQYYMd+coY+xMfbpTfbWdFWjNtj1BNqVi2llsb5/igVz+Igc+VOCl9k 6Deg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:mime-version:content-transfer-encoding :content-id:spamdiagnosticmetadata:spamdiagnosticoutput :content-language:accept-language:in-reply-to:references:message-id :date:thread-index:thread-topic:subject:cc:to:from:dkim-signature :arc-authentication-results; bh=59DEa4doJA6XXhKa5EftZYByD0bSJFdB0UhktVHC3xU=; b=nrDH2L1Yc/yHCDYjBqJB7gn5tcmejDQA3TlmqOor+zObqFD9wF+X0j8jyNaQqyIu47 tH4dAjIY04V0VVvbOHN23lUlv4AZxVNQDvK03/h5U/4t3B1rYNUSclWuSR9fKjcPhWl1 pa/3TjDWRy1RtLQ4vmGBzpwtw8QVE2uZBp181J9xjG3YoWhxWVqp2xsTKf8GNH2ey7ZY e59kq9I4DF0PYePzX1dEijs/jedV2oIOb5oKb3wcIqsSzcZlSgcJ6tOaRn0vUcMg+Zq4 VsNjQA+fAgq4A2UT5Ne0qAaOwLF9EGs+Jxt/cChnMB0bXw0PBmu685leTn7pyaJ/yKPc Zz7Q== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=Ma79ICBy; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id be3-v6si9716844plb.289.2018.05.01.13.42.41; Tue, 01 May 2018 13:42:56 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@microsoft.com header.s=selector1 header.b=Ma79ICBy; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=microsoft.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751167AbeEAUmV (ORCPT + 99 others); Tue, 1 May 2018 16:42:21 -0400 Received: from mail-dm3nam03on0131.outbound.protection.outlook.com ([104.47.41.131]:60448 "EHLO NAM03-DM3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1750766AbeEAUmT (ORCPT ); Tue, 1 May 2018 16:42:19 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=59DEa4doJA6XXhKa5EftZYByD0bSJFdB0UhktVHC3xU=; b=Ma79ICByeksMsQiC7WPLSk8aVN7n3KFmO2wQFJOCL7tkoTj/+UsRJaUEhO4es+P4Nfr9gcYtErcfUKun8Ue/osl1HMOxUJCtnNz0GDdXw18eyuOOHdnuatseAoETEM2RIJ0Z6anGNLeEtDeIl6OYKlgA+I5FZUexpXGMFtS8oJU= Received: from DM5PR2101MB1032.namprd21.prod.outlook.com (52.132.128.13) by DM5PR2101MB0725.namprd21.prod.outlook.com (10.167.107.167) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.735.4; Tue, 1 May 2018 20:42:18 +0000 Received: from DM5PR2101MB1032.namprd21.prod.outlook.com ([fe80::8109:aef0:a777:7059]) by DM5PR2101MB1032.namprd21.prod.outlook.com ([fe80::8109:aef0:a777:7059%2]) with mapi id 15.20.0755.007; Tue, 1 May 2018 20:42:18 +0000 From: Sasha Levin To: Willy Tarreau CC: "Theodore Y. Ts'o" , "ksummit-discuss@lists.linuxfoundation.org" , Greg KH , "julia.lawall@lip6.fr" , "linux-kernel@vger.kernel.org" Subject: Re: bug-introducing patches Thread-Topic: bug-introducing patches Thread-Index: AQHT4WrQpZfAdTeY4k22b0OVmzGN0aQbRuYAgAAEU4CAAAlAgIAAAnkA Date: Tue, 1 May 2018 20:42:18 +0000 Message-ID: <20180501204216.GC7397@sasha-vm> References: <20180501163818.GD1468@sasha-vm> <20180501194450.GD10479@thunk.org> <20180501200019.GA7397@sasha-vm> <20180501203325.GB11618@1wt.eu> In-Reply-To: <20180501203325.GB11618@1wt.eu> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [52.168.54.252] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;DM5PR2101MB0725;7:B20y621XsElsbBd+SvuHBvhLH6IZS68vxsKXR5gwK/GkCFXmHqRBRXYqZ1/xsiw2lyb4IHmlm2EJeES9MYlNt2cRR6fTUpRfS8XIwyKDzfHCCDk5KRSyC6OUJB7D0TcJnc2pMAS+8PyDis82P9K3S/5ISPTSVC0aN+KS/UtQg6SSLnJdWzssKhi0L+hmx+OM1GiUeuyJfLnAGCM1UfzX4bOswsNJ7lY14oL788wDTl0yigEO2Dcc8F3v4TnJbi6U;20:WEFvkpw2+ONtgMZOWVOGtRTIWlEMgYP/BDZlUlbm3jGT25PAidAjmMxXW9fFHAcEoUjYNJgyngxJZOngGeYTBASUyUfeCbhFlAZzFy8pWjioz3wATHvsKHf9+iViooeyaSKp4GSeAqubCGGkPErhOOeanhbOyguNLQKhpcpWybU= x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(48565401081)(2017052603328)(7193020);SRVR:DM5PR2101MB0725; x-ms-traffictypediagnostic: DM5PR2101MB0725: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(3231254)(2018427008)(944501410)(52105095)(93006095)(93001095)(10201501046)(3002001)(6055026)(6041310)(20161123560045)(20161123562045)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(6072148)(201708071742011);SRVR:DM5PR2101MB0725;BCL:0;PCL:0;RULEID:;SRVR:DM5PR2101MB0725; x-forefront-prvs: 06592CCE58 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(7916004)(39380400002)(346002)(39860400002)(396003)(376002)(366004)(199004)(189003)(51444003)(6116002)(6486002)(3846002)(54906003)(106356001)(86362001)(1076002)(486006)(3280700002)(7736002)(53936002)(229853002)(3660700001)(2906002)(5660300001)(97736004)(10090500001)(5250100002)(4326008)(26005)(22452003)(3480700004)(68736007)(72206003)(102836004)(476003)(316002)(66066001)(81166006)(25786009)(10290500003)(2900100001)(6512007)(9686003)(478600001)(11346002)(105586002)(446003)(6436002)(305945005)(8676002)(6916009)(33656002)(76176011)(81156014)(6246003)(186003)(86612001)(6506007)(14454004)(93886005)(33716001)(33896004)(6346003)(99286004)(8936002)(781001);DIR:OUT;SFP:1102;SCL:1;SRVR:DM5PR2101MB0725;H:DM5PR2101MB1032.namprd21.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1; received-spf: None (protection.outlook.com: microsoft.com does not designate permitted sender hosts) authentication-results: spf=none (sender IP is ) smtp.mailfrom=Alexander.Levin@microsoft.com; x-microsoft-antispam-message-info: pKJpbbhcktnhELKYyC+FA+uk4Jl7etQ+jb9mfMu1JLo/1tdHzGDF9KyMI98Ef1nmp53B1Ko8cep42kLlTXDPux/gDVU6psgh3ewyyhgZC8/DY56Yo1z7aUO9RxGOwAxzfLrPUQXNPm7Viz4mT/zrrOdjalMbrirJmrAL3RSFDO44tbWjavIF/OY1f1LngutR spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: fe71940b-966c-48dd-19da-08d5afa407ce X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: fe71940b-966c-48dd-19da-08d5afa407ce X-MS-Exchange-CrossTenant-originalarrivaltime: 01 May 2018 20:42:18.2247 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR2101MB0725 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, May 01, 2018 at 10:33:25PM +0200, Willy Tarreau wrote: >On Tue, May 01, 2018 at 08:00:21PM +0000, Sasha Levin wrote: >> What's worse is that that commit is tagged for stable, which means >> that (given Greg's schedule) it may find it's way to -stable users >> even before some -next users/bots had a chance to test it out. > >But it's a difficult trade-off. I think that -next is mostly used by >developers and that as such the audience remains limited. On the >opposite, -stable is used by many users. So how many days of -next >does it take to get the equivalent coverage of one day of -stable, >I don't know but it's probably a lot. Also server workloads are >almost exclusively on -stable. So a bug affecting only server users >will not benefit from -next exposition. > >In the end it's all about responding to users' expectations to see >the bugs fixed. In -stable we regularly see users asking to backport >certain fixes. Sometimes they have to wait one or two extra versions >before they get their fix, and they are really not happy at all. If >the fix is rushed too fast and doesn't work, they won't be happy >either. Making them happy means backporting the right fix the quickest >possible. Too little test can result in a wrong fix, but too much test >results in a slow backport. > >Again, I really don't find the -stable situation bad nowadays, quite >the opposite. I often suggest to people who don't follow too closely >to stick to latest LTS minus 1 or 2 releases. This way they don't get >the very latest fixes and have a chance that if something breaks very >badly, it gets fixed quickly. It works pretty well apparently. > >I suspect that some of the issues that really need to be improved are >the fixes to recently merged code. That's never easy by definition >because if the code is young, it's not yet very well known even by >its author. > >What *could* possibly be done (though I'm not fond of this) would be >to state a rule that past a certain number of stacked fixes for a >recently merged code, an extra review delay will be enforced on the >subsystem or on patches coming from the submitter. But I really doubt >it would significantly improve the situation. I think that this discussion has shifted to -stable issues, which is not what I was aiming for. I tried to present a statistic from the recent kernel commits showing that per changed line of code, an -rc commit has more than 3 times the likelyhood to introduce a bug rather than a merge window one. Is this something the community sees as an issue, or do we expect a significantly higher odds of introducing bugs in -rc commits? Feed free to ignore any proposals I've made. If you see this as an issue, what could we do to address it? Let's leave -stable out of this for now.=