Received: by 2002:a25:86ce:0:0:0:0:0 with SMTP id y14csp631445ybm; Wed, 22 May 2019 08:59:18 -0700 (PDT) X-Google-Smtp-Source: APXvYqyQncaY2csbzLKXpK7EzX8rf/o2dnfiTHJso+gCMPJcQ+HFPohkJsKCmVW51F5BbrxG/goD X-Received: by 2002:a62:b517:: with SMTP id y23mr11433536pfe.182.1558540758549; Wed, 22 May 2019 08:59:18 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1558540758; cv=none; d=google.com; s=arc-20160816; b=bFtasDUjKhTkEnosaNE7SaY5JZ4cjWmOER+rFP2b1gLpS8th273lZrROSkpH9G3SVp M3ivoI7DTA9E5TVYkDiERbFqiQBrAudvUA7yFbE3BgCGfMxqcOaLi0Pc2eup0Mau69MS /AOUmRX8d60VK8F01DbDeRpnFYgW1ScbIdtA8TLg5w2A2pKgAiGTLKlJx6tL6kHto21o TDdi4xIO7iwFRpcmBZTEAN+PfHjb58O5tfYPu+Nakp02qX3gD7qAIFfjTn4jzEwrEAm0 a6KCZxJtewcAugbgl3Y2zsnl53yjTiHNvv8l/wsPWoL6KIKxbsmB1gsivJgrQf0YTkkd PaYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=mITDoe4J8/uvH5cdbzz1r9ing0tGJhxbtiSsHCLEmkw=; b=V/9SvSW0mWU6UStICx6dbCfDV4GO9Mz1YcQTA3T2qwH5/idmguiEuPmMTTUXBEvala E7rVG8/tHVjymMNxlrSvsvBB5toYx3XH9PEHD0JF8pa98zj7j0IZNmPq9cf1lXvrmaZv B/OxhIL4QslhWzNvLLOruWGkfsh+eykjB7bAEj2NDxeZiel4PfQNAIEaSwsHFsG5KYO3 rHEB2k3Dov9oVjbSkCqMbmD0uRHcbTafavAZkUtJXayQwHnVT/H6LjODZ3QCKu10ktZ7 odQBy4SwvTnN/TXTDNuPHEuyhBPPYTN5CNQsxX/Dl10UrKAXzKSFD75sQE6IRuCMaJxp hVRA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=CEil9MH7; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id i4si26277756pfa.218.2019.05.22.08.59.02; Wed, 22 May 2019 08:59:18 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=CEil9MH7; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729862AbfEVPsp (ORCPT + 99 others); Wed, 22 May 2019 11:48:45 -0400 Received: from mail-io1-f54.google.com ([209.85.166.54]:36979 "EHLO mail-io1-f54.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729402AbfEVPsp (ORCPT ); Wed, 22 May 2019 11:48:45 -0400 Received: by mail-io1-f54.google.com with SMTP id u2so2256448ioc.4 for ; Wed, 22 May 2019 08:48:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=mITDoe4J8/uvH5cdbzz1r9ing0tGJhxbtiSsHCLEmkw=; b=CEil9MH7n1qNdPzMfHsM1KNbUTc28OaQK6fEycZuF4UhvpzbDJdSWlU3vavvZSULDy XtLgMkgBh8Ulg1aV+5bmNUT7Sx1Wdg6BGD3FSZsKbTR/9EUfFdyXnJlTI0Fy+HtaaEn1 /Xf4Q9LXl51jXxwHgMSPjhcox3Whq8L1CqI+aNHVVphyKZnOijizvT45uInjNZgmluJz N7PerUDsCftti0nYnWwoPbo5mpxSNU2TPYUXUM7GEBq5IXWdvSM25Wlp/Jl0HQF6/KAd ZgEm9epZfUtiGHx8/VBnz/g8ZXOM8EMT8Vq/QW2OqWPHavKMTh1+SAZT6ZZNwezvlMJJ SgVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=mITDoe4J8/uvH5cdbzz1r9ing0tGJhxbtiSsHCLEmkw=; b=a/7CuyqgbtRWqbPC+91wbi0CZDY2Yc6K0cOo336d8T6Sq30Kwm7AVGyWHskaTsnP1m m3KOYmtrcsEQLZc+EcbHs5NH9hjV/zXxKbN0mQLDZv7aYdV+CF0aFUQVEG6plZtCF8uU GO8k5NcqBnk9PdzhMpCIqUBRQ9SFo+hlmIJzJdLovlNhIhA/5ulkB1j4hya1lgnRBW0a xwQJaNpcNvGLhzbgH0v1y+AIEqOukWhgEKCtpvgqwAB0dknFi1E5vogdRxEI8JwU+Hkz sSJE2GeFjEbi6vtcnQT4RYeVGV1pOhF2ad5B1kGPjA0o4PF/tl79NAUMDoBYQ7AJNDmF QkHg== X-Gm-Message-State: APjAAAVQj1w6ZhlzubJo4oMgKHQUJmDj5vOD3Chp1o8K7v+ixT83DLGN pvXtCL7rD+/B/8ZHVD1LQzEODz5Q0eRaNZsbaACDUA== X-Received: by 2002:a5d:9dc2:: with SMTP id 2mr23339293ioo.3.1558540123678; Wed, 22 May 2019 08:48:43 -0700 (PDT) MIME-Version: 1.0 References: <199564879.15267174.1556199472004.JavaMail.zimbra@redhat.com> In-Reply-To: From: Dmitry Vyukov Date: Wed, 22 May 2019 17:48:30 +0200 Message-ID: Subject: Re: Linux Testing Microconference at LPC To: Tim Bird Cc: Veronika Kabatova , Dhaval Giani , Sasha Levin , shuah , Kevin Hilman , LKML , Steven Rostedt , Dan Carpenter , Matthew Wilcox , gustavo padovan , knut omang , Eliska Slobodova , Tim Bird Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, Apr 26, 2019 at 11:03 PM Tim Bird wrote: > > I'm in the process now of planning Automated Testing Summit 2019, > which is tentatively planned for Lyon, France on October 31. This is This is _November_ 1, right? > the day after Embedded Linux Conference Europe and Open Source Summit > Europe, in Lyon. I've been working with the > Linux Foundation event staff to set this up. > > The focus of that event is test standards, including standards for > test definition, results formats, lab and board management, and APIs > between elements of the Automated Testing and CI stack. > > I think that the set of things to discuss is somewhat different > between the Plumbers testing microconference and ATS. But I hope that > I'm not fragmenting the space too much. > > With regards to the Testing microconference at Plumbers, I would like > to do a presentation on the current status of test standards and test > framework interoperability. We recently had some good meetings > between the LAVA and Fuego people at Linaro Connect > on this topic. > > Let me know what you think. > -- Tim > > On Thu, Apr 25, 2019 at 6:37 AM Veronika Kabatova wrote: > > > > > > > > ----- Original Message ----- > > > From: "Dhaval Giani" > > > To: "Sasha Levin" , "shuah" , "Kevin Hilman" , > > > "Tim Bird" , "LKML" > > > Cc: "Steven Rostedt" , "Dan Carpenter" , willy@infradead.org, "gustavo > > > padovan" , "Dmitry Vyukov" , "knut omang" > > > > > > Sent: Thursday, April 11, 2019 7:37:51 PM > > > Subject: Linux Testing Microconference at LPC > > > > > > Hi Folks, > > > > > > This is a call for participation for the Linux Testing microconference > > > at LPC this year. > > > > > > For those who were at LPC last year, as the closing panel mentioned, > > > testing is probably the next big push needed to improve quality. From > > > getting more selftests in, to regression testing to ensure we don't > > > break realtime as more of PREEMPT_RT comes in, to more stable distros, > > > we need more testing around the kernel. > > > > > > We have talked about different efforts around testing, such as fuzzing > > > (using syzkaller and trinity), automating fuzzing with syzbot, 0day > > > testing, test frameworks such as ktests, smatch to find bugs in the > > > past. We want to push this discussion further this year and are > > > interested in hearing from you what you want to talk about, and where > > > kernel testing needs to go next. > > > > > > Please let us know what topics you believe should be a part of the > > > micro conference this year. > > > > > > > Hi, > > > > as CKI team, we would like to join the Plumbers discussions about CI for > > kernel. We obviously have our own working pipeline but would like to get > > more involved with the other upstream projects working on the same and > > collaborate on common solutions. > > > > I already started some of these discussions on automated-testing mailing > > list and got in contact with Kevin about the possibility of joining forces > > with KernelCI project. > > > > Our team planned to organize a 'hackfest' for upstream CI during the > > conference but I heard that the Automated Testing Summit should likely take > > place during that time too. If that's the case, we should meet up and > > discuss everything there instead of organizing a separate event. > > > > > > Information and links about CKI Project can be be found at [1] in case > > people are curious. Some of the things we'd like to achieve is having a > > single source for all upstream kernel test results where anyone doing the > > testing can publish them and collaborate on solving common problems (like > > interpreting test results, making build times faster, increasing the test > > coverage, detecting regressions etc.) > > > > With one of my colleagues, we will submit a microconference proposal that > > could serve as the starting point for the followup discussions about these > > topics. > > > > > > We would like to get feedback from kernel developers and maintainers about > > their expectations for testing and receiving results, as well as discuss > > the collaboration with other testing/CI projects. > > > > > > > > Veronika Kabatova > > CKI Project > > > > > > [1] https://cki-project.org/ > > > > > > > Thanks! > > > Sasha and Dhaval > > > > > > > -- > -- Tim Bird > Senior Staff Software Engineer, Sony Corporation > Architecture Group Chair, Core Embedded Linux Project, Linux Foundation