Received: by 2002:a25:f815:0:0:0:0:0 with SMTP id u21csp38972ybd; Tue, 25 Jun 2019 16:03:30 -0700 (PDT) X-Google-Smtp-Source: APXvYqzZzoqDG5BpznJSAwuSTObobev5YqdYu6cRWpyi+iG98OMBUQV+if2opCOVHKMgQOr5AFmg X-Received: by 2002:a17:902:23:: with SMTP id 32mr1317322pla.34.1561503810473; Tue, 25 Jun 2019 16:03:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1561503810; cv=none; d=google.com; s=arc-20160816; b=bEWktl9CTLmj6U1119KZYUB720bT6srHJ9UU7daI7iVrN0v5Z8138kqJfmwdbY/3X4 ZG9tkeQfHUFPPJojxBLUTc6Kv8k42FWsIUMxBNdLSOu+dU1JreLUYIHMi96WRb6UbODF ezEIPKSe+U9XZBaoTyGcq5FFG6NtpR3HZeENLjxAvR4M5L2bJ8FIM+Z5HxEwoiIjtjSf aRtdC8Lar+QNwuTXcjPxdrS1CFrbVnqVegQ38E1whINhdF+wXhSjJ2FTZrk5lbRga0YO geJLyot95G4In76sDtYNfWwAt7dQMgWvzy/hGufmi77XwVxNANkQEzl5SeudDuEAhhDh hR+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date; bh=IAVXlfOigyJbEa5HhE6BwBcpEncScOxFXJXYNv1k45k=; b=f9aINFtUlDje6bRASwmFHHQ5ow2Bal/pgSSpyNAZPSbGwcxgkSm0JIA4wVTpcTaEE4 ejew6FBELGFjMMDKStqCV/Xdf7FtdpQ5fwzss6GFDR6+0N0cyBq44JWTaXohlgXUU3N6 aLfptWNEZduZTFoqi2a6SZAAYZW4Ug8bdO5TZA/4GMp5jW7abjSEWjCxT1Npr0wl088G 2ydBwzwUsu+p7fFLKJcIrI2KfwI36jvwg0q0uVVlChKARzi2/WvXYp0vHgiKWPgB7bwj B61weiEOCvhBEa+6Upj1tcCX3bvpePuBwQ6HD5QtHxsBgdJAFHQncqxfa0SwCTlN8CSW CeIg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bi3si1325779plb.226.2019.06.25.16.03.14; Tue, 25 Jun 2019 16:03:30 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726423AbfFYXC5 (ORCPT + 99 others); Tue, 25 Jun 2019 19:02:57 -0400 Received: from mail-pg1-f194.google.com ([209.85.215.194]:42763 "EHLO mail-pg1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725782AbfFYXC4 (ORCPT ); Tue, 25 Jun 2019 19:02:56 -0400 Received: by mail-pg1-f194.google.com with SMTP id k13so165620pgq.9; Tue, 25 Jun 2019 16:02:56 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=IAVXlfOigyJbEa5HhE6BwBcpEncScOxFXJXYNv1k45k=; b=fkL5OZuDVWkej5ZG4VatI21hHWlzGJXK0Si9AQAW9zoGDwMiyZEPuYRirz3Q0aByJu 9VSHMOkGBUWW+0XoBoEXFmw+r8dtWGNTMbrgcKs5Y6TE4ftvqTFwaaqA+U2WFhJQIFlw 4KKH74x4Ywbb000a83LtPoyMHZ5lCRuW/S7lvrp3MQNb3camzLJIdH0ezPRKVp/yWlMv 3/Q1tmNtE2UScpSpGJSN7CWBf4L/z22TrszMAenhqm81+BrbizGlhy6Mq2867Dogh+6s QTfxli/sBvaR+SMxqvkCI0RltTgT8RpA3KvJKAQJ31dHl2que9hlT0apwrDNqHfDlHEN pogA== X-Gm-Message-State: APjAAAUEy5rjIl2ApPQlP2hKVqp/KAyOmZgVXhTaR1V8Qxen5rTjMWmm DtEyG+GK0eMtcjV02R/Fmj4= X-Received: by 2002:a17:90a:ac13:: with SMTP id o19mr354796pjq.143.1561503775428; Tue, 25 Jun 2019 16:02:55 -0700 (PDT) Received: from 42.do-not-panic.com (42.do-not-panic.com. [157.230.128.187]) by smtp.gmail.com with ESMTPSA id r1sm92074pji.15.2019.06.25.16.02.53 (version=TLS1_3 cipher=AEAD-AES256-GCM-SHA384 bits=256/256); Tue, 25 Jun 2019 16:02:54 -0700 (PDT) Received: by 42.do-not-panic.com (Postfix, from userid 1000) id 64827401EB; Tue, 25 Jun 2019 23:02:53 +0000 (UTC) Date: Tue, 25 Jun 2019 23:02:53 +0000 From: Luis Chamberlain To: Brendan Higgins Cc: Stephen Boyd , Frank Rowand , Greg KH , Josh Poimboeuf , Kees Cook , Kieran Bingham , Peter Zijlstra , Rob Herring , shuah , Theodore Ts'o , Masahiro Yamada , devicetree , dri-devel , kunit-dev@googlegroups.com, "open list:DOCUMENTATION" , linux-fsdevel@vger.kernel.org, linux-kbuild , Linux Kernel Mailing List , "open list:KERNEL SELFTEST FRAMEWORK" , linux-nvdimm , linux-um@lists.infradead.org, Sasha Levin , "Bird, Timothy" , Amir Goldstein , Dan Carpenter , Daniel Vetter , Jeff Dike , Joel Stanley , Julia Lawall , Kevin Hilman , Knut Omang , Logan Gunthorpe , Michael Ellerman , Petr Mladek , Randy Dunlap , Richard Weinberger , David Rientjes , Steven Rostedt , wfg@linux.intel.com Subject: Re: [PATCH v5 01/18] kunit: test: add KUnit test runner core Message-ID: <20190625230253.GQ19023@42.do-not-panic.com> References: <20190617082613.109131-1-brendanhiggins@google.com> <20190617082613.109131-2-brendanhiggins@google.com> <20190620001526.93426218BE@mail.kernel.org> <20190625214427.GN19023@42.do-not-panic.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Tue, Jun 25, 2019 at 03:14:45PM -0700, Brendan Higgins wrote: > On Tue, Jun 25, 2019 at 2:44 PM Luis Chamberlain wrote: > > Since its a new architecture and since you seem to imply most tests > > don't require locking or even IRQs disabled, I think its worth to > > consider the impact of adding such extreme locking requirements for > > an initial ramp up. > > Fair enough, I can see the point of not wanting to use irq disabled > until we get someone complaining about it, but I think making it > thread safe is reasonable. It means there is one less thing to confuse > a KUnit user and the only penalty paid is some very minor performance. One reason I'm really excited about kunit is speed... so by all means I think we're at a good point to analyze performance optimizationsm if they do make sense. While on the topic of parallization, what about support for running different test cases in parallel? Or at the very least different kunit modules in parallel. Few questions come up based on this prospect: * Why not support parallelism from the start? * Are you opposed to eventually having this added? For instance, there is enough code on lib/test_kmod.c for batching tons of kthreads each one running its own thing for testing purposes which could be used as template. * If we eventually *did* support it: - Would logs be skewed? - Could we have a way to query: give me log for only kunit module named "foo"? Luis