Received: by 2002:ac0:bc90:0:0:0:0:0 with SMTP id a16csp219818img; Thu, 21 Mar 2019 18:24:57 -0700 (PDT) X-Google-Smtp-Source: APXvYqwU2WIxQMSgk38kLZvUMRIGxYd/YlOjeslqlC9m4Y7FHfxUVUtMEl9wD6PG2weKv4lVmm2X X-Received: by 2002:a62:20d2:: with SMTP id m79mr6589910pfj.135.1553217897378; Thu, 21 Mar 2019 18:24:57 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1553217897; cv=none; d=google.com; s=arc-20160816; b=QLtuaQ8adsWVKDs6MJP80Pt4oXIJ9b8ncFns+Mf7pjuuAF7LRlwdA+IvFd++P61BNZ ZlAyiL11dvinzqlNpcl/2BK88eevXjgT9uB+RgetpyXWLP/kNgFvZRkVSM0B4jEmeMIu hb2rSyOlxYhEG3QvdFy51swNxBpV9vJP/8g/Xcg9Ye96aB5dJbeiVfmhrZibl0E5VYy2 /Jql7Y6Q1iw8NoWaSRi5QJvScttlgxWcalkeZ4PinlVSeyDXvi7jFUJMK2Elycm+zHZr ZsgNAjSNzpDz/aaX3gI/mnhFrbUXqY88UfJPJDCKhehQEGiNAsNXoscBIsfjUrVUDhNP J7YA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:content-transfer-encoding :content-language:in-reply-to:mime-version:user-agent:date :message-id:from:references:cc:to:subject:dkim-signature; bh=B46QIBIzguzuQr0SfuXfjkWdBRNFyX9AyKWMSdbfBrg=; b=f0zof8nY4AJh2KLYvbCYn4z3+E1/cXftRG7tYa1ZTKu5QSAVjLu4Cx/qp+f/uOvUrw n+31s+xmimizv2NkEB02pfhKlSYZdwakFT10dqgroUfo4mgoehl1xhcSDyuZxggI6ZeL nCEPaALvdsv3p4JzVdrwyoloSxMB+bFzAgJt9XYxKRVYjzrA6qxj99WFlqy+OKSjWM9Y WqxsqzpZl3O0Hb37poym3lruRfGyaJd8mG9kFvSfWSUD0ofLg+h2y7jwen8VTgkSWyN7 ebSK7NvZgQj1nuSQ/isLZo3BXMZDRX3PoW4LaQ3sOeQ6CbGXq5B6BJgS4kQcRIhUXzCO As9g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=hm+JsRSt; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k7si5550063pfb.69.2019.03.21.18.24.39; Thu, 21 Mar 2019 18:24:57 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=hm+JsRSt; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727512AbfCVBX6 (ORCPT + 99 others); Thu, 21 Mar 2019 21:23:58 -0400 Received: from mail-pf1-f193.google.com ([209.85.210.193]:42744 "EHLO mail-pf1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727397AbfCVBX5 (ORCPT ); Thu, 21 Mar 2019 21:23:57 -0400 Received: by mail-pf1-f193.google.com with SMTP id r15so326405pfn.9; Thu, 21 Mar 2019 18:23:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=B46QIBIzguzuQr0SfuXfjkWdBRNFyX9AyKWMSdbfBrg=; b=hm+JsRStu8C/idqnAUcPxMv/7/cyum/wXukiXx4IJ411SupdBv6419L//2590d099x quAecFUcgdHHQDGeJYJs9hsQ1BWvR11ZXIwGllJrN7BKTStP7SDvYSOKl1EO53MQxv/m 8IT1MJOj59rElmeXYLbx2oZrYkBVYffg/a1cvOwgXvJeOHv3BrVZFvQFKYS4Dsfj4dUU mQ2APCXx18mNa5SFnctRM+6fmvpssO+WKi4zUuD0Ihhvxrp1x+dwRJF7MvYJZDUEEDqS dRdgxt+e+8K3K1egiEaT9l9JRpd7ypfn2q90Xv3owDldfbXcv+hJYkrhJurr/XGzrQMJ wcsw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=B46QIBIzguzuQr0SfuXfjkWdBRNFyX9AyKWMSdbfBrg=; b=kFci9sX5kB3DAdz5Qtp4k731SrVysMGZFIibvvrFsYJTJKrxC5EbALDWMs4dnyH4cH zINKLWILOu5GBX+owjKzZ03eVG2hB4N3kMzQhNRko3g/se0kFj/bYUgOxWHhowWzkUuD n/rPK1dmS1kDWtoE1YwpZmgGMqBxq1jRTg2uKH+eFuSAKeAUZSZVDjYO7uTreQ5rAy/l RxVyKSbjCdN8RiiE8O7Ii2ZXwBUJZITvoPcbpCZ8/keG5sZhCF45E4HrpFLC04hwznGT Y+0CZN+W2rswU9h+XkZ8DERBY5iss7D0tAZHrcFygXdmqmSrj1R7XjYbu49QWW9BZ3+N 0EyQ== X-Gm-Message-State: APjAAAVrZbyGkT8V2w6YUXP3bgwYglQ32Ljv1HLmiiwlYccEhct1JdZB ebq/exnsawWJAKyfPVINjfA= X-Received: by 2002:a63:5452:: with SMTP id e18mr6371830pgm.386.1553217836568; Thu, 21 Mar 2019 18:23:56 -0700 (PDT) Received: from [192.168.1.70] (c-24-6-192-50.hsd1.ca.comcast.net. [24.6.192.50]) by smtp.gmail.com with ESMTPSA id k9sm11422638pfc.57.2019.03.21.18.23.54 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 21 Mar 2019 18:23:56 -0700 (PDT) Subject: Re: [RFC v4 00/17] kunit: introduce KUnit, the Linux kernel unit testing framework To: Brendan Higgins , Kees Cook , Luis Chamberlain , shuah@kernel.org, Rob Herring , Kieran Bingham Cc: Greg KH , Joel Stanley , Michael Ellerman , Joe Perches , brakmo@fb.com, Steven Rostedt , "Bird, Timothy" , Kevin Hilman , Julia Lawall , linux-kselftest@vger.kernel.org, kunit-dev@googlegroups.com, Linux Kernel Mailing List , Jeff Dike , Richard Weinberger , linux-um@lists.infradead.org, Daniel Vetter , dri-devel , Dan Williams , linux-nvdimm , Knut Omang , devicetree , Petr Mladek , Sasha Levin , Amir Goldstein , Dan Carpenter , wfg@linux.intel.com References: <20190214213729.21702-1-brendanhiggins@google.com> From: Frank Rowand Message-ID: <0e6eb370-3e62-e1a5-1b91-bccc5868e8e4@gmail.com> Date: Thu, 21 Mar 2019 18:23:53 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 3/4/19 3:01 PM, Brendan Higgins wrote: > On Thu, Feb 14, 2019 at 1:38 PM Brendan Higgins > wrote: >> >> This patch set proposes KUnit, a lightweight unit testing and mocking >> framework for the Linux kernel. >> > > > >> ## More information on KUnit >> >> There is a bunch of documentation near the end of this patch set that >> describes how to use KUnit and best practices for writing unit tests. >> For convenience I am hosting the compiled docs here: >> https://google.github.io/kunit-docs/third_party/kernel/docs/ >> Additionally for convenience, I have applied these patches to a branch: >> https://kunit.googlesource.com/linux/+/kunit/rfc/5.0-rc5/v4 >> The repo may be cloned with: >> git clone https://kunit.googlesource.com/linux >> This patchset is on the kunit/rfc/5.0-rc5/v4 branch. >> >> ## Changes Since Last Version >> >> - Got KUnit working on (hypothetically) all architectures (tested on >> x86), as per Rob's (and other's) request >> - Punting all KUnit features/patches depending on UML for now. >> - Broke out UML specific support into arch/um/* as per "[RFC v3 01/19] >> kunit: test: add KUnit test runner core", as requested by Luis. >> - Added support to kunit_tool to allow it to build kernels in external >> directories, as suggested by Kieran. >> - Added a UML defconfig, and a config fragment for KUnit as suggested >> by Kieran and Luis. >> - Cleaned up, and reformatted a bunch of stuff. >> >> -- >> 2.21.0.rc0.258.g878e2cd30e-goog >> > > Someone suggested I should send the next revision out as "PATCH" > instead of "RFC" since there seems to be general consensus about > everything at a high level, with a couple exceptions. > > At this time I am planning on sending the next revision out as "[PATCH > v1 00/NN] kunit: introduce KUnit, the Linux kernel unit testing > framework". Initially I wasn't sure if the next revision should be > "[PATCH v1 ...]" or "[PATCH v5 ...]". Please let me know if you have a > strong objection to the former. > > In the next revision, I will be dropping the last two of three patches > for the DT unit tests as there doesn't seem to be enough features > currently available to justify the heavy refactoring I did; however, I Thank you. > will still include the patch that just converts everything over to > KUnit without restructuring the test cases: > https://lkml.org/lkml/2019/2/14/1133 The link doesn't work for me (don't worry about that), so I'm assuming this is: [RFC v4 15/17] of: unittest: migrate tests to run on KUnit The conversation on that patch ended after: >> After adding patch 15, there are a lot of "unittest internal error" messages. > > Yeah, I meant to ask you about that. I thought it was due to a change > you made, but after further examination, just now, I found it was my > fault. Sorry for not mentioning that anywhere. I will fix it in v5. It is not worth my time to look at patch 15 when it is that broken. So I have not done any review of it. So no, I think you are still in the RFC stage unless you drop patch 15. > > I should have the next revision out in a week or so. >