Received: by 2002:a25:4158:0:0:0:0:0 with SMTP id o85csp7514134yba; Thu, 2 May 2019 11:10:54 -0700 (PDT) X-Google-Smtp-Source: APXvYqyxFqpXmVIQGm4oIgtC6Xf3V1WGu9P8HlpBYJdLKZjyM/+ZpPQG2XdJnuI6C143W2AzhDkN X-Received: by 2002:aa7:9214:: with SMTP id 20mr5605573pfo.202.1556820653951; Thu, 02 May 2019 11:10:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1556820653; cv=none; d=google.com; s=arc-20160816; b=y8sXykYZ8cYVBpLv9CNWOSh4ZFT1TxfTkB6F64IZ34wxfsCDwJd/Ih3tEIHRJ+KP2o /ShOY1Sj0Z74RLtuJ5ZoIv7ih4/goTueFoKOcz/l+gt4KmMDq8IGBNOWuuobZoqan0HT Pmxc+Rfo2rWvBrkvp3SrCQZ+jMSdS0E6lBoMsSGCmq0CZvIa5C9C5hfKcSzEYbykiajy 2yR0oDI15b0ynuEfapx5U2oIPx+xSjeIMxMLCiP5P8oJR3U6RIpfpcccdeTPAWvxl9cr R/EvWKgjiod1+kzRxcLYGCsOZZxy9JawegMr7lr6mOBnG4c21MIE6DT1BpraZW9pprvI 5B4A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:dkim-signature; bh=79fGKeHlH9FAaVSR1O2RxcfKwTsSnTq5QCRHjsEaUQU=; b=BqJ+TrrMC7gNJFgM0HkOfjFk3hA0Q5Y2COS8nk0MILAxtbfqRW7c8hgsSIStcT8jBm R4pUizbZaibAeVipB5uMNJPiGTT7LW2a5HsME9NFgL0InzkIoDf0l1dOEmK4kpJQ9E0V tjWueLP98lJ3IdtSJi1owzjVlosJ5puQ/Nj1PoqIswujOUiVwwWnEvYS+Ecsr41wBRh3 CBNpSBPpXTtWHxLXtj255H16AE+Uh91DsMcxcabYjB8aXnJ1BAj7w41Wy2zL5TLpSPDp FQZE+K+YhAj+vGLumV5TLSp+Xgku2Qb0gVROgGoVkMIHmDbJLAzD3mnTOS2ctHgWCfR3 91wA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=p6+GkF2p; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id cj5si40665346plb.76.2019.05.02.11.10.38; Thu, 02 May 2019 11:10:53 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20161025 header.b=p6+GkF2p; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726477AbfEBSIX (ORCPT + 99 others); Thu, 2 May 2019 14:08:23 -0400 Received: from mail-ot1-f66.google.com ([209.85.210.66]:38937 "EHLO mail-ot1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725962AbfEBSIX (ORCPT ); Thu, 2 May 2019 14:08:23 -0400 Received: by mail-ot1-f66.google.com with SMTP id o39so2941726ota.6 for ; Thu, 02 May 2019 11:08:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=79fGKeHlH9FAaVSR1O2RxcfKwTsSnTq5QCRHjsEaUQU=; b=p6+GkF2pa0r8kIFWr3Ue5xSJ4hl91lXS3nyMKkOj5gQv9nBUeqd4BeLUxnZv1anIlK lg1rsW/DG5+gG35Q6B+ZLV3xvGi60oYqbQR6qqrpeA01srJDWSHy+u56ea2PsXrn8x+q dAZDe0q27TZ76u7UainpJzKpuJcdKWXXDrVVYsacHOUkrblZnv39zmUQ3mgKo/PyMxtj cBGYHB2uWwE8NxbLX7q9WWmg2lFe3RBeI4j2lZBmhh5c2j8csXxGrExgKmjwwY08DAy9 PMxuPc1keMhPOI13z500WCy1D+qUSgNiYEXKQhnXWgZ+09G9ndEGtieagtsVwWkzEqOt uIWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=79fGKeHlH9FAaVSR1O2RxcfKwTsSnTq5QCRHjsEaUQU=; b=COE1zS67fNVW1+Slp/O/oQuJHulCGXolK+TGfybC87jPKnbXc22tjn7ZN6RcjeAXX6 2Qr8emqAx2nh/yK/qYEvU0Elpg+LTVVoxp92ev6Blz0LhFVbveU95V36W/LBhZHlwS8H sMo/COZN8h9u7FShcjrquNt6eSmJae+t5Tg7ck5f1mgWkA4KsiIrm7vlm42Rq9DmadH2 NAxD/xQ3AMcla1hHg+ZmyaL063BDF39ZeD6Mw/PPsrLbsBget45dfHxDPcDS2rVHK534 YkHl32x0Dt/9rs6d762RO6Wyynwrp2fwzG1Cx0dPPcg/j/McZ4v+phpjTXFm8LFJtlnJ mbmw== X-Gm-Message-State: APjAAAVEurj5QXqEpe9pQ4DjLHedhX6h0F3CsUHw7/clJ3fBBTau/QUb kF/zYlh2Dgu2xxFkziSxFjIN5GnozdTFSC2q8PazaQ== X-Received: by 2002:a9d:3621:: with SMTP id w30mr3409606otb.98.1556820502021; Thu, 02 May 2019 11:08:22 -0700 (PDT) MIME-Version: 1.0 References: <20190501230126.229218-1-brendanhiggins@google.com> <20190501230126.229218-13-brendanhiggins@google.com> <20190502110220.GD12416@kroah.com> In-Reply-To: <20190502110220.GD12416@kroah.com> From: Brendan Higgins Date: Thu, 2 May 2019 11:07:57 -0700 Message-ID: Subject: Re: [PATCH v2 12/17] kunit: tool: add Python wrappers for running KUnit tests To: Greg KH Cc: Frank Rowand , Kees Cook , Kieran Bingham , Luis Chamberlain , Rob Herring , Stephen Boyd , shuah@kernel.org, devicetree , dri-devel , kunit-dev@googlegroups.com, linux-doc@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-kbuild@vger.kernel.org, Linux Kernel Mailing List , linux-kselftest@vger.kernel.org, linux-nvdimm , linux-um@lists.infradead.org, Sasha Levin , "Bird, Timothy" , Amir Goldstein , Dan Carpenter , Dan Williams , Daniel Vetter , Jeff Dike , Joel Stanley , Julia Lawall , Kevin Hilman , Knut Omang , Logan Gunthorpe , Michael Ellerman , Petr Mladek , Richard Weinberger , David Rientjes , Steven Rostedt , wfg@linux.intel.com, Felix Guo Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, May 2, 2019 at 4:02 AM Greg KH wrote: > > On Wed, May 01, 2019 at 04:01:21PM -0700, Brendan Higgins wrote: > > From: Felix Guo > > > > The ultimate goal is to create minimal isolated test binaries; in the > > meantime we are using UML to provide the infrastructure to run tests, so > > define an abstract way to configure and run tests that allow us to > > change the context in which tests are built without affecting the user. > > This also makes pretty and dynamic error reporting, and a lot of other > > nice features easier. > > > > kunit_config.py: > > - parse .config and Kconfig files. > > > > kunit_kernel.py: provides helper functions to: > > - configure the kernel using kunitconfig. > > - build the kernel with the appropriate configuration. > > - provide function to invoke the kernel and stream the output back. > > > > Signed-off-by: Felix Guo > > Signed-off-by: Brendan Higgins > > Ah, here's probably my answer to my previous logging format question, > right? What's the chance that these wrappers output stuff in a standard > format that test-framework-tools can already parse? :) It should be pretty easy to do. I had some patches that pack up the results into a serialized format for a presubmit service; it should be pretty straightforward to take the same logic and just change the output format. Cheers