Received: by 10.192.165.148 with SMTP id m20csp276751imm; Wed, 9 May 2018 12:30:39 -0700 (PDT) X-Google-Smtp-Source: AB8JxZoSytkrBLyq2U1DfmpZoMLSQ5oSLoKjtW7hLJ420R72JnjNd9+AlFUH9tvPcuErZ/0NK0DL X-Received: by 2002:a63:69c4:: with SMTP id e187-v6mr36799089pgc.415.1525894239024; Wed, 09 May 2018 12:30:39 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1525894238; cv=none; d=google.com; s=arc-20160816; b=TZky50ifSUe4OfBQ1YL2ydRDj1FMU9vLn+YGl3mFvn4j4VQvQwBX5CjoIB8QCTxK/d eYMbBVfYZl8WuIxIPDFxBCRZDWyDT+SsCMl6kOm1PVNsvfa8L+x3Nm3LpP6U2/VhVq8x FDhC8Gf75X7Ia7yWo68qoqXq9b7xFUa2T1+eFzNVqQT5GzgMHEZ5EKP3Vp53n2dAQ6dX uPSOuFjqiEvE1xs+qWfNUISNBTeQg2PFhqPHmdy8ennGBtJs5l9ent9PZyKKhhkkjFHW Atm0HUKcYIC6WeauaQrlEMKIp6VPaT40ZtV8QMupgwHArPdXSees6XDl3sPTx0YMa0w+ hDNg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:cc :to:from:date:arc-authentication-results; bh=9e5p3Ff9QxXdjpXzhXZHZepr5vY/osUxa3UPj8a941o=; b=QA5TXUjjzcSnPSGFsJIZPlXLUpfeXJfgr7Hl2pg5CipKV+op9xqQCoH55LuyVdE7gj KanmUPGOQEDZ/8QGgtk3MmE/LwqA99QsGOmkbgUeSHgOubh/tbXoBQ4ePxJTqocIk3Ln TUgItGlIiiwpTud0VCHp8amz8NdczUY6hg/QNhlL9B90mu8WLsTjbOjesrFauBCCUyut +A/HL19M/81yN5tUQ9T1JIRl1oD5N0GGcS+/9NSvkDs9lCEy2tIacYlafMPcH8G7+6cM Qv0KNpmFhIhQfbfrtavbUE2sige6zwd2207x1Hd5LzRxlFfuh3NwZFf7pp04WaxyWYcb Rihg== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id n10-v6si536260pgc.277.2018.05.09.12.30.21; Wed, 09 May 2018 12:30:38 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965435AbeEIT2Q (ORCPT + 99 others); Wed, 9 May 2018 15:28:16 -0400 Received: from mx2.suse.de ([195.135.220.15]:60745 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S964931AbeEIT2O (ORCPT ); Wed, 9 May 2018 15:28:14 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (charybdis-ext.suse.de [195.135.220.254]) by mx2.suse.de (Postfix) with ESMTP id 9612DADCD; Wed, 9 May 2018 19:28:13 +0000 (UTC) Date: Wed, 9 May 2018 19:28:13 +0000 From: "Luis R. Rodriguez" To: "Shuah Khan (Samsung OSG)" Cc: mcgrof@kernel.org, linux-kselftest@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH 13/24] selftests: kmod: return Kselftest Skip code for skipped tests Message-ID: <20180509192813.GT27853@wotan.suse.de> References: <20180505011328.32078-1-shuah@kernel.org> <20180505011328.32078-13-shuah@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180505011328.32078-13-shuah@kernel.org> User-Agent: Mutt/1.6.0 (2016-04-01) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Fri, May 04, 2018 at 07:13:17PM -0600, Shuah Khan (Samsung OSG) wrote: > When kmod test is skipped because of unmet dependencies and/or unsupported > configuration, it returns 0 which is treated as a pass by the Kselftest > framework. This leads to false positive result even when the test could > not be run. It returns fail in some cases when test is skipped. Either way, > it is incorrect and incosnistent reporting. > > Change it to return kselftest skip code when a test gets skipped to > clearly report that the test could not be run. > > Kselftest framework SKIP code is 4 and the framework prints appropriate > messages to indicate that the test is skipped. > > Signed-off-by: Shuah Khan (Samsung OSG) Reviewed-by: Luis R. Rodriguez Luis