Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S266576AbUF3HYW (ORCPT ); Wed, 30 Jun 2004 03:24:22 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S266578AbUF3HYW (ORCPT ); Wed, 30 Jun 2004 03:24:22 -0400 Received: from fw.osdl.org ([65.172.181.6]:22441 "EHLO mail.osdl.org") by vger.kernel.org with ESMTP id S266576AbUF3HYS (ORCPT ); Wed, 30 Jun 2004 03:24:18 -0400 Date: Wed, 30 Jun 2004 00:24:14 -0700 (PDT) From: Bryce Harrington To: Andrew Morton cc: , Subject: Re: Recent changes in LTP test results In-Reply-To: <20040628211244.298293e1.akpm@osdl.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 4959 Lines: 86 Hi Andrew, Here's an update with mm4 and bk12: On Mon, 28 Jun 2004, Andrew Morton wrote: > Bryce Harrington wrote: > > > > Here is a listing of LTP results for the linux kernel. For the 2.6.x > > series LTP results have been pretty constant, but they've gotten > > interesting lately: > > > > Patch Name TestReq# CPU PASS FAIL WARN BROK RunTime > > ---------------------------------------------------------------------- > > patch-2.4.27-rc2 294321 2-way 7226 6 3 6 69.0 > > linux-2.6.7 294027 2-way 7225 6 3 6 46.0 > > linux-2.6.7 294004 1-way 7225 6 3 6 42.2 > > patch-2.6.7-bk1 294069 2-way 7224 7 3 6 45.9 > > patch-2.6.7-bk2 294081 2-way 7224 7 3 6 45.9 > > patch-2.6.7-bk3 294103 2-way 7224 7 3 6 46.4 > > patch-2.6.7-bk4 294165 2-way 7187 7 3 6 48.7 > > patch-2.6.7-bk5 294181 2-way 7181 7 3 6 45.5 > > patch-2.6.7-bk6 294204 2-way 7224 7 3 6 47.1 > > patch-2.6.7-bk7 294228 2-way 7224 7 3 6 49.0 > > patch-2.6.7-bk8 294304 2-way 7223 10 3 7 47.5 > > patch-2.6.7-bk9 294333 2-way 7224 7 3 6 46.1 > > patch-2.6.7-bk10 294403 2-way 7223 10 3 7 42.9 > > patch-2.6.7-bk11 294423 2-way 7178 46 3 6 47.8 patch-2.6.7-bk12 294442 2-way 7178 46 3 6 47.6 > > 2.6.7-mm1 294146 2-way 7185 46 3 6 59.1 > > 2.6.7-mm1 294126 1-way 7185 46 3 6 52.9 > > 2.6.7-mm2 294271 2-way 7181 47 3 6 44.9 > > 2.6.7-mm3 294363 1-way 7185 46 3 6 41.0 2.6.7-mm4 294465 1-way 7178 46 3 6 42.1 > > 2.6.7-rc3-mm2 293949 2-way 7223 8 3 6 46.5 > > > > I've generated some detailed LTP test result reports on a few of the > > above runs, with specifics about the test runs and failures. These are > > available here: > > > > http://developer.osdl.org/bryce/ltp/ > > Seems that the new failures are all related to failing to return -EFAULT > when passing a bad filename address into filesystem syscalls. > > Perhaps this was fixed recently - they work OK here. We're seeing the same behavior on the mm4 and bk12 kernels as before. It looks like you're using a version of LTP from 2003... If that's true, could you try running the April 2004 version of LTP, just to rule out it being a difference in test versions? http://prdownloads.sourceforge.net/ltp/ltp-full-20040405.tgz?download Bryce > vmm:/usr/src/ltp-full-20031002# ./testcases/kernel/syscalls/access/access03 > access03 1 PASS : access((char *)-1,R_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 2 PASS : access((char *)-1,W_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 3 PASS : access((char*)-1,X_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 4 PASS : access((char*)-1,F_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 5 PASS : access((char*)sbrk(0)+1,R_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 6 PASS : access((char*)sbrk(0)+1,W_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 7 PASS : access(high_address,X_OK) failed as expected with errno 14 (EFAULT) : Bad address > access03 8 PASS : access((char*)sbrk(0)+1,F_OK) failed as expected with errno 14 (EFAULT) : Bad address > vmm:/usr/src/ltp-full-20031002# ./testcases/kernel/syscalls/access/access05 > access05 1 PASS : access() fails, Read Access denied on file, errno:13 > access05 2 PASS : access() fails, Write Access denied on file, errno:13 > access05 3 PASS : access() fails, Execute Access denied on file, errno:13 > access05 4 PASS : access() fails, Access mode invalid, errno:22 > access05 5 PASS : access() fails, Address beyond address space, errno:14 > access05 6 PASS : access() fails, Negative address, errno:14 > access05 7 PASS : access() fails, Pathname is empty, errno:2 > access05 8 PASS : access() fails, Pathname too long, errno:36 > vmm:/usr/src/ltp-full-20031002# ./testcases/kernel/syscalls/chdir/chdir04 > chdir04 1 PASS : expected failure - errno = 36 : File name too long > chdir04 2 PASS : expected failure - errno = 2 : No such file or directory > chdir04 3 PASS : expected failure - errno = 14 : Bad address > - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/