From: Subrata Modak Subject: Re: [ANNOUNCE] Filesystem test tools open-sourced by SGI Date: Thu, 2 Apr 2009 20:35:10 +0530 Message-ID: References: <49D4CBA0.40408@sgi.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1540809793579693436==" Cc: ltp-list , NFS list , XFS OSS list , Nate Straz , Linux Filesystem list To: Greg Banks Return-path: In-Reply-To: <49D4CBA0.40408@sgi.com> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ltp-list-bounces@lists.sourceforge.net List-ID: --===============1540809793579693436== Content-Type: multipart/alternative; boundary=0016e652f9f4285b3a046693c233 --0016e652f9f4285b3a046693c233 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi Greg, On Thu, Apr 2, 2009 at 7:58 PM, Greg Banks wrote: > G'day, > > SGI is releasing to the Open Source community a number of internal > SGI testing and debugging tools for NFS. Some of these tools are > also applicable to filesystems in general. > > These tools are being released under the GNU General Public License > (GPL) version 2, in the hope that the Linux filesystem development > community may find them useful. They are provided as-is, without any > support. Please do not contact SGI for support on any of these tools. > > Some of these tools are unfinished. Others rely on build > infrastructure in internal SGI trees which cannot be released. > The tools are provided as tarball snapshots of internal SGI source > control trees; for a number of technical reasons it is not possible > to provide access to those trees or to create external repositories. > > The tools are available for download now at > > http://oss.sgi.com/projects/nfs/testtools/ Since, these are released under GPL, i hope integrating them inside LTP ( http://ltp.sf.net) after proper analysis will not be an issue. Since, no support for these tests will be available from SGI, i am hoping that having them inside LTP will be beneficial and help these tests to evolve in the long run. Regards-- Subrata (Happens to maintain LTP :-)) > > A brief description of each tool follows. > > Checkstream > ----------- > > Simple data corruption testing utilities based on the concept of > generating a stream of small self-contained records which can be > decoded in a way which makes certain common data corruption modes > automatically diagnosable. Has been useful for automated testing of > NFS, XFS, and CXFS in SGI. > > Weber > ----- > > Test load generator for NFS. Uses multiple threads, multiple sockets > and multiple IP addresses to simulate loads from many machines, > thus enabling testing of NFS server setups with larger client counts > than can be tested with physical infrastructure (or Virtual Machine > clients). Has been useful in automated NFS testing and as a pinpoint > NFS load generator tool for performance development. > > NFS PMDA > -------- > > PCP Data Agent for extended NFS server statistics. Exports to PCP > the new statistics (measuring per-client and per-server performance) > which are provided by SGI's EnhancedNFS kernel patches. > > Samba PMDA > ---------- > > PCP Data Agent for extended Samba server statistics. Exports to > PCP the additional statistics (measuring per-client and per-server > performance) which are provided by SGI's patches to Samba. > > Ddnfs > ----- > > Filesystem load generation program designed to simulate the IO > load placed on an XFS filesystem by the NFS server in response > to certain NFS loads. Intended for use in XFS automated testing, > to test performance and correctness of certain XFS functionality > not otherwise exercised by the existing XFS test suite, but never > integrated into XFSQA. > > Pmapload > -------- > > Test suite for the portmap and rpcbind programs (which are > NFS infrastructure components based on code open-sourced by Sun > Microsystems and used by every Unix and Linux). Developed by SGI to > test changes imported into those programs from newer Sun source code > during the NFS on IPv6 work for Irix several years ago. > > RPC Exerciser > ------------- > > Test suite for the userspace RPC infrastructure libraries, (which > are NFS infrastructure components based on code open-sourced by Sun > Microsystems and used by every Unix and Linux). Developed by SGI to > test changes imported into those libraries from newer Sun source code > during the NFS on IPv6 work for Irix several years ago. > > Testfs > ------ > > Linux kernel module which provides an in-memory filesystem which > forgets all data written to it. Also can be configured to simulate > timing behaviour on reads and writes. This is useful for NFS > performance testing without a fast disk subsystem. > > StReplay > -------- > > Program which reads the system call trace of another program (obtained > using the widely available strace utility) and replays the IO pattern. > This was intended to be used for automated NFS and XFS testing and > for NFS and XFS problem diagnosis, but was never completed as the > author transferred to another team. Could be the basis for a very > useful filesystem test tool. > > > -- > Greg Banks, P.Engineer, SGI Australian Software Group. > the brightly coloured sporks of revolution. > I don't speak for SGI. > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ > -- Regards & Thanks-- Subrata --0016e652f9f4285b3a046693c233 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Greg,

On Thu, Apr 2, 2009 at 7:58 PM, = Greg Banks <gnb@sgi.com= > wrote:
G'day,

SGI is releasing to the Open Source community a number of internal
SGI testing and debugging tools for NFS. =C2=A0Some of these tools are
also applicable to filesystems in general.

These tools are being released under the GNU General Public License
(GPL) version 2, in the hope that the Linux filesystem development
community may find them useful. =C2=A0They are provided as-is, without any<= br> support. =C2=A0Please do not contact SGI for support on any of these tools.=

Some of these tools are unfinished. =C2=A0Others rely on build
infrastructure in internal SGI trees which cannot be released.
The tools are provided as tarball snapshots of internal SGI source
control trees; for a number of technical reasons it is not possible
to provide access to those trees or to create external repositories.

The tools are available for download now at

ht= tp://oss.sgi.com/projects/nfs/testtools/

Since, th= ese are released under GPL, i hope integrating them inside LTP (http://ltp.sf.net) after proper analysis will not be= an issue. Since, no support for these tests will be available from SGI, i = am hoping that having them inside LTP will be beneficial and help these tes= ts to evolve in the long run.

Regards--
Subrata
(Happens to maintain LTP :-))



A brief description of each tool follows.

Checkstream
-----------

Simple data corruption testing utilities based on the concept of
generating a stream of small self-contained records which can be
decoded in a way which makes certain common data corruption modes
automatically diagnosable. =C2=A0Has been useful for automated testing of NFS, XFS, and CXFS in SGI.

Weber
-----

Test load generator for NFS. =C2=A0Uses multiple threads, multiple sockets<= br> and multiple IP addresses to simulate loads from many machines,
thus enabling testing of NFS server setups with larger client counts
than can be tested with physical infrastructure (or Virtual Machine
clients). =C2=A0Has been useful in automated NFS testing and as a pinpoint<= br> NFS load generator tool for performance development.

NFS PMDA
--------

PCP Data Agent for extended NFS server statistics. =C2=A0Exports to PCP
the new statistics (measuring per-client and per-server performance)
which are provided by SGI's EnhancedNFS kernel patches.

Samba PMDA
----------

PCP Data Agent for extended Samba server statistics. =C2=A0Exports to
PCP the additional statistics (measuring per-client and per-server
performance) which are provided by SGI's patches to Samba.

Ddnfs
-----

Filesystem load generation program designed to simulate the IO
load placed on an XFS filesystem by the NFS server in response
to certain NFS loads. =C2=A0Intended for use in XFS automated testing,
to test performance and correctness of certain XFS functionality
not otherwise exercised by the existing XFS test suite, but never
integrated into XFSQA.

Pmapload
--------

Test suite for the portmap and rpcbind programs (which are
NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). =C2=A0Developed by SGI to test changes imported into those programs from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.

RPC Exerciser
-------------

Test suite for the userspace RPC infrastructure libraries, (which
are NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). =C2=A0Developed by SGI to test changes imported into those libraries from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.

Testfs
------

Linux kernel module which provides an in-memory filesystem which
forgets all data written to it. =C2=A0Also can be configured to simulate timing behaviour on reads and writes. =C2=A0This is useful for NFS
performance testing without a fast disk subsystem.

StReplay
--------

Program which reads the system call trace of another program (obtained
using the widely available strace utility) and replays the IO pattern.
This was intended to be used for automated NFS and XFS testing and
for NFS and XFS problem diagnosis, but was never completed as the
author transferred to another team. =C2=A0Could be the basis for a very
useful filesystem test tool.


--
Greg Banks, P.Engineer, SGI Australian Software Group.
the brightly coloured sporks of revolution.
I don't speak for SGI.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel= " in
the body of a message to major= domo@vger.kernel.org
More majordomo info at =C2=A0http://vger.kernel.org/majordomo-info.html Please read the FAQ at =C2=A0http://www.tux.org/lkml/



--
Regards & Th= anks--
Subrata
--0016e652f9f4285b3a046693c233-- --===============1540809793579693436== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------------ --===============1540809793579693436== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Ltp-list mailing list Ltp-list@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ltp-list --===============1540809793579693436==--