G'day,
SGI is releasing to the Open Source community a number of internal
SGI testing and debugging tools for NFS. Some of these tools are
also applicable to filesystems in general.
These tools are being released under the GNU General Public License
(GPL) version 2, in the hope that the Linux filesystem development
community may find them useful. They are provided as-is, without any
support. Please do not contact SGI for support on any of these tools.
Some of these tools are unfinished. Others rely on build
infrastructure in internal SGI trees which cannot be released.
The tools are provided as tarball snapshots of internal SGI source
control trees; for a number of technical reasons it is not possible
to provide access to those trees or to create external repositories.
The tools are available for download now at
http://oss.sgi.com/projects/nfs/testtools/
A brief description of each tool follows.
Checkstream
-----------
Simple data corruption testing utilities based on the concept of
generating a stream of small self-contained records which can be
decoded in a way which makes certain common data corruption modes
automatically diagnosable. Has been useful for automated testing of
NFS, XFS, and CXFS in SGI.
Weber
-----
Test load generator for NFS. Uses multiple threads, multiple sockets
and multiple IP addresses to simulate loads from many machines,
thus enabling testing of NFS server setups with larger client counts
than can be tested with physical infrastructure (or Virtual Machine
clients). Has been useful in automated NFS testing and as a pinpoint
NFS load generator tool for performance development.
NFS PMDA
--------
PCP Data Agent for extended NFS server statistics. Exports to PCP
the new statistics (measuring per-client and per-server performance)
which are provided by SGI's EnhancedNFS kernel patches.
Samba PMDA
----------
PCP Data Agent for extended Samba server statistics. Exports to
PCP the additional statistics (measuring per-client and per-server
performance) which are provided by SGI's patches to Samba.
Ddnfs
-----
Filesystem load generation program designed to simulate the IO
load placed on an XFS filesystem by the NFS server in response
to certain NFS loads. Intended for use in XFS automated testing,
to test performance and correctness of certain XFS functionality
not otherwise exercised by the existing XFS test suite, but never
integrated into XFSQA.
Pmapload
--------
Test suite for the portmap and rpcbind programs (which are
NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). Developed by SGI to
test changes imported into those programs from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.
RPC Exerciser
-------------
Test suite for the userspace RPC infrastructure libraries, (which
are NFS infrastructure components based on code open-sourced by Sun
Microsystems and used by every Unix and Linux). Developed by SGI to
test changes imported into those libraries from newer Sun source code
during the NFS on IPv6 work for Irix several years ago.
Testfs
------
Linux kernel module which provides an in-memory filesystem which
forgets all data written to it. Also can be configured to simulate
timing behaviour on reads and writes. This is useful for NFS
performance testing without a fast disk subsystem.
StReplay
--------
Program which reads the system call trace of another program (obtained
using the widely available strace utility) and replays the IO pattern.
This was intended to be used for automated NFS and XFS testing and
for NFS and XFS problem diagnosis, but was never completed as the
author transferred to another team. Could be the basis for a very
useful filesystem test tool.
--
Greg Banks, P.Engineer, SGI Australian Software Group.
the brightly coloured sporks of revolution.
I don't speak for SGI.
Hi Greg,
On Fri, 2009-04-03 at 08:44 +1100, Greg Banks wrote:
> On Fri, Apr 3, 2009 at 2:05 AM, Subrata Modak <[email protected]> wrote:
> > Hi Greg,
> >
> > On Thu, Apr 2, 2009 at 7:58 PM, Greg Banks <[email protected]> wrote:
> >>
> >> The tools are available for download now at
> >>
> >> http://oss.sgi.com/projects/nfs/testtools/
> >
> > Since, these are released under GPL, i hope integrating them inside LTP
> > (http://ltp.sf.net) after proper analysis will not be an issue.
>
> Not an issue at all, in fact it would be the optimal result. The
> question was asked during the open source review process :-)
>
> > Since, no
> > support for these tests will be available from SGI, i am hoping that having
> > them inside LTP will be beneficial and help these tests to evolve in the
> > long run.
>
> Great. I'll have some spare time starting from next week and I'm
> familiar with the tools: how can I help?
Thanks for offering to help. I will get back to you sooner on any
issue(s) i face.
Regards--
Subrata
>
Hi Greg,
On Thu, Apr 2, 2009 at 7:58 PM, Greg Banks <[email protected]> wrote:
> G'day,
>
> SGI is releasing to the Open Source community a number of internal
> SGI testing and debugging tools for NFS. Some of these tools are
> also applicable to filesystems in general.
>
> These tools are being released under the GNU General Public License
> (GPL) version 2, in the hope that the Linux filesystem development
> community may find them useful. They are provided as-is, without any
> support. Please do not contact SGI for support on any of these tools.
>
> Some of these tools are unfinished. Others rely on build
> infrastructure in internal SGI trees which cannot be released.
> The tools are provided as tarball snapshots of internal SGI source
> control trees; for a number of technical reasons it is not possible
> to provide access to those trees or to create external repositories.
>
> The tools are available for download now at
>
> http://oss.sgi.com/projects/nfs/testtools/
Since, these are released under GPL, i hope integrating them inside LTP (
http://ltp.sf.net) after proper analysis will not be an issue. Since, no
support for these tests will be available from SGI, i am hoping that having
them inside LTP will be beneficial and help these tests to evolve in the
long run.
Regards--
Subrata
(Happens to maintain LTP :-))
>
> A brief description of each tool follows.
>
> Checkstream
> -----------
>
> Simple data corruption testing utilities based on the concept of
> generating a stream of small self-contained records which can be
> decoded in a way which makes certain common data corruption modes
> automatically diagnosable. Has been useful for automated testing of
> NFS, XFS, and CXFS in SGI.
>
> Weber
> -----
>
> Test load generator for NFS. Uses multiple threads, multiple sockets
> and multiple IP addresses to simulate loads from many machines,
> thus enabling testing of NFS server setups with larger client counts
> than can be tested with physical infrastructure (or Virtual Machine
> clients). Has been useful in automated NFS testing and as a pinpoint
> NFS load generator tool for performance development.
>
> NFS PMDA
> --------
>
> PCP Data Agent for extended NFS server statistics. Exports to PCP
> the new statistics (measuring per-client and per-server performance)
> which are provided by SGI's EnhancedNFS kernel patches.
>
> Samba PMDA
> ----------
>
> PCP Data Agent for extended Samba server statistics. Exports to
> PCP the additional statistics (measuring per-client and per-server
> performance) which are provided by SGI's patches to Samba.
>
> Ddnfs
> -----
>
> Filesystem load generation program designed to simulate the IO
> load placed on an XFS filesystem by the NFS server in response
> to certain NFS loads. Intended for use in XFS automated testing,
> to test performance and correctness of certain XFS functionality
> not otherwise exercised by the existing XFS test suite, but never
> integrated into XFSQA.
>
> Pmapload
> --------
>
> Test suite for the portmap and rpcbind programs (which are
> NFS infrastructure components based on code open-sourced by Sun
> Microsystems and used by every Unix and Linux). Developed by SGI to
> test changes imported into those programs from newer Sun source code
> during the NFS on IPv6 work for Irix several years ago.
>
> RPC Exerciser
> -------------
>
> Test suite for the userspace RPC infrastructure libraries, (which
> are NFS infrastructure components based on code open-sourced by Sun
> Microsystems and used by every Unix and Linux). Developed by SGI to
> test changes imported into those libraries from newer Sun source code
> during the NFS on IPv6 work for Irix several years ago.
>
> Testfs
> ------
>
> Linux kernel module which provides an in-memory filesystem which
> forgets all data written to it. Also can be configured to simulate
> timing behaviour on reads and writes. This is useful for NFS
> performance testing without a fast disk subsystem.
>
> StReplay
> --------
>
> Program which reads the system call trace of another program (obtained
> using the widely available strace utility) and replays the IO pattern.
> This was intended to be used for automated NFS and XFS testing and
> for NFS and XFS problem diagnosis, but was never completed as the
> author transferred to another team. Could be the basis for a very
> useful filesystem test tool.
>
>
> --
> Greg Banks, P.Engineer, SGI Australian Software Group.
> the brightly coloured sporks of revolution.
> I don't speak for SGI.
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/
>
--
Regards & Thanks--
Subrata
On Fri, Apr 3, 2009 at 2:05 AM, Subrata Modak <[email protected]> wrote:
> Hi Greg,
>
> On Thu, Apr 2, 2009 at 7:58 PM, Greg Banks <[email protected]> wrote:
>>
>> The tools are available for download now at
>>
>> http://oss.sgi.com/projects/nfs/testtools/
>
> Since, these are released under GPL, i hope integrating them inside LTP
> (http://ltp.sf.net) after proper analysis will not be an issue.
Not an issue at all, in fact it would be the optimal result. The
question was asked during the open source review process :-)
> Since, no
> support for these tests will be available from SGI, i am hoping that having
> them inside LTP will be beneficial and help these tests to evolve in the
> long run.
Great. I'll have some spare time starting from next week and I'm
familiar with the tools: how can I help?
--
Greg.