Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1758617AbZATMmw (ORCPT ); Tue, 20 Jan 2009 07:42:52 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753463AbZATMmk (ORCPT ); Tue, 20 Jan 2009 07:42:40 -0500 Received: from victor.provo.novell.com ([137.65.250.26]:44724 "EHLO victor.provo.novell.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752190AbZATMmj (ORCPT ); Tue, 20 Jan 2009 07:42:39 -0500 Message-ID: <4975C76D.9020208@novell.com> Date: Tue, 20 Jan 2009 07:45:33 -0500 From: Gregory Haskins User-Agent: Thunderbird 2.0.0.18 (X11/20081112) MIME-Version: 1.0 To: "Ma, Chinang" CC: "Wilcox, Matthew R" , Steven Rostedt , Matthew Wilcox , Andrew Morton , James Bottomley , "linux-kernel@vger.kernel.org" , "Tripathi, Sharad C" , "arjan@linux.intel.com" , "Kleen, Andi" , "Siddha, Suresh B" , "Chilukuri, Harita" , "Styner, Douglas W" , "Wang, Peter Xihong" , "Nueckel, Hubert" , "chris.mason@oracle.com" , "linux-scsi@vger.kernel.org" , Andrew Vasquez , Anirban Chakraborty Subject: Re: Mainline kernel OLTP performance update References: <20090114163557.11e097f2.akpm@linux-foundation.org> <20090115012147.GW29283@parisc-linux.org> <20090114180431.f4a96543.akpm@linux-foundation.org> <1232028766.5966.10.camel@localhost.localdomain> <20090115094442.b6394544.akpm@linux-foundation.org> <20090115180052.GG29283@parisc-linux.org> <1232043287.21980.65.camel@localhost.localdomain> <496F8421.3070703@novell.com> <4970CE79.1080002@novell.com> In-Reply-To: <4970CE79.1080002@novell.com> X-Enigmail-Version: 0.95.7 OpenPGP: id=D8195319 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig1D8037201D5825D038EA98D2" Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2452 Lines: 73 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig1D8037201D5825D038EA98D2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Gregory Haskins wrote: > > Then, email the contents of /sys/kernel/debug/tracing/trace to me > > > =20 [ Chinang has performed the trace as requested, but replied with a reduced CC to avoid spamming people with a large file. This is restoring the original list] Ma, Chinang wrote: > Hi Gregory, > Trace in attachment. I trim down the distribution list. As the attachme= nt is quite big. > > Thanks, > -Chinang > =20 Hi Chinang, Thank you very much for taking the time to do this. I have analyzed the trace: I do not see any smoking gun w.r.t. the theory that we are over IPI'ing the system. There were holes in the data due to trace limitations that rendered some of the data inconclusive. However, the places where we did not run into trace limitations looked like everything was functioning as designed. That being said, I do see that you have a ton of prio 48(ish) threads that are over-straining the RT push logic. The interesting thing here is I recently pushed some patches to tip that have potential to help you here. Could you try your test using the sched/rt branch from -tip?=20 Here is a clone link, for your convenience: git://git.kernel.org/pub/scm/linux/kernel/git/x86/linux-2.6-tip.git sched= /rt For this run, do _not_ use the trace patch/config. I just want to see if you observe performance improvements with OLTP configured for RT prio when compared to historic rt-push/pull based kernels (including HEAD on linus.git, as tested in the last run) Thanks! -Greg --------------enig1D8037201D5825D038EA98D2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iEYEARECAAYFAkl1x20ACgkQlOSOBdgZUxl9DgCeMOkzM1OfIV5ALA2L9PvO05Gz G9AAn3CuAYh1/BNgv/fYwgwNa/O4nOEt =I2KJ -----END PGP SIGNATURE----- --------------enig1D8037201D5825D038EA98D2-- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/