Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752729AbXL3KNM (ORCPT ); Sun, 30 Dec 2007 05:13:12 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751182AbXL3KNC (ORCPT ); Sun, 30 Dec 2007 05:13:02 -0500 Received: from mail.isohunt.com ([208.71.112.20]:35433 "EHLO mail.isohunt.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751073AbXL3KM7 (ORCPT ); Sun, 30 Dec 2007 05:12:59 -0500 X-Greylist: delayed 400 seconds by postgrey-1.27 at vger.kernel.org; Sun, 30 Dec 2007 05:12:59 EST Date: Sun, 30 Dec 2007 02:06:14 -0800 From: "Robin H. Johnson" To: linux-kernel@vger.kernel.org Subject: Idle loadavg of ~1, maybe MD related Message-ID: <20071230100614.GX17327@curie-int.orbis-terrarum.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/LSm8UPTCLHL4o89" Content-Disposition: inline User-Agent: Mutt/1.5.16 (2007-06-09) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 10407 Lines: 229 --/LSm8UPTCLHL4o89 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable (Please CC me, I'm subbed to LKML). My G5, while running practically nothing (just sshd and some to watch the load), has a weird cycle of load averages. I think it might be related to M= D, simply because that's the only thing that is clocking up cputime. A full cycle lasts approximately 27 minutes. Mins Load 0-2 0.0-0.15 (stable, 0 level) 3-5 0.50, 0.80, 0.95 (fast increase) 6-21 0.95-1.10 (stable, 1 level) 22-24 0.9, 0.8, 0.1 (fast decrease, to 0 level) 25-27 0.2, 0.3, 0.15 (local maxima peak) Here's a graph of it, spanning 230 minutes: http://dev.gentoo.org/~robbat2/20071230-g5-loadavg-bug.png Processed data for the graph here: http://dev.gentoo.org/~robbat2/20071230-g5-loadavg-bug.txt For the entire 230 minute period, there was _no_ disk I/O. Not recorded by iostat, nor generated. # while true ; do uptime ; iostat -t 60 2 -N -d | tail -n15 ; done >/dev/s= hm/foo Example of single output pass for the above loop: 00:59:37 up 8:32, 2 users, load average: 0.02, 0.47, 0.66 Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn sda 0.00 0.00 0.00 0 0 sdb 0.00 0.00 0.00 0 0 md1 0.00 0.00 0.00 0 0 md0 0.00 0.00 0.00 0 0 md2 0.00 0.00 0.00 0 0 md3 0.00 0.00 0.00 0 0 vg-usr 0.00 0.00 0.00 0 0 vg-var 0.00 0.00 0.00 0 0 vg-tmp 0.00 0.00 0.00 0 0 vg-opt 0.00 0.00 0.00 0 0 vg-home 0.00 0.00 0.00 0 0 vg-usr_src 0.00 0.00 0.00 0 0 vg-usr_portage 0.00 0.00 0.00 0 0 This is basically 1842c7f2 from Linus's tree, my own stuff is config'd out = with =3Dn for the moment. And the problem does still occur in the main tree. Snippet from the head of 'top', sorting by cputime. top - 01:59:08 up 9:32, 2 users, load average: 1.04, 0.87, 0.70 Tasks: 74 total, 1 running, 73 sleeping, 0 stopped, 0 zombie Cpu0 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0= %st Cpu1 : 0.0%us, 0.5%sy, 0.0%ni, 99.5%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0= %st Cpu2 : 0.0%us, 0.2%sy, 0.0%ni, 99.8%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0= %st Cpu3 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0= %st Mem: 12074480k total, 292520k used, 11781960k free, 76812k buffers Swap: 8388536k total, 0k used, 8388536k free, 144276k cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 4635 root 15 -5 0 0 0 S 0 0.0 8:14.33 md3_raid1 3121 root 15 -5 0 0 0 S 1 0.0 3:15.12 md2_raid1 3098 root 15 -5 0 0 0 S 0 0.0 3:07.83 md1_raid1 3076 root 15 -5 0 0 0 S 0 0.0 0:45.82 md0_raid1 829 root 15 -5 0 0 0 D 0 0.0 0:01.85 kwindfarm 13 root 15 -5 0 0 0 S 0 0.0 0:01.41 ksoftirqd/3 18 root 15 -5 0 0 0 S 0 0.0 0:01.39 events/3 10 root 15 -5 0 0 0 S 0 0.0 0:00.94 ksoftirqd/2 1 root 20 0 1900 652 576 S 0 0.0 0:00.89 init 32086 root 20 0 9336 2696 2076 S 0 0.0 0:00.87 sshd # ver_linux Linux buck-int 2.6.24-rc6-prod-g6f0f5304 #10 SMP Sat Dec 29 05:11:24 PST 20= 07 ppc64 PPC970MP, altivec supported PowerMac11,2 GNU/Linux Gnu C 4.2.2 Gnu make 3.81 binutils 2.18 util-linux 2.13 mount 2.13 module-init-tools 3.4 e2fsprogs 1.40.3 reiserfsprogs 3.6.19 xfsprogs 2.9.4 quota-tools 3.15. PPP 2.4.4 Linux C Library 2.7 Dynamic linker (ldd) 2.7 Procps 3.2.7 Net-tools 1.60 Kbd 1.13 Sh-utils 6.9 udev 118 wireless-tools 29 Modules Loaded nfsd exportfs auth_rpcgss ipv6 unix tg3 nfs_acl lock= d sunrpc dm_mod # lsmod Module Size Used by nfsd 346552 1 exportfs 8392 1 nfsd auth_rpcgss 69152 1 nfsd ipv6 428760 20 unix 47384 13 tg3 159020 0 nfs_acl 6056 1 nfsd lockd 105248 1 nfsd sunrpc 281248 6 nfsd,auth_rpcgss,nfs_acl,lockd dm_mod 100520 15 # ps -ef UID PID PPID C STIME TTY TIME CMD root 1 0 0 Dec29 ? 00:00:00 init [3] root 2 0 0 Dec29 ? 00:00:00 [kthreadd] root 3 2 0 Dec29 ? 00:00:00 [migration/0] root 4 2 0 Dec29 ? 00:00:00 [ksoftirqd/0] root 5 2 0 Dec29 ? 00:00:00 [watchdog/0] root 6 2 0 Dec29 ? 00:00:00 [migration/1] root 7 2 0 Dec29 ? 00:00:00 [ksoftirqd/1] root 8 2 0 Dec29 ? 00:00:00 [watchdog/1] root 9 2 0 Dec29 ? 00:00:00 [migration/2] root 10 2 0 Dec29 ? 00:00:00 [ksoftirqd/2] root 11 2 0 Dec29 ? 00:00:00 [watchdog/2] root 12 2 0 Dec29 ? 00:00:00 [migration/3] root 13 2 0 Dec29 ? 00:00:01 [ksoftirqd/3] root 14 2 0 Dec29 ? 00:00:00 [watchdog/3] root 15 2 0 Dec29 ? 00:00:00 [events/0] root 16 2 0 Dec29 ? 00:00:00 [events/1] root 17 2 0 Dec29 ? 00:00:00 [events/2] root 18 2 0 Dec29 ? 00:00:01 [events/3] root 19 2 0 Dec29 ? 00:00:00 [khelper] root 103 2 0 Dec29 ? 00:00:00 [kblockd/0] root 104 2 0 Dec29 ? 00:00:00 [kblockd/1] root 105 2 0 Dec29 ? 00:00:00 [kblockd/2] root 106 2 0 Dec29 ? 00:00:00 [kblockd/3] root 114 2 0 Dec29 ? 00:00:00 [ata/0] root 115 2 0 Dec29 ? 00:00:00 [ata/1] root 116 2 0 Dec29 ? 00:00:00 [ata/2] root 117 2 0 Dec29 ? 00:00:00 [ata/3] root 118 2 0 Dec29 ? 00:00:00 [ata_aux] root 119 2 0 Dec29 ? 00:00:00 [ksuspend_usbd] root 125 2 0 Dec29 ? 00:00:00 [khubd] root 128 2 0 Dec29 ? 00:00:00 [kseriod] root 155 2 0 Dec29 ? 00:00:00 [pdflush] root 156 2 0 Dec29 ? 00:00:00 [pdflush] root 157 2 0 Dec29 ? 00:00:00 [kswapd0] root 205 2 0 Dec29 ? 00:00:00 [aio/0] root 206 2 0 Dec29 ? 00:00:00 [aio/1] root 207 2 0 Dec29 ? 00:00:00 [aio/2] root 208 2 0 Dec29 ? 00:00:00 [aio/3] root 829 2 0 Dec29 ? 00:00:01 [kwindfarm] root 841 2 0 Dec29 ? 00:00:00 [scsi_eh_0] root 843 2 0 Dec29 ? 00:00:00 [scsi_eh_1] root 845 2 0 Dec29 ? 00:00:00 [scsi_eh_2] root 847 2 0 Dec29 ? 00:00:00 [scsi_eh_3] root 2531 2 0 Dec29 ? 00:00:00 [rpciod/0] root 2532 2 0 Dec29 ? 00:00:00 [rpciod/1] root 2533 2 0 Dec29 ? 00:00:00 [rpciod/2] root 2534 2 0 Dec29 ? 00:00:00 [rpciod/3] root 3076 2 0 Dec29 ? 00:00:45 [md0_raid1] root 3098 2 0 Dec29 ? 00:03:07 [md1_raid1] root 3121 2 0 Dec29 ? 00:03:14 [md2_raid1] root 3169 2 0 Dec29 ? 00:00:00 [kjournald] root 3285 1 0 Dec29 ? 00:00:00 /sbin/udevd --daemon root 4635 2 1 Dec29 ? 00:08:12 [md3_raid1] root 4740 2 0 Dec29 ? 00:00:00 [kjournald] root 4741 2 0 Dec29 ? 00:00:00 [kjournald] root 4742 2 0 Dec29 ? 00:00:00 [kjournald] root 4743 2 0 Dec29 ? 00:00:00 [reiserfs/0] root 4744 2 0 Dec29 ? 00:00:00 [reiserfs/1] root 4745 2 0 Dec29 ? 00:00:00 [reiserfs/2] root 4746 2 0 Dec29 ? 00:00:00 [reiserfs/3] root 4747 2 0 Dec29 ? 00:00:00 [kjournald] root 5663 32089 0 01:57 pts/1 00:00:00 ps -ef root 7324 1 0 Dec29 ? 00:00:00 /sbin/dhcpcd -h buck-int -t= 10 -R -N -Y -I -R -N -Y eth0 root 8340 1 0 Dec29 ? 00:00:00 /usr/sbin/sshd root 8517 1 0 Dec29 tty1 00:00:00 /sbin/agetty 38400 tty1 lin= ux root 8518 1 0 Dec29 tty2 00:00:00 /sbin/agetty 38400 tty2 lin= ux root 8519 1 0 Dec29 tty3 00:00:00 /sbin/agetty 38400 tty3 lin= ux root 8521 1 0 Dec29 tty4 00:00:00 /sbin/agetty 38400 tty4 lin= ux root 8522 1 0 Dec29 tty5 00:00:00 /sbin/agetty 38400 tty5 lin= ux root 8524 1 0 Dec29 tty6 00:00:00 /sbin/agetty 38400 tty6 lin= ux root 9436 8340 0 Dec29 ? 00:00:00 sshd: root@pts/0 root 9440 9436 0 Dec29 pts/0 00:00:00 -bash root 32086 8340 0 Dec29 ? 00:00:00 sshd: root@pts/1 root 32089 32086 0 Dec29 pts/1 00:00:00 -bash --=20 Robin Hugh Johnson Gentoo Linux Developer & Infra Guy E-Mail : robbat2@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 --/LSm8UPTCLHL4o89 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.8 (GNU/Linux) Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iEYEARECAAYFAkd3bZYACgkQPpIsIjIzwiyZNQCfczfPOA2d4UE9ZYboxkWImRU6 hssAoKLq1KDgX7r0xByGtD7d57gYvqLz =sYJ0 -----END PGP SIGNATURE----- --/LSm8UPTCLHL4o89-- -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/