2006-08-06 10:00:54

by Matthias Dahl

[permalink] [raw]
Subject: sluggish system responsiveness under higher IO load

Hello everyone.

Since I bought my current system, I have experienced sluggish system
responsiveness when the IO load increases to a certain point.

For example: when I emerge (gentoo system) new kernel sources, during the
untar process of the archive, Xorg gets sluggish, meaning you can sometimes
see the entire desktop or windows repainting or the mouse pointer jumps
around. From time to time, depending on the IO load, even typing in the
console doesn't respond right away.

I opened a thread in the gentoo support forum for amd64 which brought some
details to light: it doesn't seem to be a nforce4 or amd64 related problem,
because other people on newer intel based systems run into exactly the same
problems. It looks like a general sata issue. Here a link to the thread:

http://forums.gentoo.org/viewtopic-t-482731.html

For the sake of completeness, here my system stats: AMD64 3500+ (Winchester),
Nforce4 Ultra (Gigabyte K8N-Ultra9 board), 1 GiG ram, Samsung SP1614C sata
disk (rev SW10). I am utilizing a up2date 64 bit gentoo system and tried
different kernels (current git snapshots, vanilla and others). (currently
gentoo based sources 2.6.17-r4). Bbased on reports in the above mentioned
thread, this issue still exists in the current 2.6.18 tree.

Below my kernel config and boot msgs. Please cc' replies to me as I am not
subscribed to the list.

If I can be of any help in tracking this down, just let me know.

Have a nice weekend,
matthew.

------------------------------------------------------------------------------
#
# Automatically generated make config: don't edit
# Linux kernel version: 2.6.17-gentoo-r4
# Fri Jul 28 23:23:55 2006
#
CONFIG_X86_64=y
CONFIG_64BIT=y
CONFIG_X86=y
CONFIG_SEMAPHORE_SLEEPERS=y
CONFIG_MMU=y
CONFIG_RWSEM_GENERIC_SPINLOCK=y
CONFIG_GENERIC_HWEIGHT=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_X86_CMPXCHG=y
CONFIG_EARLY_PRINTK=y
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_IOMAP=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_DMI=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_BROKEN_ON_SMP=y
CONFIG_LOCK_KERNEL=y
CONFIG_INIT_ENV_ARG_LIMIT=32

#
# General setup
#
CONFIG_LOCALVERSION=""
# CONFIG_LOCALVERSION_AUTO is not set
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_POSIX_MQUEUE=y
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
# CONFIG_RELAY is not set
CONFIG_INITRAMFS_SOURCE=""
CONFIG_UID16=y
CONFIG_VM86=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_HOTPLUG=y
CONFIG_PRINTK=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_SHMEM=y
CONFIG_SLAB=y
# CONFIG_TINY_SHMEM is not set
CONFIG_BASE_SMALL=0
# CONFIG_SLOB is not set

#
# Loadable module support
#
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
# CONFIG_MODULE_FORCE_UNLOAD is not set
# CONFIG_MODVERSIONS is not set
# CONFIG_MODULE_SRCVERSION_ALL is not set
CONFIG_KMOD=y

#
# Block layer
#
# CONFIG_LBD is not set
# CONFIG_BLK_DEV_IO_TRACE is not set
# CONFIG_LSF is not set

#
# IO Schedulers
#
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_DEFAULT_AS is not set
# CONFIG_DEFAULT_DEADLINE is not set
CONFIG_DEFAULT_CFQ=y
# CONFIG_DEFAULT_NOOP is not set
CONFIG_DEFAULT_IOSCHED="cfq"

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_VSMP is not set
CONFIG_MK8=y
# CONFIG_MPSC is not set
# CONFIG_GENERIC_CPU is not set
CONFIG_X86_L1_CACHE_BYTES=64
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_INTERNODE_CACHE_BYTES=64
CONFIG_X86_TSC=y
CONFIG_X86_GOOD_APIC=y
# CONFIG_MICROCODE is not set
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_MTRR=y
# CONFIG_SMP is not set
# CONFIG_PREEMPT_NONE is not set
# CONFIG_PREEMPT_VOLUNTARY is not set
CONFIG_PREEMPT=y
CONFIG_PREEMPT_BKL=y
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_FLATMEM_ENABLE=y
CONFIG_SELECT_MEMORY_MODEL=y
# CONFIG_FLATMEM_MANUAL is not set
# CONFIG_DISCONTIGMEM_MANUAL is not set
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_HAVE_MEMORY_PRESENT=y
# CONFIG_SPARSEMEM_STATIC is not set
CONFIG_SPARSEMEM_EXTREME=y
# CONFIG_MEMORY_HOTPLUG is not set
CONFIG_SPLIT_PTLOCK_CPUS=4
CONFIG_HPET_TIMER=y
# CONFIG_HPET_EMULATE_RTC is not set
CONFIG_GART_IOMMU=y
CONFIG_SWIOTLB=y
CONFIG_X86_MCE=y
# CONFIG_X86_MCE_INTEL is not set
CONFIG_X86_MCE_AMD=y
# CONFIG_KEXEC is not set
# CONFIG_CRASH_DUMP is not set
CONFIG_PHYSICAL_START=0x200000
CONFIG_SECCOMP=y
# CONFIG_HZ_100 is not set
CONFIG_HZ_250=y
# CONFIG_HZ_1000 is not set
CONFIG_HZ=250
CONFIG_REORDER=y
CONFIG_GENERIC_HARDIRQS=y
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_ISA_DMA_API=y

#
# Power management options
#
CONFIG_PM=y
CONFIG_PM_LEGACY=y
# CONFIG_PM_DEBUG is not set
# CONFIG_SOFTWARE_SUSPEND is not set

#
# ACPI (Advanced Configuration and Power Interface) Support
#
CONFIG_ACPI=y
# CONFIG_ACPI_SLEEP is not set
# CONFIG_ACPI_AC is not set
# CONFIG_ACPI_BATTERY is not set
CONFIG_ACPI_BUTTON=y
# CONFIG_ACPI_VIDEO is not set
# CONFIG_ACPI_HOTKEY is not set
CONFIG_ACPI_FAN=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_THERMAL=y
# CONFIG_ACPI_ASUS is not set
# CONFIG_ACPI_IBM is not set
# CONFIG_ACPI_TOSHIBA is not set
CONFIG_ACPI_BLACKLIST_YEAR=0
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_EC=y
CONFIG_ACPI_POWER=y
CONFIG_ACPI_SYSTEM=y
CONFIG_X86_PM_TIMER=y
# CONFIG_ACPI_CONTAINER is not set
# CONFIG_ACPI_HOTPLUG_MEMORY is not set

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y
CONFIG_CPU_FREQ_TABLE=y
# CONFIG_CPU_FREQ_DEBUG is not set
CONFIG_CPU_FREQ_STAT=y
CONFIG_CPU_FREQ_STAT_DETAILS=y
CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set
CONFIG_CPU_FREQ_GOV_PERFORMANCE=y
CONFIG_CPU_FREQ_GOV_POWERSAVE=y
CONFIG_CPU_FREQ_GOV_USERSPACE=y
CONFIG_CPU_FREQ_GOV_ONDEMAND=y
CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y

#
# CPUFreq processor drivers
#
CONFIG_X86_POWERNOW_K8=y
CONFIG_X86_POWERNOW_K8_ACPI=y
# CONFIG_X86_SPEEDSTEP_CENTRINO is not set
# CONFIG_X86_ACPI_CPUFREQ is not set

#
# shared options
#
CONFIG_X86_ACPI_CPUFREQ_PROC_INTF=y
# CONFIG_X86_SPEEDSTEP_LIB is not set

#
# Bus options (PCI etc.)
#
CONFIG_PCI=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_PCIEPORTBUS=y
CONFIG_PCI_MSI=y
# CONFIG_PCI_DEBUG is not set

#
# PCCARD (PCMCIA/CardBus) support
#
# CONFIG_PCCARD is not set

#
# PCI Hotplug Support
#
# CONFIG_HOTPLUG_PCI is not set

#
# Executable file formats / Emulations
#
CONFIG_BINFMT_ELF=y
CONFIG_BINFMT_MISC=y
CONFIG_IA32_EMULATION=y
CONFIG_IA32_AOUT=y
CONFIG_COMPAT=y
CONFIG_SYSVIPC_COMPAT=y

#
# Networking
#
CONFIG_NET=y

#
# Networking options
#
# CONFIG_NETDEBUG is not set
CONFIG_PACKET=y
CONFIG_PACKET_MMAP=y
CONFIG_UNIX=y
CONFIG_XFRM=y
CONFIG_XFRM_USER=y
CONFIG_NET_KEY=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
# CONFIG_IP_ADVANCED_ROUTER is not set
CONFIG_IP_FIB_HASH=y
# CONFIG_IP_PNP is not set
CONFIG_NET_IPIP=m
# CONFIG_NET_IPGRE is not set
# CONFIG_IP_MROUTE is not set
# CONFIG_ARPD is not set
# CONFIG_SYN_COOKIES is not set
# CONFIG_INET_AH is not set
# CONFIG_INET_ESP is not set
# CONFIG_INET_IPCOMP is not set
# CONFIG_INET_XFRM_TUNNEL is not set
CONFIG_INET_TUNNEL=m
# CONFIG_INET_DIAG is not set
# CONFIG_TCP_CONG_ADVANCED is not set
CONFIG_TCP_CONG_BIC=y

#
# IP: Virtual Server Configuration
#
# CONFIG_IP_VS is not set
# CONFIG_IPV6 is not set
# CONFIG_INET6_XFRM_TUNNEL is not set
# CONFIG_INET6_TUNNEL is not set
CONFIG_NETFILTER=y
# CONFIG_NETFILTER_DEBUG is not set

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_NETLINK=m
CONFIG_NETFILTER_NETLINK_QUEUE=m
CONFIG_NETFILTER_NETLINK_LOG=m
CONFIG_NETFILTER_XTABLES=m
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=m
CONFIG_NETFILTER_XT_TARGET_CONNMARK=m
CONFIG_NETFILTER_XT_TARGET_MARK=m
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
CONFIG_NETFILTER_XT_TARGET_NOTRACK=m
CONFIG_NETFILTER_XT_MATCH_COMMENT=m
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=m
CONFIG_NETFILTER_XT_MATCH_CONNMARK=m
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=m
CONFIG_NETFILTER_XT_MATCH_DCCP=m
CONFIG_NETFILTER_XT_MATCH_ESP=m
CONFIG_NETFILTER_XT_MATCH_HELPER=m
CONFIG_NETFILTER_XT_MATCH_LENGTH=m
CONFIG_NETFILTER_XT_MATCH_LIMIT=m
CONFIG_NETFILTER_XT_MATCH_MAC=m
CONFIG_NETFILTER_XT_MATCH_MARK=m
CONFIG_NETFILTER_XT_MATCH_POLICY=m
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=m
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=m
CONFIG_NETFILTER_XT_MATCH_REALM=m
CONFIG_NETFILTER_XT_MATCH_SCTP=m
CONFIG_NETFILTER_XT_MATCH_STATE=m
CONFIG_NETFILTER_XT_MATCH_STRING=m
CONFIG_NETFILTER_XT_MATCH_TCPMSS=m

#
# IP: Netfilter Configuration
#
CONFIG_IP_NF_CONNTRACK=m
CONFIG_IP_NF_CT_ACCT=y
CONFIG_IP_NF_CONNTRACK_MARK=y
CONFIG_IP_NF_CONNTRACK_EVENTS=y
CONFIG_IP_NF_CONNTRACK_NETLINK=m
CONFIG_IP_NF_CT_PROTO_SCTP=m
CONFIG_IP_NF_FTP=m
CONFIG_IP_NF_IRC=m
CONFIG_IP_NF_NETBIOS_NS=m
CONFIG_IP_NF_TFTP=m
CONFIG_IP_NF_AMANDA=m
CONFIG_IP_NF_PPTP=m
CONFIG_IP_NF_H323=m
CONFIG_IP_NF_QUEUE=m
CONFIG_IP_NF_IPTABLES=m
CONFIG_IP_NF_MATCH_IPRANGE=m
CONFIG_IP_NF_MATCH_TOS=m
CONFIG_IP_NF_MATCH_RECENT=m
CONFIG_IP_NF_MATCH_ECN=m
CONFIG_IP_NF_MATCH_DSCP=m
CONFIG_IP_NF_MATCH_AH=m
CONFIG_IP_NF_MATCH_TTL=m
CONFIG_IP_NF_MATCH_OWNER=m
CONFIG_IP_NF_MATCH_ADDRTYPE=m
CONFIG_IP_NF_MATCH_HASHLIMIT=m
CONFIG_IP_NF_FILTER=m
CONFIG_IP_NF_TARGET_REJECT=m
CONFIG_IP_NF_TARGET_LOG=m
CONFIG_IP_NF_TARGET_ULOG=m
CONFIG_IP_NF_TARGET_TCPMSS=m
CONFIG_IP_NF_NAT=m
CONFIG_IP_NF_NAT_NEEDED=y
CONFIG_IP_NF_TARGET_MASQUERADE=m
CONFIG_IP_NF_TARGET_REDIRECT=m
CONFIG_IP_NF_TARGET_NETMAP=m
CONFIG_IP_NF_TARGET_SAME=m
CONFIG_IP_NF_NAT_SNMP_BASIC=m
CONFIG_IP_NF_NAT_IRC=m
CONFIG_IP_NF_NAT_FTP=m
CONFIG_IP_NF_NAT_TFTP=m
CONFIG_IP_NF_NAT_AMANDA=m
CONFIG_IP_NF_NAT_PPTP=m
CONFIG_IP_NF_NAT_H323=m
CONFIG_IP_NF_MANGLE=m
CONFIG_IP_NF_TARGET_TOS=m
CONFIG_IP_NF_TARGET_ECN=m
CONFIG_IP_NF_TARGET_DSCP=m
CONFIG_IP_NF_TARGET_TTL=m
CONFIG_IP_NF_TARGET_CLUSTERIP=m
CONFIG_IP_NF_RAW=m
CONFIG_IP_NF_ARPTABLES=m
CONFIG_IP_NF_ARPFILTER=m
CONFIG_IP_NF_ARP_MANGLE=m

#
# DCCP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_DCCP is not set

#
# SCTP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_SCTP is not set

#
# TIPC Configuration (EXPERIMENTAL)
#
# CONFIG_TIPC is not set
# CONFIG_ATM is not set
# CONFIG_BRIDGE is not set
# CONFIG_VLAN_8021Q is not set
# CONFIG_DECNET is not set
# CONFIG_LLC2 is not set
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_NET_DIVERT is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set

#
# QoS and/or fair queueing
#
# CONFIG_NET_SCHED is not set
CONFIG_NET_CLS_ROUTE=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
# CONFIG_IEEE80211 is not set

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_STANDALONE=y
CONFIG_PREVENT_FIRMWARE_BUILD=y
# CONFIG_FW_LOADER is not set
# CONFIG_DEBUG_DRIVER is not set

#
# Connector - unified userspace <-> kernelspace linker
#
CONFIG_CONNECTOR=m

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
# CONFIG_PARPORT is not set

#
# Plug and Play support
#
CONFIG_PNP=y
# CONFIG_PNP_DEBUG is not set

#
# Protocols
#
CONFIG_PNPACPI=y

#
# Block devices
#
# CONFIG_BLK_DEV_FD is not set
# CONFIG_BLK_CPQ_DA is not set
# CONFIG_BLK_CPQ_CISS_DA is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_COW_COMMON is not set
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_CRYPTOLOOP=m
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_UB is not set
CONFIG_BLK_DEV_RAM=m
CONFIG_BLK_DEV_RAM_COUNT=16
CONFIG_BLK_DEV_RAM_SIZE=8192
# CONFIG_BLK_DEV_INITRD is not set
CONFIG_CDROM_PKTCDVD=y
CONFIG_CDROM_PKTCDVD_BUFFERS=16
# CONFIG_CDROM_PKTCDVD_WCACHE is not set
# CONFIG_ATA_OVER_ETH is not set

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
# CONFIG_IDEDISK_MULTI_MODE is not set
CONFIG_BLK_DEV_IDECD=y
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set

#
# IDE chipset support/bugfixes
#
# CONFIG_IDE_GENERIC is not set
# CONFIG_BLK_DEV_CMD640 is not set
# CONFIG_BLK_DEV_IDEPNP is not set
CONFIG_BLK_DEV_IDEPCI=y
# CONFIG_IDEPCI_SHARE_IRQ is not set
# CONFIG_BLK_DEV_OFFBOARD is not set
# CONFIG_BLK_DEV_GENERIC is not set
# CONFIG_BLK_DEV_OPTI621 is not set
# CONFIG_BLK_DEV_RZ1000 is not set
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
CONFIG_BLK_DEV_AMD74XX=y
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CY82C693 is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_HPT34X is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_SC1200 is not set
# CONFIG_BLK_DEV_PIIX is not set
# CONFIG_BLK_DEV_IT821X is not set
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
# CONFIG_BLK_DEV_SVWKS is not set
# CONFIG_BLK_DEV_SIIMAGE is not set
# CONFIG_BLK_DEV_SIS5513 is not set
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
# CONFIG_BLK_DEV_VIA82CXXX is not set
# CONFIG_IDE_ARM is not set
CONFIG_BLK_DEV_IDEDMA=y
CONFIG_IDEDMA_IVB=y
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
# CONFIG_RAID_ATTRS is not set
CONFIG_SCSI=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
# CONFIG_BLK_DEV_SR is not set
# CONFIG_CHR_DEV_SG is not set
# CONFIG_CHR_DEV_SCH is not set

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
# CONFIG_SCSI_MULTI_LUN is not set
CONFIG_SCSI_CONSTANTS=y
# CONFIG_SCSI_LOGGING is not set

#
# SCSI Transport Attributes
#
CONFIG_SCSI_SPI_ATTRS=y
# CONFIG_SCSI_FC_ATTRS is not set
# CONFIG_SCSI_ISCSI_ATTRS is not set
# CONFIG_SCSI_SAS_ATTRS is not set

#
# SCSI low-level drivers
#
# CONFIG_ISCSI_TCP is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
CONFIG_SCSI_SATA=y
CONFIG_SCSI_SATA_AHCI=y
# CONFIG_SCSI_SATA_SVW is not set
# CONFIG_SCSI_ATA_PIIX is not set
# CONFIG_SCSI_SATA_MV is not set
CONFIG_SCSI_SATA_NV=y
# CONFIG_SCSI_PDC_ADMA is not set
# CONFIG_SCSI_SATA_QSTOR is not set
# CONFIG_SCSI_SATA_PROMISE is not set
# CONFIG_SCSI_SATA_SX4 is not set
# CONFIG_SCSI_SATA_SIL is not set
# CONFIG_SCSI_SATA_SIL24 is not set
# CONFIG_SCSI_SATA_SIS is not set
# CONFIG_SCSI_SATA_ULI is not set
# CONFIG_SCSI_SATA_VIA is not set
# CONFIG_SCSI_SATA_VITESSE is not set
CONFIG_SCSI_SATA_INTEL_COMBINED=y
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_DEBUG is not set

#
# Multi-device support (RAID and LVM)
#
# CONFIG_MD is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set
# CONFIG_FUSION_SPI is not set
# CONFIG_FUSION_FC is not set
# CONFIG_FUSION_SAS is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_IEEE1394 is not set

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Network device support
#
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
CONFIG_TUN=m
# CONFIG_NET_SB1000 is not set

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# PHY device support
#
CONFIG_PHYLIB=y

#
# MII PHY device drivers
#
# CONFIG_MARVELL_PHY is not set
# CONFIG_DAVICOM_PHY is not set
# CONFIG_QSEMI_PHY is not set
# CONFIG_LXT_PHY is not set
# CONFIG_CICADA_PHY is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_CASSINI is not set
# CONFIG_NET_VENDOR_3COM is not set

#
# Tulip family network device support
#
# CONFIG_NET_TULIP is not set
# CONFIG_HP100 is not set
CONFIG_NET_PCI=y
# CONFIG_PCNET32 is not set
# CONFIG_AMD8111_ETH is not set
# CONFIG_ADAPTEC_STARFIRE is not set
# CONFIG_B44 is not set
CONFIG_FORCEDETH=y
# CONFIG_DGRS is not set
# CONFIG_EEPRO100 is not set
# CONFIG_E100 is not set
# CONFIG_FEALNX is not set
# CONFIG_NATSEMI is not set
# CONFIG_NE2K_PCI is not set
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
# CONFIG_SIS900 is not set
# CONFIG_EPIC100 is not set
# CONFIG_SUNDANCE is not set
# CONFIG_VIA_RHINE is not set

#
# Ethernet (1000 Mbit)
#
# CONFIG_ACENIC is not set
# CONFIG_DL2K is not set
# CONFIG_E1000 is not set
# CONFIG_NS83820 is not set
# CONFIG_HAMACHI is not set
# CONFIG_YELLOWFIN is not set
# CONFIG_R8169 is not set
# CONFIG_SIS190 is not set
CONFIG_SKGE=m
# CONFIG_SKY2 is not set
# CONFIG_SK98LIN is not set
# CONFIG_VIA_VELOCITY is not set
# CONFIG_TIGON3 is not set
# CONFIG_BNX2 is not set

#
# Ethernet (10000 Mbit)
#
# CONFIG_CHELSIO_T1 is not set
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
# CONFIG_TR is not set

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NET_FC is not set
# CONFIG_SHAPER is not set
# CONFIG_NETCONSOLE is not set
# CONFIG_NETPOLL is not set
# CONFIG_NET_POLL_CONTROLLER is not set

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
# CONFIG_INPUT_MOUSEDEV_PSAUX is not set
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_TSDEV is not set
CONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
# CONFIG_MOUSE_SERIAL is not set
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_PCSPKR is not set
CONFIG_INPUT_UINPUT=y

#
# Hardware I/O ports
#
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
# CONFIG_SERIO_SERPORT is not set
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set
CONFIG_SERIO_LIBPS2=y
# CONFIG_SERIO_RAW is not set
# CONFIG_GAMEPORT is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
# CONFIG_SERIAL_NONSTANDARD is not set

#
# Serial drivers
#
# CONFIG_SERIAL_8250 is not set

#
# Non-8250 serial port support
#
# CONFIG_SERIAL_JSM is not set
CONFIG_UNIX98_PTYS=y
# CONFIG_LEGACY_PTYS is not set

#
# IPMI
#
# CONFIG_IPMI_HANDLER is not set

#
# Watchdog Cards
#
# CONFIG_WATCHDOG is not set
CONFIG_HW_RANDOM=y
CONFIG_NVRAM=m
CONFIG_RTC=y
# CONFIG_DTLK is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set

#
# Ftape, the floppy tape device driver
#
# CONFIG_FTAPE is not set
CONFIG_AGP=y
CONFIG_AGP_AMD64=y
# CONFIG_AGP_INTEL is not set
# CONFIG_AGP_SIS is not set
# CONFIG_AGP_VIA is not set
CONFIG_DRM=m
# CONFIG_DRM_TDFX is not set
# CONFIG_DRM_R128 is not set
# CONFIG_DRM_RADEON is not set
# CONFIG_DRM_MGA is not set
# CONFIG_DRM_SIS is not set
# CONFIG_DRM_VIA is not set
# CONFIG_DRM_SAVAGE is not set
# CONFIG_MWAVE is not set
# CONFIG_RAW_DRIVER is not set
# CONFIG_HPET is not set
# CONFIG_HANGCHECK_TIMER is not set

#
# TPM devices
#
# CONFIG_TCG_TPM is not set
# CONFIG_TELCLOCK is not set

#
# I2C support
#
CONFIG_I2C=y
CONFIG_I2C_CHARDEV=y

#
# I2C Algorithms
#
CONFIG_I2C_ALGOBIT=y
CONFIG_I2C_ALGOPCF=y
CONFIG_I2C_ALGOPCA=y

#
# I2C Hardware Bus support
#
# CONFIG_I2C_ALI1535 is not set
# CONFIG_I2C_ALI1563 is not set
# CONFIG_I2C_ALI15X3 is not set
CONFIG_I2C_AMD756=m
# CONFIG_I2C_AMD756_S4882 is not set
# CONFIG_I2C_AMD8111 is not set
# CONFIG_I2C_I801 is not set
# CONFIG_I2C_I810 is not set
# CONFIG_I2C_PIIX4 is not set
CONFIG_I2C_ISA=m
CONFIG_I2C_NFORCE2=m
# CONFIG_I2C_PARPORT_LIGHT is not set
# CONFIG_I2C_PROSAVAGE is not set
# CONFIG_I2C_SAVAGE4 is not set
# CONFIG_I2C_SIS5595 is not set
# CONFIG_I2C_SIS630 is not set
# CONFIG_I2C_SIS96X is not set
# CONFIG_I2C_STUB is not set
# CONFIG_I2C_VIA is not set
# CONFIG_I2C_VIAPRO is not set
# CONFIG_I2C_VOODOO3 is not set
# CONFIG_I2C_PCA_ISA is not set

#
# Miscellaneous I2C Chip support
#
# CONFIG_SENSORS_DS1337 is not set
# CONFIG_SENSORS_DS1374 is not set
CONFIG_SENSORS_EEPROM=m
# CONFIG_SENSORS_PCF8574 is not set
# CONFIG_SENSORS_PCA9539 is not set
# CONFIG_SENSORS_PCF8591 is not set
# CONFIG_SENSORS_MAX6875 is not set
# CONFIG_I2C_DEBUG_CORE is not set
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# CONFIG_I2C_DEBUG_CHIP is not set

#
# SPI support
#
# CONFIG_SPI is not set
# CONFIG_SPI_MASTER is not set

#
# Dallas's 1-wire bus
#
# CONFIG_W1 is not set

#
# Hardware Monitoring support
#
CONFIG_HWMON=y
CONFIG_HWMON_VID=m
# CONFIG_SENSORS_ADM1021 is not set
# CONFIG_SENSORS_ADM1025 is not set
# CONFIG_SENSORS_ADM1026 is not set
# CONFIG_SENSORS_ADM1031 is not set
# CONFIG_SENSORS_ADM9240 is not set
# CONFIG_SENSORS_ASB100 is not set
# CONFIG_SENSORS_ATXP1 is not set
# CONFIG_SENSORS_DS1621 is not set
# CONFIG_SENSORS_F71805F is not set
# CONFIG_SENSORS_FSCHER is not set
# CONFIG_SENSORS_FSCPOS is not set
# CONFIG_SENSORS_GL518SM is not set
# CONFIG_SENSORS_GL520SM is not set
CONFIG_SENSORS_IT87=m
# CONFIG_SENSORS_LM63 is not set
# CONFIG_SENSORS_LM75 is not set
# CONFIG_SENSORS_LM77 is not set
# CONFIG_SENSORS_LM78 is not set
# CONFIG_SENSORS_LM80 is not set
# CONFIG_SENSORS_LM83 is not set
# CONFIG_SENSORS_LM85 is not set
# CONFIG_SENSORS_LM87 is not set
# CONFIG_SENSORS_LM90 is not set
# CONFIG_SENSORS_LM92 is not set
# CONFIG_SENSORS_MAX1619 is not set
# CONFIG_SENSORS_PC87360 is not set
# CONFIG_SENSORS_SIS5595 is not set
# CONFIG_SENSORS_SMSC47M1 is not set
# CONFIG_SENSORS_SMSC47B397 is not set
# CONFIG_SENSORS_VIA686A is not set
# CONFIG_SENSORS_VT8231 is not set
# CONFIG_SENSORS_W83781D is not set
# CONFIG_SENSORS_W83792D is not set
# CONFIG_SENSORS_W83L785TS is not set
# CONFIG_SENSORS_W83627HF is not set
# CONFIG_SENSORS_W83627EHF is not set
# CONFIG_SENSORS_HDAPS is not set
# CONFIG_HWMON_DEBUG_CHIP is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
CONFIG_VIDEO_DEV=y
CONFIG_VIDEO_V4L1=y
CONFIG_VIDEO_V4L1_COMPAT=y
CONFIG_VIDEO_V4L2=y

#
# Video Capture Adapters
#

#
# Video Capture Adapters
#
# CONFIG_VIDEO_ADV_DEBUG is not set
# CONFIG_VIDEO_VIVI is not set
# CONFIG_VIDEO_BT848 is not set
# CONFIG_VIDEO_CPIA is not set
# CONFIG_VIDEO_CPIA2 is not set
# CONFIG_VIDEO_SAA5246A is not set
# CONFIG_VIDEO_SAA5249 is not set
# CONFIG_TUNER_3036 is not set
# CONFIG_VIDEO_STRADIS is not set
# CONFIG_VIDEO_ZORAN is not set
CONFIG_VIDEO_SAA7134=m
# CONFIG_VIDEO_MXB is not set
# CONFIG_VIDEO_DPC is not set
# CONFIG_VIDEO_HEXIUM_ORION is not set
# CONFIG_VIDEO_HEXIUM_GEMINI is not set
# CONFIG_VIDEO_CX88 is not set
# CONFIG_VIDEO_OVCAMCHIP is not set

#
# Encoders and Decoders
#
# CONFIG_VIDEO_MSP3400 is not set
# CONFIG_VIDEO_CS53L32A is not set
# CONFIG_VIDEO_WM8775 is not set
# CONFIG_VIDEO_WM8739 is not set
# CONFIG_VIDEO_CX25840 is not set
# CONFIG_VIDEO_SAA711X is not set
# CONFIG_VIDEO_SAA7127 is not set
# CONFIG_VIDEO_UPD64031A is not set
# CONFIG_VIDEO_UPD64083 is not set

#
# V4L USB devices
#
# CONFIG_VIDEO_EM28XX is not set
# CONFIG_USB_DSBR is not set
# CONFIG_USB_VICAM is not set
# CONFIG_USB_IBMCAM is not set
# CONFIG_USB_KONICAWC is not set
# CONFIG_USB_ET61X251 is not set
# CONFIG_USB_OV511 is not set
# CONFIG_USB_SE401 is not set
# CONFIG_USB_SN9C102 is not set
# CONFIG_USB_STV680 is not set
# CONFIG_USB_W9968CF is not set
# CONFIG_USB_ZC0301 is not set
# CONFIG_USB_PWC is not set

#
# Radio Adapters
#
# CONFIG_RADIO_GEMTEK_PCI is not set
# CONFIG_RADIO_MAXIRADIO is not set
# CONFIG_RADIO_MAESTRO is not set

#
# Digital Video Broadcasting Devices
#
# CONFIG_DVB is not set
CONFIG_VIDEO_TUNER=m
CONFIG_VIDEO_BUF=m
CONFIG_VIDEO_IR=m
# CONFIG_USB_DABUSB is not set

#
# Graphics support
#
# CONFIG_FB is not set
# CONFIG_VIDEO_SELECT is not set

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_VGACON_SOFT_SCROLLBACK is not set
CONFIG_DUMMY_CONSOLE=y

#
# Speakup console speech
#
# CONFIG_SPEAKUP is not set
CONFIG_SPEAKUP_DEFAULT="none"

#
# Sound
#
CONFIG_SOUND=m

#
# Advanced Linux Sound Architecture
#
# CONFIG_SND is not set

#
# Open Sound System
#
# CONFIG_SOUND_PRIME is not set

#
# USB support
#
CONFIG_USB_ARCH_HAS_HCD=y
CONFIG_USB_ARCH_HAS_OHCI=y
CONFIG_USB_ARCH_HAS_EHCI=y
CONFIG_USB=y
# CONFIG_USB_DEBUG is not set

#
# Miscellaneous USB options
#
CONFIG_USB_DEVICEFS=y
# CONFIG_USB_BANDWIDTH is not set
# CONFIG_USB_DYNAMIC_MINORS is not set
CONFIG_USB_SUSPEND=y
# CONFIG_USB_OTG is not set

#
# USB Host Controller Drivers
#
CONFIG_USB_EHCI_HCD=y
# CONFIG_USB_EHCI_SPLIT_ISO is not set
CONFIG_USB_EHCI_ROOT_HUB_TT=y
# CONFIG_USB_ISP116X_HCD is not set
CONFIG_USB_OHCI_HCD=y
# CONFIG_USB_OHCI_BIG_ENDIAN is not set
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
# CONFIG_USB_UHCI_HCD is not set
# CONFIG_USB_SL811_HCD is not set

#
# USB Device Class drivers
#
# CONFIG_USB_ACM is not set
CONFIG_USB_PRINTER=m

#
# NOTE: USB_STORAGE enables SCSI, and 'SCSI disk support'
#

#
# may also be needed; see USB_STORAGE Help for more information
#
CONFIG_USB_STORAGE=m
# CONFIG_USB_STORAGE_DEBUG is not set
# CONFIG_USB_STORAGE_DATAFAB is not set
# CONFIG_USB_STORAGE_FREECOM is not set
# CONFIG_USB_STORAGE_ISD200 is not set
# CONFIG_USB_STORAGE_DPCM is not set
# CONFIG_USB_STORAGE_USBAT is not set
# CONFIG_USB_STORAGE_SDDR09 is not set
# CONFIG_USB_STORAGE_SDDR55 is not set
# CONFIG_USB_STORAGE_JUMPSHOT is not set
# CONFIG_USB_STORAGE_ALAUDA is not set
# CONFIG_USB_LIBUSUAL is not set

#
# USB Input Devices
#
CONFIG_USB_HID=y
CONFIG_USB_HIDINPUT=y
# CONFIG_USB_HIDINPUT_POWERBOOK is not set
# CONFIG_HID_FF is not set
CONFIG_USB_HIDDEV=y
# CONFIG_USB_AIPTEK is not set
# CONFIG_USB_WACOM is not set
# CONFIG_USB_ACECAD is not set
# CONFIG_USB_KBTAB is not set
# CONFIG_USB_POWERMATE is not set
# CONFIG_USB_TOUCHSCREEN is not set
# CONFIG_USB_YEALINK is not set
# CONFIG_USB_XPAD is not set
# CONFIG_USB_ATI_REMOTE is not set
# CONFIG_USB_ATI_REMOTE2 is not set
# CONFIG_USB_KEYSPAN_REMOTE is not set
# CONFIG_USB_APPLETOUCH is not set

#
# USB Imaging devices
#
# CONFIG_USB_MDC800 is not set
# CONFIG_USB_MICROTEK is not set

#
# USB Network Adapters
#
# CONFIG_USB_CATC is not set
# CONFIG_USB_KAWETH is not set
# CONFIG_USB_PEGASUS is not set
# CONFIG_USB_RTL8150 is not set
# CONFIG_USB_USBNET is not set
# CONFIG_USB_MON is not set

#
# USB port drivers
#

#
# USB Serial Converter support
#
# CONFIG_USB_SERIAL is not set

#
# USB Miscellaneous drivers
#
# CONFIG_USB_EMI62 is not set
# CONFIG_USB_EMI26 is not set
# CONFIG_USB_AUERSWALD is not set
# CONFIG_USB_RIO500 is not set
# CONFIG_USB_LEGOTOWER is not set
# CONFIG_USB_LCD is not set
# CONFIG_USB_LED is not set
# CONFIG_USB_CYTHERM is not set
# CONFIG_USB_PHIDGETKIT is not set
# CONFIG_USB_PHIDGETSERVO is not set
# CONFIG_USB_IDMOUSE is not set
# CONFIG_USB_SISUSBVGA is not set
# CONFIG_USB_LD is not set
# CONFIG_USB_TEST is not set

#
# USB DSL modem support
#

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# MMC/SD Card support
#
# CONFIG_MMC is not set

#
# LED devices
#
# CONFIG_NEW_LEDS is not set

#
# LED drivers
#

#
# LED Triggers
#

#
# InfiniBand support
#
# CONFIG_INFINIBAND is not set
# CONFIG_IPATH_CORE is not set

#
# EDAC - error detection and reporting (RAS) (EXPERIMENTAL)
#
# CONFIG_EDAC is not set

#
# Real Time Clock
#
# CONFIG_RTC_CLASS is not set

#
# Firmware Drivers
#
# CONFIG_EDD is not set
# CONFIG_DELL_RBU is not set
# CONFIG_DCDBAS is not set

#
# File systems
#
CONFIG_EXT2_FS=m
CONFIG_EXT2_FS_XATTR=y
CONFIG_EXT2_FS_POSIX_ACL=y
CONFIG_EXT2_FS_SECURITY=y
# CONFIG_EXT2_FS_XIP is not set
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
CONFIG_EXT3_FS_POSIX_ACL=y
CONFIG_EXT3_FS_SECURITY=y
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
CONFIG_REISERFS_FS=m
# CONFIG_REISERFS_CHECK is not set
# CONFIG_REISERFS_PROC_INFO is not set
CONFIG_REISERFS_FS_XATTR=y
CONFIG_REISERFS_FS_POSIX_ACL=y
CONFIG_REISERFS_FS_SECURITY=y
# CONFIG_JFS_FS is not set
CONFIG_FS_POSIX_ACL=y
CONFIG_XFS_FS=m
# CONFIG_XFS_QUOTA is not set
CONFIG_XFS_SECURITY=y
CONFIG_XFS_POSIX_ACL=y
CONFIG_XFS_RT=y
# CONFIG_OCFS2_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_ROMFS_FS is not set
CONFIG_INOTIFY=y
# CONFIG_QUOTA is not set
CONFIG_DNOTIFY=y
# CONFIG_AUTOFS_FS is not set
# CONFIG_AUTOFS4_FS is not set
CONFIG_FUSE_FS=m

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=m
CONFIG_JOLIET=y
CONFIG_ZISOFS=y
CONFIG_ZISOFS_FS=m
CONFIG_UDF_FS=m
CONFIG_UDF_NLS=y

#
# DOS/FAT/NT Filesystems
#
CONFIG_FAT_FS=m
CONFIG_MSDOS_FS=m
CONFIG_VFAT_FS=m
CONFIG_FAT_DEFAULT_CODEPAGE=850
CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-15"
CONFIG_NTFS_FS=m
# CONFIG_NTFS_DEBUG is not set
# CONFIG_NTFS_RW is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
CONFIG_TMPFS=y
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y
CONFIG_CONFIGFS_FS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
# CONFIG_CRAMFS is not set
# CONFIG_SQUASHFS is not set
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set

#
# Network File Systems
#
# CONFIG_NFS_FS is not set
# CONFIG_NFSD is not set
CONFIG_SMB_FS=m
# CONFIG_SMB_NLS_DEFAULT is not set
# CONFIG_CIFS is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set
# CONFIG_9P_FS is not set

#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-15"
CONFIG_NLS_CODEPAGE_437=y
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
CONFIG_NLS_CODEPAGE_850=y
CONFIG_NLS_CODEPAGE_852=y
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
CONFIG_NLS_CODEPAGE_1250=y
# CONFIG_NLS_CODEPAGE_1251 is not set
# CONFIG_NLS_ASCII is not set
CONFIG_NLS_ISO8859_1=y
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
CONFIG_NLS_ISO8859_15=y
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
CONFIG_NLS_UTF8=y

#
# Instrumentation Support
#
# CONFIG_PROFILING is not set
# CONFIG_KPROBES is not set

#
# Kernel hacking
#
# CONFIG_PRINTK_TIME is not set
CONFIG_MAGIC_SYSRQ=y
CONFIG_DEBUG_KERNEL=y
CONFIG_LOG_BUF_SHIFT=15
# CONFIG_DETECT_SOFTLOCKUP is not set
# CONFIG_SCHEDSTATS is not set
# CONFIG_DEBUG_SLAB is not set
# CONFIG_DEBUG_PREEMPT is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_SPINLOCK_SLEEP is not set
# CONFIG_DEBUG_KOBJECT is not set
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_FS is not set
# CONFIG_DEBUG_VM is not set
# CONFIG_FRAME_POINTER is not set
# CONFIG_UNWIND_INFO is not set
CONFIG_FORCED_INLINING=y
# CONFIG_RCU_TORTURE_TEST is not set
# CONFIG_DEBUG_RODATA is not set
# CONFIG_IOMMU_DEBUG is not set

#
# Security options
#
# CONFIG_KEYS is not set
# CONFIG_SECURITY is not set

#
# Cryptographic options
#
CONFIG_CRYPTO=y
CONFIG_CRYPTO_HMAC=y
CONFIG_CRYPTO_NULL=m
CONFIG_CRYPTO_MD4=m
CONFIG_CRYPTO_MD5=m
CONFIG_CRYPTO_SHA1=m
CONFIG_CRYPTO_SHA256=m
CONFIG_CRYPTO_SHA512=m
CONFIG_CRYPTO_WP512=m
CONFIG_CRYPTO_TGR192=m
CONFIG_CRYPTO_DES=m
CONFIG_CRYPTO_BLOWFISH=m
CONFIG_CRYPTO_TWOFISH=m
CONFIG_CRYPTO_SERPENT=m
CONFIG_CRYPTO_AES=m
CONFIG_CRYPTO_AES_X86_64=m
CONFIG_CRYPTO_CAST5=m
CONFIG_CRYPTO_CAST6=m
CONFIG_CRYPTO_TEA=m
CONFIG_CRYPTO_ARC4=m
CONFIG_CRYPTO_KHAZAD=m
CONFIG_CRYPTO_ANUBIS=m
CONFIG_CRYPTO_DEFLATE=m
CONFIG_CRYPTO_MICHAEL_MIC=m
CONFIG_CRYPTO_CRC32C=m
# CONFIG_CRYPTO_TEST is not set

#
# Hardware crypto devices
#

#
# Library routines
#
CONFIG_CRC_CCITT=y
CONFIG_CRC16=y
CONFIG_CRC32=y
CONFIG_LIBCRC32C=y
CONFIG_ZLIB_INFLATE=m
CONFIG_ZLIB_DEFLATE=m
CONFIG_TEXTSEARCH=y
CONFIG_TEXTSEARCH_KMP=m
CONFIG_TEXTSEARCH_BM=m
CONFIG_TEXTSEARCH_FSM=m
------------------------------------------------------------------------------
Bootdata ok (command line is root=/dev/sda3 elevator=cfq)
Linux version 2.6.17-gentoo-r4 (root@dreamgate) (gcc version 4.1.1 (Gentoo
4.1.1)) #1 PREEMPT Fri Jul 28 23:31:21 CEST 2006
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009f800 (usable)
BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000003fff0000 (usable)
BIOS-e820: 000000003fff0000 - 000000003fff3000 (ACPI NVS)
BIOS-e820: 000000003fff3000 - 0000000040000000 (ACPI data)
BIOS-e820: 00000000d0000000 - 00000000e0000000 (reserved)
BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
DMI 2.3 present.
ACPI: RSDP (v000 Nvidia ) @ 0x00000000000f6e80
ACPI: RSDT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x01010101) @
0x000000003fff3000
ACPI: FADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x01010101) @
0x000000003fff3040
ACPI: MCFG (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x01010101) @
0x000000003fff7d80
ACPI: MADT (v001 Nvidia AWRDACPI 0x42302e31 AWRD 0x01010101) @
0x000000003fff7d00
ACPI: DSDT (v001 NVIDIA AWRDACPI 0x00001000 MSFT 0x0100000c) @
0x0000000000000000
On node 0 totalpages: 257262
DMA zone: 2757 pages, LIFO batch:0
DMA32 zone: 254505 pages, LIFO batch:31
Nvidia board detected. Ignoring ACPI timer override.
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 15:15 APIC version 16
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled)
ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: BIOS IRQ0 pin2 override ignored.
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
ACPI: IRQ9 used by override.
ACPI: IRQ14 used by override.
ACPI: IRQ15 used by override.
Setting APIC routing to flat
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at 50000000 (gap: 40000000:90000000)
Checking aperture...
CPU 0: aperture @ 88a0000000 size 32 MB
Aperture from northbridge cpu 0 too small (32 MB)
No AGP bridge found
Built 1 zonelists
Kernel command line: root=/dev/sda3 elevator=cfq
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 32768 bytes)
time.c: Using 3.579545 MHz WALL PM GTOD PIT/TSC timer.
time.c: Detected 2264.479 MHz processor.
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Memory: 1027068k/1048512k available (2304k kernel code, 20680k reserved, 892k
data, 168k init)
Calibrating delay using timer specific routine.. 4531.62 BogoMIPS
(lpj=9063256)
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 512K (64 bytes/line)
CPU: AMD Athlon(tm) 64 Processor 3500+ stepping 00
Using local APIC timer interrupts.
result 12866358
Detected 12.866 MHz APIC timer.
testing NMI watchdog ... OK.
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using MMCONFIG at d0000000
PCI: No mmconfig possible on device 0:18
ACPI: Subsystem revision 20060127
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Probing PCI hardware (bus 00)
PCI: Transparent bridge - 0000:00:09.0
Boot video device is 0000:05:00.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.HUB0._PRT]
ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 *5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 5 *7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK4] (IRQs 3 *4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LUBA] (IRQs 3 4 5 7 9 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 11 *12 14 15)
ACPI: PCI Interrupt Link [LACI] (IRQs *3 4 5 7 9 10 11 12 14 15)
ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 5 7 9 10 11 *12 14 15)
ACPI: PCI Interrupt Link [LUB2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LIDE] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 5 7 9 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 9 devices
Generic PHY: Registered new driver
SCSI subsystem initialized
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
PCI-DMA: Disabling IOMMU.
pnp: 00:01: ioport range 0x1000-0x107f could not be reserved
pnp: 00:01: ioport range 0x1080-0x10ff has been reserved
pnp: 00:01: ioport range 0x1400-0x147f has been reserved
pnp: 00:01: ioport range 0x1480-0x14ff could not be reserved
pnp: 00:01: ioport range 0x1800-0x187f has been reserved
pnp: 00:01: ioport range 0x1880-0x18ff has been reserved
PCI: Bridge: 0000:00:09.0
IO window: disabled.
MEM window: f2000000-f20fffff
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0b.0
IO window: a000-afff
MEM window: f0000000-f1ffffff
PREFETCH window: 50000000-500fffff
PCI: Bridge: 0000:00:0c.0
IO window: 9000-9fff
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0d.0
IO window: 8000-8fff
MEM window: disabled.
PREFETCH window: disabled.
PCI: Bridge: 0000:00:0e.0
IO window: disabled.
MEM window: e8000000-efffffff
PREFETCH window: e0000000-e7ffffff
PCI: Setting latency timer of device 0000:00:09.0 to 64
PCI: Setting latency timer of device 0000:00:0b.0 to 64
PCI: Setting latency timer of device 0000:00:0c.0 to 64
PCI: Setting latency timer of device 0000:00:0d.0 to 64
PCI: Setting latency timer of device 0000:00:0e.0 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
Initializing Cryptographic API
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
PCI: Setting latency timer of device 0000:00:0b.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:0b.0:pcie00]
Allocate Port Service[0000:00:0b.0:pcie03]
PCI: Setting latency timer of device 0000:00:0c.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:0c.0:pcie00]
Allocate Port Service[0000:00:0c.0:pcie03]
PCI: Setting latency timer of device 0000:00:0d.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:0d.0:pcie00]
Allocate Port Service[0000:00:0d.0:pcie03]
PCI: Setting latency timer of device 0000:00:0e.0 to 64
pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
assign_interrupt_mode Found MSI capability
Allocate Port Service[0000:00:0e.0:pcie00]
Allocate Port Service[0000:00:0e.0:pcie03]
Real Time Clock Driver v1.12ac
Linux agpgart interface v0.101 (c) Dave Jones
ACPI: Power Button (FF) [PWRF]
ACPI: Power Button (CM) [PWRB]
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 AUX port at 0x60,0x64 irq 12
serio: i8042 KBD port at 0x60,0x64 irq 1
mice: PS/2 mouse device common for all mice
forcedeth.c: Reverse Engineered nForce ethernet driver. Version 0.54.
ACPI: PCI Interrupt Link [APCH] enabled at IRQ 23
GSI 16 sharing vector 0xD9 and IRQ 16
ACPI: PCI Interrupt 0000:00:0a.0[A] -> Link [APCH] -> GSI 23 (level, low) ->
IRQ 217
PCI: Setting latency timer of device 0000:00:0a.0 to 64
forcedeth: using HIGHDMA
eth0: forcedeth.c: subsystem: 01458:e000 bound to 0000:00:0a.0
Linux video capture interface: v1.00
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
NFORCE-CK804: chipset revision 242
NFORCE-CK804: not 100% native mode: will probe irqs later
NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
Probing IDE interface ide0...
hda: AOPEN DVD1648/AAP PRO, ATAPI CD/DVD-ROM drive
hdb: TOSHIBA DVD-ROM SD-M1612, ATAPI CD/DVD-ROM drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
Probing IDE interface ide1...
hdc: HL-DT-ST DVDRAM GSA-4163B, ATAPI CD/DVD-ROM drive
ide1 at 0x170-0x177,0x376 on irq 15
hda: ATAPI 48X DVD-ROM drive, 512kB Cache
Uniform CD-ROM driver Revision: 3.20
hdb: ATAPI 48X DVD-ROM drive, 512kB Cache, UDMA(33)
hdc: ATAPI 40X DVD-ROM DVD-R-RAM CD-R/RW drive, 2048kB Cache, UDMA(33)
libata version 1.20 loaded.
sata_nv 0000:00:07.0: version 0.8
ACPI: PCI Interrupt Link [APSI] enabled at IRQ 22
GSI 17 sharing vector 0xE1 and IRQ 17
ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 22 (level, low) ->
IRQ 225
PCI: Setting latency timer of device 0000:00:07.0 to 64
ata1: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD000 irq 225
ata2: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD008 irq 225
ata1: SATA link down (SStatus 0)
scsi0 : sata_nv
ata2: SATA link up 1.5 Gbps (SStatus 113)
ata2: dev 0 cfg 49:2f00 82:346b 83:7f01 84:4003 85:3c69 86:3c01 87:4003
88:40ff
ata2: dev 0 ATA-7, max UDMA7, 312581808 sectors: LBA48
nv_sata: Primary device added
nv_sata: Primary device removed
nv_sata: Secondary device added
nv_sata: Secondary device removed
ata2: dev 0 configured for UDMA/133
scsi1 : sata_nv
Vendor: ATA Model: SAMSUNG SP1614C Rev: SW10
Type: Direct-Access ANSI SCSI revision: 05
ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 21
GSI 18 sharing vector 0xE9 and IRQ 18
ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 21 (level, low) ->
IRQ 233
PCI: Setting latency timer of device 0000:00:08.0 to 64
ata3: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xE400 irq 233
ata4: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xE408 irq 233
ata3: SATA link down (SStatus 0)
scsi2 : sata_nv
ata4: SATA link down (SStatus 0)
scsi3 : sata_nv
SCSI device sda: 312581808 512-byte hdwr sectors (160042 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
SCSI device sda: 312581808 512-byte hdwr sectors (160042 MB)
sda: Write Protect is off
sda: Mode Sense: 00 3a 00 00
SCSI device sda: drive cache: write back
sda: sda1 sda2 sda3
sd 1:0:0:0: Attached scsi disk sda
ACPI: PCI Interrupt Link [APCL] enabled at IRQ 20
GSI 19 sharing vector 0x32 and IRQ 19
ACPI: PCI Interrupt 0000:00:02.1[B] -> Link [APCL] -> GSI 20 (level, low) ->
IRQ 50
PCI: Setting latency timer of device 0000:00:02.1 to 64
ehci_hcd 0000:00:02.1: EHCI Host Controller
ehci_hcd 0000:00:02.1: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:02.1: debug port 1
PCI: cache line size of 64 is not supported by device 0000:00:02.1
ehci_hcd 0000:00:02.1: irq 50, io mem 0xfeb00000
ehci_hcd 0000:00:02.1: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 10 ports detected
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
ACPI: PCI Interrupt Link [APCF] enabled at IRQ 23
ACPI: PCI Interrupt 0000:00:02.0[A] -> Link [APCF] -> GSI 23 (level, low) ->
IRQ 217
PCI: Setting latency timer of device 0000:00:02.0 to 64
ohci_hcd 0000:00:02.0: OHCI Host Controller
ohci_hcd 0000:00:02.0: new USB bus registered, assigned bus number 2
ohci_hcd 0000:00:02.0: irq 217, io mem 0xf2101000
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 10 ports detected
usb 2-9: new low speed USB device using ohci_hcd and address 2
usb 2-9: configuration #1 chosen from 1 choice
usb 2-10: new low speed USB device using ohci_hcd and address 3
usb 2-10: configuration #1 chosen from 1 choice
usbcore: registered new driver hiddev
input: HID 046a:000c as /class/input/input0
input: USB HID v1.00 Mouse [HID 046a:000c] on usb-0000:00:02.0-9
input: HID 046a:0023 as /class/input/input1
input: USB HID v1.11 Keyboard [HID 046a:0023] on usb-0000:00:02.0-10
input: HID 046a:0023 as /class/input/input2
input: USB HID v1.11 Device [HID 046a:0023] on usb-0000:00:02.0-10
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
i2c /dev entries driver
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 15
powernow-k8: Found 1 AMD Athlon 64 / Opteron processors (version 1.60.2)
powernow-k8: 0 : fid 0xe (2200 MHz), vid 0x6 (1400 mV)
powernow-k8: 1 : fid 0xc (2000 MHz), vid 0x8 (1350 mV)
powernow-k8: 2 : fid 0xa (1800 MHz), vid 0xa (1300 mV)
powernow-k8: 3 : fid 0x2 (1000 MHz), vid 0x12 (1100 mV)
cpu_init done, current fid 0xe, vid 0x6
kjournald starting. Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
VFS: Mounted root (ext3 filesystem) readonly.
Freeing unused kernel memory: 168k freed
i2c_adapter i2c-0: nForce2 SMBus adapter at 0x1c00
i2c_adapter i2c-1: nForce2 SMBus adapter at 0x1c40
saa7130/34: v4l2 driver version 0.2.14 loaded
ACPI: PCI Interrupt Link [APC4] enabled at IRQ 19
GSI 20 sharing vector 0x3A and IRQ 20
ACPI: PCI Interrupt 0000:01:07.0[A] -> Link [APC4] -> GSI 19 (level, low) ->
IRQ 58
saa7134[0]: found at 0000:01:07.0, rev: 1, irq: 58, latency: 32, mmio:
0xf2005000
saa7134[0]: subsystem: 153b:1142, board: Terratec Cinergy 400 TV
[card=8,autodetected]
saa7134[0]: board init: gpio is 50000
input: saa7134 IR (Terratec Cinergy 40 as /class/input/input3
saa7134[0]: i2c eeprom 00: 3b 15 42 11 10 28 ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 50: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
saa7134[0]: i2c eeprom 70: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
tuner 2-0060: All bytes are equal. It is not a TEA5767
tuner 2-0060: chip found @ 0xc0 (saa7134[0])
tuner 2-0060: type set to 5 (Philips PAL_BG (FI1216 and compatibles))
saa7134[0]: registered device video0 [v4l2]
saa7134[0]: registered device vbi0
ACPI: PCI Interrupt Link [APCJ] enabled at IRQ 22
ACPI: PCI Interrupt 0000:00:04.0[A] -> Link [APCJ] -> GSI 22 (level, low) ->
IRQ 225
PCI: Setting latency timer of device 0000:00:04.0 to 64
intel8x0_measure_ac97_clock: measured 56462 usecs
intel8x0: clocking to 46997
nvidia: module license 'NVIDIA' taints kernel.
ACPI: PCI Interrupt Link [APC3] enabled at IRQ 18
GSI 21 sharing vector 0x42 and IRQ 21
ACPI: PCI Interrupt 0000:05:00.0[A] -> Link [APC3] -> GSI 18 (level, low) ->
IRQ 66
PCI: Setting latency timer of device 0000:05:00.0 to 64
NVRM: loading NVIDIA Linux x86_64 Kernel Module 1.0-8762 Mon May 15 13:58:14
PDT 2006
EXT3 FS on sda3, internal journal
Adding 987988k swap on /dev/sda2. Priority:-1 extents:1 across:987988k
it87: Found IT8712F chip at 0x290, revision 5
i2c_adapter i2c-3: SMBus Quick command not supported, can't probe for chips
i2c_adapter i2c-4: SMBus Quick command not supported, can't probe for chips
i2c_adapter i2c-5: SMBus Quick command not supported, can't probe for chips
ip_tables: (C) 2000-2006 Netfilter Core Team
Netfilter messages via NETLINK v0.30.
ip_conntrack version 2.4 (4095 buckets, 32760 max) - 304 bytes per conntrack
ClusterIP Version 0.8 loaded successfully
ipt_recent v0.3.1: Stephen Frost <[email protected]>.
http://snowman.net/projects/ipt_recent/


2006-08-06 10:15:19

by Andrew Morton

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, 6 Aug 2006 12:00:37 +0200
Matthias Dahl <[email protected]> wrote:

> Since I bought my current system, I have experienced sluggish system
> responsiveness when the IO load increases to a certain point.
>
> For example: when I emerge (gentoo system) new kernel sources, during the
> untar process of the archive, Xorg gets sluggish, meaning you can sometimes
> see the entire desktop or windows repainting or the mouse pointer jumps
> around. From time to time, depending on the IO load, even typing in the
> console doesn't respond right away.
>
> I opened a thread in the gentoo support forum for amd64 which brought some
> details to light: it doesn't seem to be a nforce4 or amd64 related problem,
> because other people on newer intel based systems run into exactly the same
> problems. It looks like a general sata issue. Here a link to the thread:
>
> http://forums.gentoo.org/viewtopic-t-482731.html

I'd suggest that you generate a kernel profile while the sluggishness is
happening.

Boot with "profile=1" on the kernel boot command line. Then run:

readprofile -r
do-sluggish-thing
readprofile -n -v -m /boot/System.map | sort -n -k 3 | tail -40


Or, better-but-more-complex: oprofile.

2006-08-06 13:55:05

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

> I'd suggest that you generate a kernel profile while the sluggishness is
> happening.

Done...

profile 1: (emerge of three huge packages which caused quite some IO)

ffffffff80232650 __wake_up 23 0.2396
ffffffff803427a0 vgacon_cursor 23 0.0395
ffffffff8020ba40 free_hot_cold_page 24 0.0652
ffffffff8020be90 find_vma 25 0.2232
ffffffff8020c9b0 __wake_up_bit 25 0.5208
ffffffff80301800 journal_add_journal_head 25 0.0601
ffffffff803424e0 vgacon_scroll 26 0.0478
ffffffff802eb970 __ext3_get_inode_loc 27 0.0312
ffffffff802fd8e0 journal_dirty_metadata 27 0.0456
ffffffff80207500 kmem_cache_free 28 0.2917
ffffffff80211d90 do_select 30 0.0216
ffffffff8020d420 bit_waitqueue 32 0.1429
ffffffff8020bbb0 fget_light 34 0.1635
ffffffff8026b97f thread_return 35 0.1211
ffffffff80268d50 system_call 36 0.2748
ffffffff8020a580 kmem_cache_alloc 39 0.6094
ffffffff8020cae0 vm_normal_page 42 0.2188
ffffffff8020bf00 __make_request 43 0.0384
ffffffff8020b600 __find_get_block 47 0.0979
ffffffff802eb5c0 ext3_mark_iloc_dirty 48 0.0508
ffffffff8020a0f0 get_page_from_freelist 50 0.0428
ffffffff802fba50 do_get_write_access 55 0.0382
ffffffff80209050 __link_path_walk 56 0.0132
ffffffff803a63a0 scsi_request_fn 57 0.0604
ffffffff8026b0c0 memcpy 59 0.3352
ffffffff8020ccf0 __delay 69 2.1562
ffffffff80208350 __handle_mm_fault 78 0.0269
ffffffff802075e0 unmap_vmas 93 0.0501
ffffffff80208ea0 __d_lookup 95 0.2199
ffffffff8026ad30 clear_page 100 1.7544
ffffffff80341880 vgacon_set_cursor_size 103 0.4023
ffffffff8020a920 do_page_fault 105 0.0443
ffffffff80207560 find_get_page 106 0.9464
ffffffff80207d20 copy_page_range 111 0.0701
ffffffff8026ad70 copy_page 157 0.7009
ffffffff80212cd0 __do_softirq 189 1.0739
ffffffff803a0430 scsi_dispatch_cmd 459 0.7172
ffffffff8026afda copy_user_generic_c 854 22.4737
ffffffff80270e00 default_idle 49571 516.3646
0000000000000000 total 54590 0.0232

profile 2: (emerge of recent kernel sources- huge, causes quite some IO too)

ffffffff8020ff40 generic_permission 57 0.2227
ffffffff8020ccf0 __delay 58 1.8125
ffffffff802149a0 rb_insert_color 58 0.2417
ffffffff802af8b0 free_page_and_swap_cache 63 1.3125
ffffffff8020ccb0 put_page 66 1.0312
ffffffff803a63a0 scsi_request_fn 67 0.0710
ffffffff80234c60 unix_poll 69 0.3920
ffffffff8020b600 __find_get_block 74 0.1542
ffffffff80268d50 system_call 81 0.6183
ffffffff8020e220 memscan 88 1.8333
ffffffff80224820 __up_read 92 0.5227
ffffffff802fba50 do_get_write_access 95 0.0660
ffffffff80207500 kmem_cache_free 99 1.0312
ffffffff80223d40 find_next_zero_bit 100 0.6944
ffffffff8020d6a0 strncpy_from_user 103 1.2875
ffffffff80211d90 do_select 104 0.0747
ffffffff8020c9b0 __wake_up_bit 117 2.4375
ffffffff8026b97f thread_return 120 0.4152
ffffffff8020a580 kmem_cache_alloc 143 2.2344
ffffffff8026b0c0 memcpy 154 0.8750
ffffffff8020a0f0 get_page_from_freelist 155 0.1327
ffffffff8020b260 page_remove_rmap 172 2.6875
ffffffff80221320 copy_process 175 0.0315
ffffffff80207560 find_get_page 190 1.6964
ffffffff8020be90 find_vma 198 1.7679
ffffffff80211900 do_wp_page 249 0.2132
ffffffff80209050 __link_path_walk 315 0.0740
ffffffff8026afda copy_user_generic_c 325 8.5526
ffffffff80212cd0 __do_softirq 452 2.5682
ffffffff80208350 __handle_mm_fault 479 0.1654
ffffffff80208ea0 __d_lookup 510 1.1806
ffffffff8026ad30 clear_page 519 9.1053
ffffffff803a0430 scsi_dispatch_cmd 576 0.9000
ffffffff8020a920 do_page_fault 712 0.3007
ffffffff8020cae0 vm_normal_page 814 4.2396
ffffffff8026ad70 copy_page 1929 8.6116
ffffffff802075e0 unmap_vmas 2362 1.2726
ffffffff80207d20 copy_page_range 2683 1.6938
ffffffff80270e00 default_idle 45081 469.5938
0000000000000000 total 64216 0.0273

I hope this helps.

2006-08-06 19:37:24

by Andrew Morton

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, 6 Aug 2006 15:54:42 +0200
Matthias Dahl <[email protected]> wrote:

> > I'd suggest that you generate a kernel profile while the sluggishness is
> > happening.
>
> Done...

Please always do reply-to-all, especially on linux-kernel. I'm often two
days behind, sometimes five days.

> profile 1: (emerge of three huge packages which caused quite some IO)
>
> ...
>
> ffffffff803a0430 scsi_dispatch_cmd 459 0.7172
> ffffffff8026afda copy_user_generic_c 854 22.4737
> ffffffff80270e00 default_idle 49571 516.3646
> 0000000000000000 total 54590 0.0232
>
> profile 2: (emerge of recent kernel sources- huge, causes quite some IO too)
>
> ...
>
> ffffffff8020cae0 vm_normal_page 814 4.2396
> ffffffff8026ad70 copy_page 1929 8.6116
> ffffffff802075e0 unmap_vmas 2362 1.2726
> ffffffff80207d20 copy_page_range 2683 1.6938
> ffffffff80270e00 default_idle 45081 469.5938
> 0000000000000000 total 64216 0.0273
>
> I hope this helps.

Well, it rules a lot of things out. There's plenty of idle time there, so
that rules out a lot of silly things and points the finger at IO scheduler
bustage, poor page-replacement decisions, etc.

hm. Do you have any reason for thinking that it's specific to any
particular device driver or hardware setup?

How much memory does the machine have?

It'd be interesting if you could gather a `vmstat 1' trace during the
sluggish period.


2006-08-07 13:47:40

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, Aug 06 2006, Matthias Dahl wrote:
> > I'd suggest that you generate a kernel profile while the sluggishness is
> > happening.
>
> Done...
>
> profile 1: (emerge of three huge packages which caused quite some IO)

Can you see if this makes any difference whatsoever?

diff --git a/block/ll_rw_blk.c b/block/ll_rw_blk.c
index 61d6b3c..ed6a30e 100644
--- a/block/ll_rw_blk.c
+++ b/block/ll_rw_blk.c
@@ -3422,6 +3422,7 @@ #endif /* CONFIG_HOTPLUG_CPU */

void blk_complete_request(struct request *req)
{
+#if 0
struct list_head *cpu_list;
unsigned long flags;

@@ -3434,6 +3435,14 @@ void blk_complete_request(struct request
raise_softirq_irqoff(BLOCK_SOFTIRQ);

local_irq_restore(flags);
+#else
+ unsigned long flags;
+ request_queue_t *q = req->q;
+
+ local_irq_save(flags);
+ q->softirq_done_fn(req);
+ local_irq_restore(flags);
+#endif
}

EXPORT_SYMBOL(blk_complete_request);

--
Jens Axboe

2006-08-08 15:57:29

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sunday 06 August 2006 21:37, Andrew Morton wrote:

> hm. Do you have any reason for thinking that it's specific to any
> particular device driver or hardware setup?

Even though this is subjective, I suspect the sata subsystem or something in
that area. My old P3 500 system (IDE based) performed better under heavy IO
than my current setup which is sata based. But like I said, this is highly
subjective and I cannot give you any reasonable facts.

> How much memory does the machine have?

1 gb of ram. Usually swap is rarely or not much touched except when I stress
the system with eclipse and other things that consume too much memory. :)

> It'd be interesting if you could gather a `vmstat 1' trace during the
> sluggish period.

No problem at all. It's just not as easy to trigger as one might think.
Sometimes every high io load causes sluggish performance, while on a
different occassion, things run almost fine even though the system is under
io pressure...

procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 1 0 203172 30616 495628 0 0 26 14 472 278 3 1 95 1
1 0 0 190092 30628 508736 0 0 13120 0 675 572 37 3 0 60
1 0 0 191712 30628 508728 0 0 0 0 389 97 97 3 0 0
1 0 0 191592 30628 508836 0 0 108 0 396 186 74 7 0 19
0 1 0 190772 30640 508872 0 0 44 388 464 127 84 7 0 9
0 1 0 184732 30736 514152 0 0 5360 172 587 379 2 4 0 94
1 0 0 179080 30788 519664 0 0 5564 0 514 387 13 7 0 80
0 1 0 177024 30836 520008 0 0 260 0 457 304 31 49 0 20
1 0 0 165084 31844 525608 0 0 1212 0 680 1825 42 10 0 48
1 1 0 153924 32784 533796 0 0 692 4 641 3119 61 6 0 33
0 2 0 151072 33124 535380 0 0 268 9640 793 661 10 7 0 83
0 2 0 149212 33288 536752 0 0 128 3828 710 565 13 5 0 82
2 1 0 148344 33408 537484 0 0 80 2408 683 998 23 7 0 70
1 1 0 144252 33944 540648 0 0 360 0 620 2245 39 8 0 53
2 1 0 131968 34560 550612 0 0 188 2672 665 2039 81 11 0 8
2 1 0 123908 35104 556448 0 0 156 5168 909 1765 45 14 0 41
0 2 0 115352 35520 563024 0 0 128 8492 1135 2256 51 14 0 35
1 0 0 107852 35876 568948 0 0 232 2428 751 972 41 9 0 50
3 0 0 90368 36812 582488 0 0 220 0 550 1248 77 16 0 7
0 2 0 74248 37228 596256 0 0 16 5568 584 3173 87 10 0 3
2 1 0 64576 37544 604380 0 0 44 14572 1242 1329 56 9 0 35
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 2 0 62096 37768 606216 0 0 148 4212 890 902 13 5 0 82
0 2 0 58624 37892 609120 0 0 72 7676 906 2011 44 10 0 45
1 1 0 57012 37984 610028 0 0 60 5768 893 1451 20 6 0 74
0 3 0 56704 38076 610352 0 0 100 7908 796 1092 18 8 0 75
1 2 0 55340 38200 611292 0 0 100 9664 806 1236 20 9 0 71
0 2 0 51992 38416 613904 0 0 136 4420 910 1320 27 7 0 66
1 2 0 49512 38600 615976 0 0 116 3132 896 1412 25 5 0 70
2 1 0 45544 38788 619324 0 0 84 1004 863 4514 68 13 0 19
3 0 0 30540 39392 629544 0 0 304 0 667 1737 73 5 0 22
0 2 0 15396 39768 637920 0 0 160 12044 1174 1975 63 10 0 27
0 4 0 9332 40048 643272 0 0 80 6804 1813 1470 52 6 0 42
2 3 0 10232 40236 641768 0 0 88 5372 1729 1392 45 6 0 49
1 1 0 10008 40464 641096 0 0 136 13176 1795 1364 43 6 0 51
2 1 0 10116 40700 640608 0 0 156 6248 1739 1597 46 5 0 50
2 0 0 9504 40852 640964 0 0 56 432 1581 2085 50 5 0 46
2 0 0 9364 41284 639996 0 0 176 0 1554 1471 86 6 0 8
2 0 0 9212 41748 638880 0 0 252 0 1596 1521 86 5 0 9
0 1 0 9148 42160 637656 0 0 228 0 1560 1477 82 6 0 12
1 2 0 9876 42792 635208 0 0 356 10160 1662 1574 66 7 0 27
0 3 0 9180 42996 635276 0 0 124 11028 1880 1377 36 3 0 61
0 4 0 9848 43148 634336 0 0 32 9900 1762 1345 42 5 0 53
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 4 0 9260 43312 634376 0 0 76 3316 1758 1427 48 6 0 47
0 4 0 9480 43528 633752 0 0 92 3336 1843 1434 45 7 0 48
0 2 0 9272 43724 633500 0 0 108 1584 1714 1364 35 5 0 60
2 3 0 16220 43856 634752 0 0 68 5400 959 1540 36 6 0 58
0 4 0 13988 43956 636588 0 0 44 3752 942 4695 43 20 0 36
0 5 0 12004 44140 637956 0 0 124 3740 915 2949 14 11 0 75
0 5 0 10020 44340 639328 0 0 152 3104 740 455 11 4 0 85
0 5 0 9044 44588 639500 0 0 172 3660 740 513 15 9 0 76
0 5 0 9984 44752 638000 0 0 128 1952 754 460 13 8 0 79
0 2 0 9588 44992 637556 0 0 172 1108 769 1255 15 11 0 74
1 4 0 9140 45164 637340 0 0 112 4392 718 1256 23 8 0 69
2 3 0 9520 45444 636112 0 0 248 1964 738 769 15 7 0 78
1 5 0 9544 45628 635748 0 0 136 1424 656 604 6 3 0 91
0 5 0 10096 45812 634900 0 0 168 2172 682 585 5 6 0 89
0 5 0 9500 45988 634940 0 0 128 1588 652 601 11 4 0 85
0 6 0 9924 46156 633736 0 0 108 3132 707 462 17 8 0 75
0 2 0 10156 46416 633064 0 0 208 4320 731 381 18 7 0 75
0 3 0 9568 46552 633400 0 0 96 1252 619 249 1 5 0 94
0 3 0 9568 46712 633680 0 0 116 1496 614 310 1 1 0 98
0 4 0 9284 46880 633188 0 0 108 2448 681 505 24 8 0 68
2 3 0 9696 47112 631712 0 0 136 1968 735 535 26 10 0 64
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 1 0 9528 47272 631492 0 0 84 1288 689 462 19 6 0 75
0 3 0 9488 47396 631216 0 0 76 7448 785 416 8 8 0 84
1 4 0 9328 47576 630700 0 0 124 3436 827 583 25 11 0 64
0 3 0 9692 47792 629884 0 0 148 2292 665 481 15 6 0 79
0 1 0 9812 48032 629272 0 0 180 1196 631 489 13 8 0 79
1 1 0 10376 48560 627012 0 0 344 0 517 581 56 6 0 38
2 3 0 10028 48748 627580 0 0 132 7832 875 518 16 6 0 78
2 5 0 10148 48908 627044 0 0 84 3828 935 1475 39 8 0 53
1 3 0 9728 49048 627040 0 0 84 2604 1024 3977 31 8 0 61
0 3 0 9372 49120 627136 0 0 60 1680 905 2990 34 7 0 59
0 3 0 9168 49272 626992 0 0 92 1428 734 2410 27 4 0 69
3 2 0 9124 49368 626952 0 0 52 5332 833 2286 17 3 0 80
1 3 0 9192 49596 626320 0 0 100 1784 992 3304 35 9 0 56
0 3 0 10324 49772 624704 0 0 60 3444 906 3163 45 6 0 48
0 3 0 9424 49984 624956 0 0 56 2020 857 1386 35 4 0 61
1 1 0 9836 50176 624192 0 0 48 2584 859 3261 33 7 0 60
0 3 0 10136 50288 623588 0 0 36 1860 632 410 14 3 0 83
0 2 0 17204 50328 621736 0 0 52 20828 5602 7789 8 7 0 86
1 0 0 17212 50328 621736 0 0 0 380 720 1035 14 17 0 69
0 2 0 17088 50328 621740 0 0 0 2764 667 830 17 20 0 63
2 0 0 10512 50356 624032 0 0 500 5696 890 1517 33 24 0 43
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 0 9868 49312 625308 0 0 0 0 443 642 94 6 0 0
2 0 0 13080 49004 625656 0 0 188 0 489 610 82 5 0 13
0 2 0 10228 49104 627156 0 0 4 29100 501 630 47 29 1 23
2 0 0 9484 49220 628400 0 0 0 3564 601 418 43 29 0 27
3 0 0 9848 49488 627496 0 0 128 2132 565 771 55 41 0 4
1 0 0 9372 49632 624564 0 0 288 524 642 1623 57 31 0 12
1 0 12 10024 49356 619120 0 0 396 0 912 2909 62 26 0 12
2 0 12 9764 49660 619056 0 0 0 0 830 2940 66 34 0 0
2 0 12 14004 50432 615020 0 0 84 468 634 1506 58 37 0 5
2 0 12 12504 51084 616064 0 0 24 0 552 718 50 50 0 0
0 2 12 10016 51696 616112 0 0 0 17752 687 1288 55 28 0 17
2 3 12 10536 51936 614960 0 0 16 12460 1155 1088 17 22 0 61
1 3 12 11048 52880 611944 0 0 0 21716 972 428 52 48 0 0
0 3 12 9596 53260 612508 0 0 0 15400 1003 682 40 57 0 3
0 2 12 10348 53284 612516 0 0 8 15628 847 709 5 5 0 90
0 2 12 11132 53832 613036 0 0 56 91444 6355 6600 9 11 0 80
2 0 12 41160 53932 585872 0 0 288 3516 782 1821 32 30 0 38
0 1 12 40688 53948 586020 0 0 0 3584 722 532 17 10 0 73
3 0 12 36956 53952 585952 0 0 0 4 1136 1878 38 28 0 33
0 1 12 35064 53968 585952 0 0 0 11160 1052 1081 15 15 0 70
4 0 12 32416 53968 585960 0 0 0 4336 2840 5072 19 8 0 73
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
3 1 12 31616 54272 586864 0 0 1168 18540 5110 4204 8 6 0 86
6 2 12 30560 54276 587020 0 0 128 784 761 1957 26 14 0 60
2 1 12 32908 54292 587452 0 0 448 916 903 1486 21 29 0 50
1 1 12 35660 54304 587452 0 0 12 1096 645 422 46 33 0 20
1 1 12 35252 54304 587452 0 0 0 1384 594 292 84 16 0 0
1 0 12 33888 54312 587452 0 0 0 696 707 2809 85 15 0 0
1 0 12 33764 54312 587452 0 0 0 0 420 208 97 3 0 0
1 0 12 33796 54312 587452 0 0 0 0 468 231 98 2 0 0
1 0 12 33672 54312 587452 0 0 0 0 414 193 97 3 0 0
1 0 12 34920 54320 587452 0 0 0 16 470 224 98 2 0 0
1 0 12 34920 54320 587452 0 0 0 648 521 236 92 8 0 0
2 0 12 34944 54320 587452 0 0 0 0 471 286 98 2 0 0
1 0 12 34944 54320 587452 0 0 0 0 403 190 87 13 0 0
1 0 12 35084 54320 587452 0 0 0 0 408 245 99 1 0 0
1 0 12 35332 54328 587452 0 0 0 16 354 240 93 7 0 0
1 0 12 35364 54328 587452 0 0 0 0 408 292 93 7 0 0
1 0 12 35364 54328 587452 0 0 0 0 353 161 93 7 0 0
1 0 12 35380 54328 587452 0 0 0 0 406 212 91 9 0 0
1 0 12 35380 54328 587452 0 0 0 0 352 170 96 4 0 0
1 0 12 35660 54332 587452 0 0 0 16 409 216 96 4 0 0
1 0 12 34420 54332 587452 0 0 0 0 352 161 96 4 0 0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 12 34164 54332 587452 0 0 0 0 409 239 88 12 0 0
0 1 12 33916 54344 587588 0 0 12 0 358 292 75 20 0 5
2 0 12 33800 54432 587628 0 0 16 0 414 860 29 69 0 2
2 0 12 33552 54532 587656 0 0 12 1192 394 870 25 74 0 1
4 0 12 33452 54596 587684 0 0 4 0 501 852 20 80 0 0
2 0 12 33164 54676 587712 0 0 4 0 432 670 22 78 0 0
1 0 12 33008 54716 587740 0 0 0 0 450 989 25 75 0 0
2 0 12 32860 54784 587768 0 0 4 0 526 1212 26 74 0 0
1 0 12 32612 54868 587796 0 0 4 1692 471 980 23 77 0 0
2 0 12 32472 54940 587824 0 0 4 0 432 838 26 74 0 0
2 0 12 32364 55008 587860 0 0 12 0 455 858 28 71 0 1
1 0 12 32232 55060 587892 0 0 0 0 432 847 22 78 0 0
2 0 12 32004 55112 588012 0 0 92 0 468 881 22 74 0 4
3 0 12 31888 55156 588080 0 0 44 1680 446 853 27 71 0 2
1 0 12 31624 55240 588108 0 0 0 0 451 865 25 75 0 0
1 0 12 31456 55288 588184 0 0 48 0 443 869 26 70 0 4
1 0 12 31456 55368 588212 0 0 4 0 454 915 23 77 0 0
2 0 12 31340 55436 588244 0 0 0 0 446 1158 23 77 0 0
2 0 12 31456 55488 588276 0 0 0 1768 485 1098 23 68 0 9
0 1 12 31348 55580 588312 0 0 8 0 440 1000 24 75 0 1
1 0 12 31008 55644 588392 0 0 64 0 465 997 23 77 0 0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
2 0 12 31024 55720 588452 0 0 32 0 445 983 26 72 0 2
2 0 12 30940 55748 588484 0 0 0 0 450 1131 23 77 0 0
1 0 12 30684 55824 588512 0 0 4 1624 461 1051 26 70 0 4
2 0 12 30552 55900 588544 0 0 4 0 454 941 25 74 0 1
2 0 12 30436 55968 588576 0 0 4 0 452 970 32 66 0 2
1 0 12 30320 56040 588608 0 0 4 0 486 997 34 66 0 0
2 0 12 30320 56092 588636 0 0 0 0 400 796 19 81 0 0
1 1 12 30200 56204 588668 0 0 0 4576 548 899 25 75 0 1
3 1 12 30084 56300 588684 0 0 0 1444 588 611 13 50 0 37
5 1 12 29892 56444 588712 0 0 0 2304 755 737 17 83 0 0
1 0 12 29720 56520 588740 0 0 0 564 563 648 22 78 0 0
2 0 12 29540 56600 588772 0 0 0 0 449 1009 28 72 0 0
1 0 12 29416 56700 588804 0 0 0 1968 557 1315 26 73 0 1
1 0 12 29292 56748 588836 0 0 0 0 532 1336 23 77 0 0
2 0 12 28060 56888 589236 0 0 232 0 515 1350 27 73 0 0
2 0 12 28008 57008 589144 0 0 32 0 521 1281 24 76 0 0
2 0 12 27760 57180 589180 0 0 0 0 530 1392 25 75 0 0
2 0 12 27380 57384 589208 0 0 0 1992 557 1549 29 65 0 6
1 0 12 27248 57484 589228 0 0 0 0 541 51688 45 55 0 0
2 0 12 26620 57568 589260 0 0 0 0 509 2092 31 69 0 0
2 0 12 26480 57680 589292 0 0 0 0 451 913 25 75 0 0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 0 12 26240 57868 589328 0 0 0 0 471 1509 27 73 0 0
2 0 12 26000 57972 589364 0 0 0 2108 487 1409 24 75 0 1
3 0 12 25892 58052 589396 0 0 0 0 528 1346 26 74 0 0
2 0 12 22088 58120 589416 0 0 0 1292 663 10366 69 31 0 0
3 0 12 21864 58160 589460 0 0 0 0 774 5945 64 36 0 0
2 0 12 20896 58296 589488 0 0 0 0 563 2229 32 68 0 0
2 0 12 20764 58380 589520 0 0 4 0 554 1464 24 74 0 2
2 0 12 20632 58432 589540 0 0 0 0 528 1136 51 49 0 0
2 0 12 20640 58460 589556 0 0 0 1824 509 972 60 40 0 0
3 0 12 19708 58480 589568 0 0 0 0 520 1006 68 32 0 0
2 0 12 20252 58544 589588 0 0 0 0 637 2646 44 56 0 0
1 0 12 20308 58604 589616 0 0 0 4 620 4560 33 67 0 0
2 0 12 20076 58752 589648 0 0 0 0 553 1438 27 73 0 0
2 0 12 19828 58820 589672 0 0 0 1804 553 52245 43 56 0 1
2 0 12 19820 58892 589700 0 0 0 0 513 1193 24 76 0 0
3 0 12 19860 58908 589732 0 0 0 0 428 996 22 78 0 0
2 0 12 19720 58924 589760 0 0 0 0 476 1118 25 75 0 0
4 0 12 19628 58980 589796 0 0 0 4 414 1006 27 73 0 0
2 0 12 19488 59040 589828 0 0 0 1392 486 1324 26 73 0 1
1 0 12 19412 59092 589860 0 0 0 0 424 843 18 82 0 0
2 0 12 19396 59120 589892 0 0 0 0 548 1191 21 79 0 0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
1 1 12 19272 59136 589920 0 0 0 3900 713 1290 27 73 0 0
2 1 12 19272 59144 589948 0 0 0 1880 753 1075 27 73 0 0
3 1 12 19296 59184 589984 0 0 0 3740 772 880 25 75 0 0
2 0 12 19156 59220 590016 0 0 0 1076 512 889 20 80 0 0
2 0 12 19164 59248 590044 0 0 0 0 353 848 21 79 0 0
2 0 12 19048 59280 590076 0 0 4 84 415 935 26 73 0 1
2 0 12 19072 59304 590104 0 0 0 0 358 850 27 73 0 0
2 0 12 18956 59404 590140 0 0 4 1128 422 919 25 74 0 1
2 0 12 18824 59532 590172 0 0 0 0 357 839 26 74 0 0
2 0 12 18840 59540 590204 0 0 0 0 393 886 22 78 0 0
2 0 12 18740 59640 590232 0 0 0 0 367 837 22 78 0 0
0 1 12 18648 59700 590268 0 0 16 0 391 774 34 62 0 4
0 2 12 18388 59800 590432 0 0 260 1876 470 388 2 2 0 96
0 1 12 17188 59856 591608 0 0 1232 8 603 333 0 1 0 99
1 1 12 14268 60000 594212 0 0 2748 0 522 425 0 2 0 98
0 1 12 10840 60116 597404 0 0 3308 0 608 395 0 3 0 97
4 1 12 10128 59624 598320 0 0 1704 0 509 244 1 35 0 64
0 1 20 10124 58976 598716 0 0 3660 24 664 312 1 11 0 88
1 1 20 9416 58484 599856 0 0 3176 0 633 622 5 1 0 94
0 1 20 9560 57596 600128 0 0 3528 0 1068 3061 17 6 0 77
3 1 20 9560 57240 600636 0 0 2708 0 959 4046 18 6 0 76
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 1 20 10096 56316 600856 0 0 3240 0 804 3018 17 6 0 77
0 2 20 9868 54828 602856 0 0 3156 8 620 390 2 12 0 86
0 1 20 10044 52652 604952 0 0 3916 20 634 406 0 1 0 99
0 1 20 9108 50216 608528 0 0 3700 0 574 453 2 2 0 96
1 1 20 9408 47736 610748 0 0 3684 4 625 448 0 2 0 98
0 1 20 9304 47752 611008 0 0 2980 0 558 425 1 3 0 96
0 2 20 10008 45744 612276 0 0 4408 16 596 436 0 1 0 99
0 1 20 9376 45704 613136 0 0 3560 0 573 377 1 3 0 96
0 1 20 9608 45488 613104 0 0 3720 0 649 405 1 2 0 97
0 1 20 9264 45580 613204 0 0 2728 0 536 417 3 1 0 96

All I did was emerging the kernel sources and doing some surfing with
konqueror (which stalled quite a few times without even repainting itself) to
test the system behaviour.

2006-08-08 15:57:28

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

> Can you see if this makes any difference whatsoever?

Recompiling now and will test it for a couple of hours and will report back as
soon as I have come to a conclusion. (probably not before tomorrow though)

2006-08-08 17:44:31

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

> Can you see if this makes any difference whatsoever?

Sorry but no change for the better with this patch.

Are there any more informations I can provide to help?

2006-08-08 19:01:33

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Tue, Aug 08 2006, Matthias Dahl wrote:
> > Can you see if this makes any difference whatsoever?
>
> Sorry but no change for the better with this patch.
>
> Are there any more informations I can provide to help?

Ok, it was worth a shot. I got another report that the patch fixes this
behaviour, so maybe we are dealing with two seperate issues. It would be
nice if you could gather vmstat 1 info during a problematic period.
blktrace info could also be very useful:

http://brick.kernel.dk/snaps/blktrace-git-20060807122505.tar.gz

--
Jens Axboe

2006-08-10 12:27:36

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Tue, Aug 08 2006, Jens Axboe wrote:
> On Tue, Aug 08 2006, Matthias Dahl wrote:
> > > Can you see if this makes any difference whatsoever?
> >
> > Sorry but no change for the better with this patch.
> >
> > Are there any more informations I can provide to help?
>
> Ok, it was worth a shot. I got another report that the patch fixes this
> behaviour, so maybe we are dealing with two seperate issues. It would be
> nice if you could gather vmstat 1 info during a problematic period.
> blktrace info could also be very useful:
>
> http://brick.kernel.dk/snaps/blktrace-git-20060807122505.tar.gz

Some more things to try/questions:

- Did 2.6.16 work well for you?

- Does disabling preemtion (CONFIG_PREEMPT_NONE=y) help?

--
Jens Axboe

2006-08-11 11:41:04

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Thursday 10 August 2006 14:28, Jens Axboe wrote:

> - Did 2.6.16 work well for you?

AFAICT 2.6.17 behaved more sluggish but this is my subjective observation. The
problem itself exists for quite some time now. (prior to 2.6.16) I cannot
even tell if it ever worked fine. :-(

> - Does disabling preemtion (CONFIG_PREEMPT_NONE=y) help?

Sorry for my late response btw. I will do the necessary tests (including the
blktrace you asked for) this weekend and report back as soon as possible.

2006-08-13 16:15:30

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Thursday 10 August 2006 14:28, Jens Axboe wrote:

> > [...] It would be
> > nice if you could gather vmstat 1 info during a problematic period.
> > blktrace info could also be very useful:
>
> - Does disabling preemtion (CONFIG_PREEMPT_NONE=y) help?

First of all, I put the blktrace and vmstat logs on my webspace because they
grew too big for the list to handle. :-)

http://www.mortal-soul.de/blktrace.log.bz2
http://www.mortal-soul.de/vmstat.log.bz2

Just let me know once you got them, so I can safely delete them again.

At the moment, I am trying without preemption but for example doing a untar
kernel sources still results in sluggish system responsiveness. :-(

If I can do anything else, please let me know.

2006-09-03 11:15:44

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Thursday 10 August 2006 14:28, Jens Axboe wrote:

>> > [...] It would be
>> > nice if you could gather vmstat 1 info during a problematic period.
>> > blktrace info could also be very useful:
>>
>> - Does disabling preemtion (CONFIG_PREEMPT_NONE=y) help?

> http://www.mortal-soul.de/blktrace.log.bz2
> http://www.mortal-soul.de/vmstat.log.bz2

Jens, did you get these? Just wondered because it's been almost a month since.
BTW... just a few more observations:

1. running an OpenGL app like ET and just having some compiling done in the
background or some light disk io gives distorted sound playback as well as
very poor OpenGL performance

2. switching between console and xorg also results in short sound distortions
even though the cpu load is almost zero

Maybe those and the original problem are somehow related.

Thanks...
matthew.

--
VGER BF report: U 0.500007

2006-09-17 11:12:13

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, Sep 03 2006, Matthias Dahl wrote:
> On Thursday 10 August 2006 14:28, Jens Axboe wrote:
>
> >> > [...] It would be
> >> > nice if you could gather vmstat 1 info during a problematic period.
> >> > blktrace info could also be very useful:
> >>
> >> - Does disabling preemtion (CONFIG_PREEMPT_NONE=y) help?
>
> > http://www.mortal-soul.de/blktrace.log.bz2
> > http://www.mortal-soul.de/vmstat.log.bz2
>
> Jens, did you get these? Just wondered because it's been almost a month since.
> BTW... just a few more observations:
>
> 1. running an OpenGL app like ET and just having some compiling done in the
> background or some light disk io gives distorted sound playback as well as
> very poor OpenGL performance
>
> 2. switching between console and xorg also results in short sound distortions
> even though the cpu load is almost zero
>
> Maybe those and the original problem are somehow related.

Sounds like a hardware issue, someone could be hogging the bus. You
could try and play with the pci latency setting.

--
Jens Axboe

2006-09-24 14:32:25

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Friday 15 September 2006 20:17, Jens Axboe wrote:

> Sounds like a hardware issue, someone could be hogging the bus. You
> could try and play with the pci latency setting.

Is there a way I can debug this...? I really would like to get to the bottom
of this somehow. I did one more test: installed and started enemy territory
because it's free and heavily uses OpenGL... works fine so far. But simply
starting an untar process in the background while et is running causes quite
distorted sound and even the mouse pointer won't react in time anymore until
the untar process is finished. This can't be right. IO load shouldn't cause
sluggish responsiveness...

What bus are you referring to? As far as I remember only one or two devices
are connected through the PCI bus... all the rest uses point to point
connections. (PCI Express)

lspci -v shows the following: (most of the devices have a latency of 0)

00:00.0 Memory controller: nVidia Corporation CK804 Memory Controller (rev a3)
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0
Capabilities: [44] HyperTransport: Slave or Primary Interface
Capabilities: [e0] HyperTransport: MSI Mapping

00:01.0 ISA bridge: nVidia Corporation CK804 ISA Bridge (rev a3)
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0

00:01.1 SMBus: nVidia Corporation CK804 SMBus (rev a2)
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: 66MHz, fast devsel, IRQ 12
I/O ports at ec00 [size=32]
I/O ports at 1c00 [size=64]
I/O ports at 1c40 [size=64]
Capabilities: [44] Power Management version 2

00:02.0 USB Controller: nVidia Corporation CK804 USB Controller (rev a2)
(prog-if 10 [OHCI])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 217
Memory at f2101000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2

00:02.1 USB Controller: nVidia Corporation CK804 USB Controller (rev a3)
(prog-if 20 [EHCI])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 50
Memory at feb00000 (32-bit, non-prefetchable) [size=256]
Capabilities: [44] Debug port
Capabilities: [80] Power Management version 2

00:04.0 Multimedia audio controller: nVidia Corporation CK804 AC'97 Audio
Controller (rev a2)
Subsystem: Giga-byte Technology Unknown device ae01
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 225
I/O ports at b800 [size=256]
I/O ports at bc00 [size=256]
Memory at f2104000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2

00:06.0 IDE interface: nVidia Corporation CK804 IDE (rev f2) (prog-if 8a
[Master SecP PriP])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0
I/O ports at f000 [size=16]
Capabilities: [44] Power Management version 2

00:07.0 IDE interface: nVidia Corporation CK804 Serial ATA Controller (rev f3)
(prog-if 85 [Master SecO PriO])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 225
I/O ports at 09f0 [size=8]
I/O ports at 0bf0 [size=4]
I/O ports at 0970 [size=8]
I/O ports at 0b70 [size=4]
I/O ports at d000 [size=16]
Memory at f2105000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2

00:08.0 IDE interface: nVidia Corporation CK804 Serial ATA Controller (rev f3)
(prog-if 85 [Master SecO PriO])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 233
I/O ports at 09e0 [size=8]
I/O ports at 0be0 [size=4]
I/O ports at 0960 [size=8]
I/O ports at 0b60 [size=4]
I/O ports at e400 [size=16]
Memory at f2100000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Power Management version 2

00:09.0 PCI bridge: nVidia Corporation CK804 PCI Bridge (rev a2) (prog-if 01
[Subtractive decode])
Flags: bus master, 66MHz, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=32
Memory behind bridge: f2000000-f20fffff

00:0a.0 Bridge: nVidia Corporation CK804 Ethernet Controller (rev a3)
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, 66MHz, fast devsel, latency 0, IRQ 217
Memory at f2102000 (32-bit, non-prefetchable) [size=4K]
I/O ports at e800 [size=8]
Capabilities: [44] Power Management version 2

00:0b.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00
[Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
I/O behind bridge: 0000a000-0000afff
Memory behind bridge: f0000000-f1ffffff
Prefetchable memory behind bridge: 0000000050000000-0000000050000000
Capabilities: [40] Power Management version 2
Capabilities: [48] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable+
Capabilities: [58] HyperTransport: MSI Mapping
Capabilities: [80] Express Root Port (Slot+) IRQ 0
Capabilities: [100] Virtual Channel

00:0c.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00
[Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: 00009000-00009fff
Capabilities: [40] Power Management version 2
Capabilities: [48] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable+
Capabilities: [58] HyperTransport: MSI Mapping
Capabilities: [80] Express Root Port (Slot+) IRQ 0
Capabilities: [100] Virtual Channel

00:0d.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00
[Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
I/O behind bridge: 00008000-00008fff
Capabilities: [40] Power Management version 2
Capabilities: [48] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable+
Capabilities: [58] HyperTransport: MSI Mapping
Capabilities: [80] Express Root Port (Slot+) IRQ 0
Capabilities: [100] Virtual Channel

00:0e.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00
[Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
Memory behind bridge: e8000000-efffffff
Prefetchable memory behind bridge: 00000000e0000000-00000000e7f00000
Capabilities: [40] Power Management version 2
Capabilities: [48] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable+
Capabilities: [58] HyperTransport: MSI Mapping
Capabilities: [80] Express Root Port (Slot+) IRQ 0
Capabilities: [100] Virtual Channel

00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron]
HyperTransport Technology Configuration
Flags: fast devsel
Capabilities: [80] HyperTransport: Host or Secondary Interface

00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron]
Address Map
Flags: fast devsel

00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM
Controller
Flags: fast devsel

00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron]
Miscellaneous Control
Flags: fast devsel

01:07.0 Multimedia controller: Philips Semiconductors SAA7134/SAA7135HL Video
Broadcast Decoder (rev 01)
Subsystem: TERRATEC Electronic GmbH Terratec Cinergy 400 TV
Flags: bus master, medium devsel, latency 32, IRQ 58
Memory at f2005000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [40] Power Management version 1

01:0a.0 FireWire (IEEE 1394): Texas Instruments TSB82AA2 IEEE-1394b Link Layer
Controller (rev 01) (prog-if 10 [OHCI])
Subsystem: Giga-byte Technology GA-K8N Ultra-9 Mainboard
Flags: bus master, medium devsel, latency 32, IRQ 7
Memory at f2004000 (32-bit, non-prefetchable) [size=2K]
Memory at f2000000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [44] Power Management version 2

02:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8053 PCI-E
Gigabit Ethernet Controller (rev 19)
Subsystem: Giga-byte Technology Marvell 88E8053 Gigabit Ethernet Controller
(Gigabyte)
Flags: bus master, fast devsel, latency 0, IRQ 5
Memory at f1000000 (64-bit, non-prefetchable) [size=16K]
I/O ports at a000 [size=256]
[virtual] Expansion ROM at 50000000 [disabled] [size=128K]
Capabilities: [48] Power Management version 2
Capabilities: [50] Vital Product Data
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable-
Capabilities: [e0] Express Legacy Endpoint IRQ 0
Capabilities: [100] Advanced Error Reporting

05:00.0 VGA compatible controller: nVidia Corporation NV43 [GeForce 6600 GT]
(rev a2) (prog-if 00 [VGA])
Subsystem: LeadTek Research Inc. Unknown device 2009
Flags: bus master, fast devsel, latency 0, IRQ 66
Memory at e8000000 (32-bit, non-prefetchable) [size=64M]
Memory at e0000000 (64-bit, prefetchable) [size=128M]
Memory at ec000000 (64-bit, non-prefetchable) [size=16M]
[virtual] Expansion ROM at ed000000 [disabled] [size=128K]
Capabilities: [60] Power Management version 2
Capabilities: [68] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Capabilities: [78] Express Endpoint IRQ 0
Capabilities: [100] Virtual Channel
Capabilities: [128] Power Budgeting

Best regards,
Matthias Dahl

2006-09-24 18:14:43

by Mike Galbraith

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, 2006-09-24 at 16:32 +0200, Matthias Dahl wrote:
> On Friday 15 September 2006 20:17, Jens Axboe wrote:
>
> > Sounds like a hardware issue, someone could be hogging the bus. You
> > could try and play with the pci latency setting.
>
> Is there a way I can debug this...? I really would like to get to the bottom
> of this somehow. I did one more test: installed and started enemy territory
> because it's free and heavily uses OpenGL... works fine so far. But simply
> starting an untar process in the background while et is running causes quite
> distorted sound and even the mouse pointer won't react in time anymore until
> the untar process is finished. This can't be right. IO load shouldn't cause
> sluggish responsiveness...

It depends a lot on how the application is written. Start your app at
nice -10, and retry the IO interference test.

-Mike

2006-10-06 15:58:30

by Paolo Ornati

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, 13 Aug 2006 18:15:12 +0200
Matthias Dahl <[email protected]> wrote:

> Just let me know once you got them, so I can safely delete them again.
>
> At the moment, I am trying without preemption but for example doing a untar
> kernel sources still results in sluggish system responsiveness. :-(

I used to have this type of problem and 2.6.19-rc1 looks much better
than 2.6.18.

I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
and /proc/sys/vm/swappiness = 20.

--
Paolo Ornati
Linux 2.6.19-rc1 on x86_64

2006-10-08 14:29:22

by Christian

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

Am Freitag, 6. Oktober 2006 17:58 schrieb Paolo Ornati:
> On Sun, 13 Aug 2006 18:15:12 +0200
>
> Matthias Dahl <[email protected]> wrote:
> > Just let me know once you got them, so I can safely delete them again.
> >
> > At the moment, I am trying without preemption but for example doing a
> > untar kernel sources still results in sluggish system responsiveness. :-(
>
> I used to have this type of problem and 2.6.19-rc1 looks much better
> than 2.6.18.
>
> I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> and /proc/sys/vm/swappiness = 20.


Which change in the new kernel has made it better? I was following the lkml
very close and didn't see any change that could have fixed that problem.

- Christian

2006-10-08 17:05:45

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sun, Oct 08 2006, Christian wrote:
> Am Freitag, 6. Oktober 2006 17:58 schrieb Paolo Ornati:
> > On Sun, 13 Aug 2006 18:15:12 +0200
> >
> > Matthias Dahl <[email protected]> wrote:
> > > Just let me know once you got them, so I can safely delete them again.
> > >
> > > At the moment, I am trying without preemption but for example doing a
> > > untar kernel sources still results in sluggish system responsiveness. :-(
> >
> > I used to have this type of problem and 2.6.19-rc1 looks much better
> > than 2.6.18.
> >
> > I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> > and /proc/sys/vm/swappiness = 20.
>
>
> Which change in the new kernel has made it better? I was following the lkml
> very close and didn't see any change that could have fixed that problem.

There is a substantial CFQ update, so it could be that. Or it could be
something unrelated of course, I didn't check if eg the cpu scheduler
changed much. Or vm :-)

--
Jens Axboe

2006-10-08 23:50:29

by Jesper Juhl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On 08/10/06, Jens Axboe <[email protected]> wrote:
> On Sun, Oct 08 2006, Christian wrote:
> > Am Freitag, 6. Oktober 2006 17:58 schrieb Paolo Ornati:
> > > On Sun, 13 Aug 2006 18:15:12 +0200
> > >
> > > Matthias Dahl <[email protected]> wrote:
> > > > Just let me know once you got them, so I can safely delete them again.
> > > >
> > > > At the moment, I am trying without preemption but for example doing a
> > > > untar kernel sources still results in sluggish system responsiveness. :-(
> > >
> > > I used to have this type of problem and 2.6.19-rc1 looks much better
> > > than 2.6.18.
> > >
> > > I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> > > and /proc/sys/vm/swappiness = 20.
> >
> >
> > Which change in the new kernel has made it better? I was following the lkml
> > very close and didn't see any change that could have fixed that problem.
>
> There is a substantial CFQ update, so it could be that. Or it could be
> something unrelated of course, I didn't check if eg the cpu scheduler
> changed much. Or vm :-)
>
> --
> Jens Axboe
>
I want to chime in here and let you know that I've experienced
something similar.

I'm using CFQ as my default I/O schedular.
Since 2.6.18-git<something_I'm_not_sure_of> I've experienced that when
doing heavy (or even not so heave) disk I/O my system gets very
sluggish. Observable by the fact that my mouse pointer in X "jumps"
which it never did before, and switching windows I can see the new
window repaint slowly whereas earlier it would just snap onto the
screen.

<serious hand-waving enabled>
This is quite unreliable, but I *seem* to have observed a slightly
higher overall memory use for my system since 2.6.18+ as well as the
software interrupt rate (as observable by 'top' oscilating between 1.5
& 5 % with 2.6.18+ where with older kernels it would seem to mostly
stay below 1%.
I've also observed that when rebooting, unmounting my local
filesystems takes significantly longer (previously just a second or
two, recently up to a minute or not at all, that is, the system just
hangs) - may or may not be related to this.
<serious hand-waving disabled>

In any case, disk I/O seems to have a large negative impact on system
performance recently compared to pre-2.6.18* kernels.

--
Jesper Juhl <[email protected]>
Don't top-post http://www.catb.org/~esr/jargon/html/T/top-post.html
Plain text mails only, please http://www.expita.com/nomime.html

2006-10-09 05:58:32

by Jens Axboe

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Mon, Oct 09 2006, Jesper Juhl wrote:
> On 08/10/06, Jens Axboe <[email protected]> wrote:
> >On Sun, Oct 08 2006, Christian wrote:
> >> Am Freitag, 6. Oktober 2006 17:58 schrieb Paolo Ornati:
> >> > On Sun, 13 Aug 2006 18:15:12 +0200
> >> >
> >> > Matthias Dahl <[email protected]> wrote:
> >> > > Just let me know once you got them, so I can safely delete them
> >again.
> >> > >
> >> > > At the moment, I am trying without preemption but for example doing a
> >> > > untar kernel sources still results in sluggish system
> >responsiveness. :-(
> >> >
> >> > I used to have this type of problem and 2.6.19-rc1 looks much better
> >> > than 2.6.18.
> >> >
> >> > I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> >> > and /proc/sys/vm/swappiness = 20.
> >>
> >>
> >> Which change in the new kernel has made it better? I was following the
> >lkml
> >> very close and didn't see any change that could have fixed that problem.
> >
> >There is a substantial CFQ update, so it could be that. Or it could be
> >something unrelated of course, I didn't check if eg the cpu scheduler
> >changed much. Or vm :-)
> >
> >--
> >Jens Axboe
> >
> I want to chime in here and let you know that I've experienced
> something similar.
>
> I'm using CFQ as my default I/O schedular.
> Since 2.6.18-git<something_I'm_not_sure_of> I've experienced that when
> doing heavy (or even not so heave) disk I/O my system gets very
> sluggish. Observable by the fact that my mouse pointer in X "jumps"
> which it never did before, and switching windows I can see the new
> window repaint slowly whereas earlier it would just snap onto the
> screen.

You should verify that this is CFQ related by booting into the same
kernel with elevator=deadline (or anticipatory) and attempt to reproduce
it, then reboot with CFQ and make sure it reproduces again.

Having profiles of the sluggish period would also be very interesting,
regardless of the outcome of the above test.

--
Jens Axboe

2006-10-14 14:40:12

by Matthias Dahl

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Friday 06 October 2006 17:58, Paolo Ornati wrote:

> I used to have this type of problem and 2.6.19-rc1 looks much better
> than 2.6.18.
>
> I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> and /proc/sys/vm/swappiness = 20.

I will give 2.6.19 a test in a few weeks when the dust of all the changes have
settled a bit. :-)

As my Mike Galbraith suggested, I made some tests with renicing the IO
intensive applications. This indeed makes a hell of a difference. Currently I
am renicing everything that causes a lot of disk IO to a nice of 19. Even
though this doesn't fix it completely, the occasional short hangs have become
less common.

Unfortunately things have gotten a bit worse again since I switched my machine
over to a linux software RAID5 (3 sata disks attached to the nforce4 ultra)
even though I hoped quite the opposite would happen.

Have a nice weekend,
matthew.

2006-10-14 14:57:50

by Paolo Ornati

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

On Sat, 14 Oct 2006 16:39:57 +0200
Matthias Dahl <[email protected]> wrote:

> I will give 2.6.19 a test in a few weeks when the dust of all the changes have
> settled a bit. :-)

-rc2 is rock solid here, but if you want to wait...

>
> As my Mike Galbraith suggested, I made some tests with renicing the IO
> intensive applications. This indeed makes a hell of a difference. Currently I
> am renicing everything that causes a lot of disk IO to a nice of 19. Even
> though this doesn't fix it completely, the occasional short hangs have become
> less common.

Renicing to avoid sluggish system with a simple "cp" or untar is at
best a workaround... so I say: go with .19 and see what happens !

:)

--
Paolo Ornati
Linux 2.6.19-rc2 on x86_64

2006-10-14 17:50:28

by Mike Galbraith

[permalink] [raw]
Subject: Re: sluggish system responsiveness under higher IO load

Greetings,

On Sat, 2006-10-14 at 16:39 +0200, Matthias Dahl wrote:
> On Friday 06 October 2006 17:58, Paolo Ornati wrote:
>
> > I used to have this type of problem and 2.6.19-rc1 looks much better
> > than 2.6.18.
> >
> > I'm using CONFIG_PREEMPT + CONFIG_PREEMPT_BKL, CFQ i/o scheduler
> > and /proc/sys/vm/swappiness = 20.
>
> I will give 2.6.19 a test in a few weeks when the dust of all the changes have
> settled a bit. :-)
>
> As my Mike Galbraith suggested, I made some tests with renicing the IO
> intensive applications. This indeed makes a hell of a difference. Currently I
> am renicing everything that causes a lot of disk IO to a nice of 19. Even
> though this doesn't fix it completely, the occasional short hangs have become
> less common.

(I probably should have been more verbose in my suggestion;)

What I actually suggested was that you try renicing the application you
were experiencing sluggishness with to -10, and retry your IO
interference test to see if you were experiencing scheduling latency or
something else. For example, if your GL application is using lots of
cpu, it will likely not be classified as interactive, and can end up in
the expired array, at which time an IO task can do a long burst of heavy
cpu usage at interactive status, and keep your application off of the
cpu for quite a while. The intent of renicing your application to -10
was to keep it at interactive status, and above the heavy IO tasks. (if
it sleeps at all that should work. there are other scenarios too, but
less likely than this one)

If running IO at nice 19 more or less fixes your problem, I think we can
assume that you are having scheduling troubles, so the thing to do is to
grab some top snapshots showing cpu distribution during a problem
period.

-Mike