Return-Path: linux-nfs-owner@vger.kernel.org Received: from aserp1040.oracle.com ([141.146.126.69]:18257 "EHLO aserp1040.oracle.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S965166AbaGPPsZ (ORCPT ); Wed, 16 Jul 2014 11:48:25 -0400 Message-ID: <53C69EC3.1010208@oracle.com> Date: Wed, 16 Jul 2014 08:48:19 -0700 From: Shirley Ma MIME-Version: 1.0 To: Chuck Lever , linux-rdma , Linux NFS Mailing List Subject: Re: [PATCH v3 00/21] NFS/RDMA client patches for 3.17 References: <59034BAD-306F-462F-A274-3EB06C0CBE47@oracle.com> In-Reply-To: <59034BAD-306F-462F-A274-3EB06C0CBE47@oracle.com> Content-Type: text/plain; charset=ISO-8859-1 Sender: linux-nfs-owner@vger.kernel.org List-ID: These two patches have been significant reduced interrupt rate by around 4 times. xprtrdma: Disable completions for FAST_REG_MR Work Requests xprtrdma: Disable completions for LOCAL_INV Work Requests Same NFS read/write workload, here are interrupts rate irq/per sec report based upon /proc/interrupts: w/o patches: ----------- PCI-MSI-edge mlx4-ib (204): 105176 PCI-MSI-edge mlx4-ib (204): 123650 PCI-MSI-edge mlx4-ib (204): 123690 PCI-MSI-edge mlx4-ib (204): 116554 PCI-MSI-edge mlx4-ib (204): 122864 And perf stat irq report: Performance counter stats for 'system wide': 2,131,870 irq:irq_handler_entry [100.00%] 2,131,870 irq:irq_handler_exit [100.00%] 635,587 irq:softirq_entry [100.00%] 635,597 irq:softirq_exit [100.00%] 636,155 irq:softirq_raise 25.422821792 seconds time elapsed w/i patches: ----------- PCI-MSI-edge mlx4-ib (204): 31131 PCI-MSI-edge mlx4-ib (204): 32958 PCI-MSI-edge mlx4-ib (204): 31068 PCI-MSI-edge mlx4-ib (204): 30236 PCI-MSI-edge mlx4-ib (204): 33041 And perf stat irq report: Performance counter stats for 'system wide': 653,548 irq:irq_handler_entry [100.00%] 653,548 irq:irq_handler_exit [100.00%] 568,138 irq:softirq_entry [100.00%] 568,148 irq:softirq_exit [100.00%] 568,690 irq:softirq_raise 21.675597062 seconds time elapsed Shirley