Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S934210AbZDCRXf (ORCPT ); Fri, 3 Apr 2009 13:23:35 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S933849AbZDCRXK (ORCPT ); Fri, 3 Apr 2009 13:23:10 -0400 Received: from sbc-mgw1.sbcounty.gov ([170.164.50.70]:21838 "EHLO sbc-mgw1.sbcounty.gov" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S933695AbZDCRXJ convert rfc822-to-8bit (ORCPT ); Fri, 3 Apr 2009 13:23:09 -0400 X-Greylist: delayed 570 seconds by postgrey-1.27 at vger.kernel.org; Fri, 03 Apr 2009 13:23:08 EDT X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 8BIT Subject: RE: [Scst-devel] ISCSI-SCST performance (with also IET and STGTdata) Date: Fri, 3 Apr 2009 10:13:35 -0700 Message-ID: In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: [Scst-devel] ISCSI-SCST performance (with also IET and STGTdata) Thread-Index: Acm0fu0fycBtOzJJSc6L3E0ZSg5VhwAAG+sg From: "Sufficool, Stanley" To: "Bart Van Assche" , "Vladislav Bolkhovitin" Cc: "scst-devel" , , X-OriginalArrivalTime: 03 Apr 2009 17:13:36.0831 (UTC) FILETIME=[8691ACF0:01C9B47F] Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Length: 2186 Lines: 59 > -----Original Message----- > From: Bart Van Assche [mailto:bart.vanassche@gmail.com] > Sent: Friday, April 03, 2009 10:09 AM > To: Vladislav Bolkhovitin > Cc: scst-devel; linux-kernel@vger.kernel.org; > linux-scsi@vger.kernel.org > Subject: Re: [Scst-devel] ISCSI-SCST performance (with also > IET and STGTdata) > > > On Thu, Apr 2, 2009 at 7:16 PM, Vladislav Bolkhovitin > wrote: > > Bart Van Assche, on 04/02/2009 12:14 AM wrote: > >> I have repeated some of these performance tests for iSCSI > over IPoIB > >> (two DDR PCIe 1.0 ConnectX HCA's connected back to back). > The results > >> for the buffered I/O test with a block size of 512K (initiator) > >> against a file of 1GB residing on a tmpfs filesystem on the target > >> are as follows: > >> > >> write-test: iSCSI-SCST 243 MB/s; IET 192 MB/s. > >> read-test: iSCSI-SCST 291 MB/s; IET 223 MB/s. > >> > >> And for a block size of 4 KB: > >> > >> write-test: iSCSI-SCST 43 MB/s; IET 42 MB/s. > >> read-test: iSCSI-SCST 288 MB/s; IET 221 MB/s. > > > > Do you have any thoughts why writes are so bad? It shouldn't be so.. > > It's not impossible that with the 4 KB write test I hit the > limits of the initiator system (Intel E6750 CPU, 2.66 GHz, > two cores). Some statistics I gathered during the 4 KB write test: > Target: CPU load 0.5, 16500 mlx4-comp-0 interrupts per > second, same number of interrupts processed by each core (8250/s). > Initiator: CPU load 1.0, 32850 mlx4-comp-0 interrupts per > second, all interrupts occurred on the same core. Are you using connected mode IPoIB and setting the MTU to 4KB? Would fragmentation of IPoIB drive up the interrupt rates? > > Bart. > > -------------------------------------------------------------- > ---------------- > _______________________________________________ > Scst-devel mailing list > Scst-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/scst-devel > -- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/