2010-06-07 17:29:47

by Boaz Harrosh

[permalink] [raw]
Subject: Re: Performance results with exofs

Show me yours and I'll show you mine, ...! ;-)

Boaz

On 06/07/2010 08:28 PM, sfaibish wrote:
> Thanks.
>
> /Sorin
>
> On Mon, 07 Jun 2010 12:13:31 -0400, Boaz Harrosh <[email protected]>
> wrote:
>
>> On 06/07/2010 07:07 PM, Boaz Harrosh wrote:
>>> On 06/07/2010 06:24 PM, sfaibish wrote:
>>>> Boaz,
>>>>
>>>> You were mentioning some preliminary performance on NFS4.1 and pNFS
>>>> during
>>>> the pNFS call few weeks back. I thought you put them in an email but I
>>>> couldn't
>>>> find that email. Could you re-send it to me or summarize the results
>>>> in a
>>>> new
>>>> email for comparison to the block layout performance. Bruce is also
>>>> interested
>>>> so I CC him as well. Thanks
>>>>
>>>> /Sorin
>>>>
>>>
>>> I did not yet publish the Document. It's stuck behind my dis-talent for
>>> writing and the pnfs bugs de jur.
>>>
>>> Basically all machines:
>>> - connected by a 1 GBit link.
>>> - All clients doing a dd write of 8GB file from /dev/zero
>>> - 3of8 is the special raid-groups arrangement of exofs && objlayout
>>> where out of 8 devices each file is striped over 3 devices in a
>>> round robin fashion. (*With a small dirty trick)
>>>
>>
>> - All tests over an *empty* filesystem.
>>
>>> [single client]
>>> 1 - osds 40MB
>>> 2 - osds 80MB
>>> 4 - osds 114MB (saturation point of the 1 Gbit link)
>>> 8 - osds 114MB
>>>
>>> [2 clients 8of8 osds]
>>> 226 MBs
>>>
>>> [4 clients 8of8 osds]
>>> 263 MBs
>>>
>>> [8 clients 8of8 osds]
>>> 252 MBs
>>>
>>> [1 clients 3of8 osds]
>>> 114 MBs
>>>
>>> [2 clients 3of8 osds *]
>>> 226 MBs
>>>
>>> [4 clients 3of8 osds *]
>>> 417 MBs
>>>
>>> [8 clients 3of8 osds]
>>> 405 MBs
>>>
>>> Boaz
>>>
>>
>>
>>
>
>
>



2010-06-07 17:34:51

by Sorin Faibish

[permalink] [raw]
Subject: Re: Performance results with exofs

On Mon, 07 Jun 2010 13:29:41 -0400, Boaz Harrosh <[email protected]>=
=20
wrote:

> Show me yours and I'll show you mine, ...! ;-)
Working on this. Hope that next week we will have something to share. :=
)

>
> Boaz
>
> On 06/07/2010 08:28 PM, sfaibish wrote:
>> Thanks.
>>
>> /Sorin
>>
>> On Mon, 07 Jun 2010 12:13:31 -0400, Boaz Harrosh <[email protected]=
om>
>> wrote:
>>
>>> On 06/07/2010 07:07 PM, Boaz Harrosh wrote:
>>>> On 06/07/2010 06:24 PM, sfaibish wrote:
>>>>> Boaz,
>>>>>
>>>>> You were mentioning some preliminary performance on NFS4.1 and pN=
=46S
>>>>> during
>>>>> the pNFS call few weeks back. I thought you put them in an email =
but =20
>>>>> I
>>>>> couldn't
>>>>> find that email. Could you re-send it to me or summarize the resu=
lts
>>>>> in a
>>>>> new
>>>>> email for comparison to the block layout performance. Bruce is al=
so
>>>>> interested
>>>>> so I CC him as well. Thanks
>>>>>
>>>>> /Sorin
>>>>>
>>>>
>>>> I did not yet publish the Document. It's stuck behind my dis-talen=
t =20
>>>> for
>>>> writing and the pnfs bugs de jur.
>>>>
>>>> Basically all machines:
>>>> - connected by a 1 GBit link.
>>>> - All clients doing a dd write of 8GB file from /dev/zero
>>>> - 3of8 is the special raid-groups arrangement of exofs && objlayou=
t
>>>> where out of 8 devices each file is striped over 3 devices in a
>>>> round robin fashion. (*With a small dirty trick)
>>>>
>>>
>>> - All tests over an *empty* filesystem.
>>>
>>>> [single client]
>>>> 1 - osds 40MB
>>>> 2 - osds 80MB
>>>> 4 - osds 114MB (saturation point of the 1 Gbit link)
>>>> 8 - osds 114MB
>>>>
>>>> [2 clients 8of8 osds]
>>>> 226 MBs
>>>>
>>>> [4 clients 8of8 osds]
>>>> 263 MBs
>>>>
>>>> [8 clients 8of8 osds]
>>>> 252 MBs
>>>>
>>>> [1 clients 3of8 osds]
>>>> 114 MBs
>>>>
>>>> [2 clients 3of8 osds *]
>>>> 226 MBs
>>>>
>>>> [4 clients 3of8 osds *]
>>>> 417 MBs
>>>>
>>>> [8 clients 3of8 osds]
>>>> 405 MBs
>>>>
>>>> Boaz
>>>>
>>>
>>>
>>>
>>
>>
>>
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" =
in
> the body of a message to [email protected]
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
>



--=20
Best Regards

Sorin Faibish
Corporate Distinguished Engineer
Network Storage Group

EMC=B2
where information lives

Phone: 508-435-1000 x 48545
Cellphone: 617-510-0422
Email : [email protected]