2010-12-07 11:29:40

by Sanka Piyaratna

[permalink] [raw]
Subject: Posted Write onto a PCI end point device using Linux

Hi,


I am wondering whether it is possible to issue a posted write using the host
computer's root complex towards an PCI express end point. I have done this using

DMA in the past. However, if posted writes are possible that would save a lot of

time and effort and would be quicker too.

Thanks,
Sanka



2010-12-08 01:47:00

by Robert Hancock

[permalink] [raw]
Subject: Re: Posted Write onto a PCI end point device using Linux

On 12/07/2010 05:29 AM, Sanka Piyaratna wrote:
> Hi,
>
>
> I am wondering whether it is possible to issue a posted write using the host
> computer's root complex towards an PCI express end point. I have done this using
>
> DMA in the past. However, if posted writes are possible that would save a lot of
>
> time and effort and would be quicker too.

Writes from the CPU to PCI memory are always posted. However, the posted
write buffer size is usually quite limited and so this probably will
still cause CPU overhead when writing any significant amount of data
this way.

2010-12-08 04:55:49

by Robert Hancock

[permalink] [raw]
Subject: Re: Posted Write onto a PCI end point device using Linux

On Tue, Dec 7, 2010 at 9:57 PM, Sanka Piyaratna <[email protected]> wrote:
> Hi Robert,
> Could you please tell me how I can initiate a posted write towards a PCIe
> endpoint with larger than 32 bit payload using Linux?
> Thanks and regards,

You can try writeq to get a 64-bit payload, but I don't think it's
available on all platforms. In particular with a 32-bit CPU, it may
not be possible at all. If you need to send bigger payloads then you
need to use DMA.

>
> Sanka Piyaratna
>
> ________________________________
> From: Robert Hancock <[email protected]>
> To: Sanka Piyaratna <[email protected]>
> Cc: [email protected]
> Sent: Wed, 8 December, 2010 12:16:54 PM
> Subject: Re: Posted Write onto a PCI end point device using Linux
>
> On 12/07/2010 05:29 AM, Sanka Piyaratna wrote:
>> Hi,
>>
>>
>> I am wondering whether it is possible to issue a posted write using the
>> host
>> computer's root complex towards an PCI express end point. I have done this
>> using
>>
>> DMA in the past. However, if posted writes are possible that would save a
>> lot of
>>
>> time and effort and would be quicker too.
>
> Writes from the CPU to PCI memory are always posted. However, the posted
> write buffer size is usually quite limited and so this probably will
> still cause CPU overhead when writing any significant amount of data
> this way.
>
>

2010-12-08 06:05:42

by Sanka Piyaratna

[permalink] [raw]
Subject: Re: Posted Write onto a PCI end point device using Linux

Thanks for that Robert. When you say DMA, this has to be implemented at the
endpoint device doesn't it? There is no DMA mode on the CPU for doing this is
there?

Sanka Piyaratna




________________________________
From: Robert Hancock <[email protected]>
To: Sanka Piyaratna <[email protected]>
Cc: [email protected]
Sent: Wed, 8 December, 2010 3:25:47 PM
Subject: Re: Posted Write onto a PCI end point device using Linux

On Tue, Dec 7, 2010 at 9:57 PM, Sanka Piyaratna <[email protected]> wrote:
> Hi Robert,
> Could you please tell me how I can initiate a posted write towards a PCIe
> endpoint with larger than 32 bit payload using Linux?
> Thanks and regards,

You can try writeq to get a 64-bit payload, but I don't think it's
available on all platforms. In particular with a 32-bit CPU, it may
not be possible at all. If you need to send bigger payloads then you
need to use DMA.

>
> Sanka Piyaratna
>
> ________________________________
> From: Robert Hancock <[email protected]>
> To: Sanka Piyaratna <[email protected]>
> Cc: [email protected]
> Sent: Wed, 8 December, 2010 12:16:54 PM
> Subject: Re: Posted Write onto a PCI end point device using Linux
>
> On 12/07/2010 05:29 AM, Sanka Piyaratna wrote:
>> Hi,
>>
>>
>> I am wondering whether it is possible to issue a posted write using the
>> host
>> computer's root complex towards an PCI express end point. I have done this
>> using
>>
>> DMA in the past. However, if posted writes are possible that would save a
>> lot of
>>
>> time and effort and would be quicker too.
>
> Writes from the CPU to PCI memory are always posted. However, the posted
> write buffer size is usually quite limited and so this probably will
> still cause CPU overhead when writing any significant amount of data
> this way.
>
>



2010-12-08 15:23:07

by Robert Hancock

[permalink] [raw]
Subject: Re: Posted Write onto a PCI end point device using Linux

On Wed, Dec 8, 2010 at 12:05 AM, Sanka Piyaratna <[email protected]> wrote:
> Thanks for that Robert. When you say DMA, this has to be implemented at the
> endpoint device doesn't it? There is no DMA mode on the CPU for doing this is
> there?

No, there's not (on typical hardware, anyway).

>
> ?Sanka Piyaratna
>
>
>
>
> ________________________________
> From: Robert Hancock <[email protected]>
> To: Sanka Piyaratna <[email protected]>
> Cc: [email protected]
> Sent: Wed, 8 December, 2010 3:25:47 PM
> Subject: Re: Posted Write onto a PCI end point device using Linux
>
> On Tue, Dec 7, 2010 at 9:57 PM, Sanka Piyaratna <[email protected]> wrote:
>> Hi Robert,
>> Could you please tell me how I can initiate a posted write towards a PCIe
>> endpoint with larger than 32 bit payload using Linux?
>> Thanks and regards,
>
> You can try writeq to get a 64-bit payload, but I don't think it's
> available on all platforms. In particular with a 32-bit CPU, it may
> not be possible at all. If you need to send bigger payloads then you
> need to use DMA.
>
>>
>> Sanka Piyaratna
>>
>> ________________________________
>> From: Robert Hancock <[email protected]>
>> To: Sanka Piyaratna <[email protected]>
>> Cc: [email protected]
>> Sent: Wed, 8 December, 2010 12:16:54 PM
>> Subject: Re: Posted Write onto a PCI end point device using Linux
>>
>> On 12/07/2010 05:29 AM, Sanka Piyaratna wrote:
>>> Hi,
>>>
>>>
>>> I am wondering whether it is possible to issue a posted write using the
>>> host
>>> computer's root complex towards an PCI express end point. I have done this
>>> using
>>>
>>> DMA in the past. However, if posted writes are possible that would save a
>>> lot of
>>>
>>> time and effort and would be quicker too.
>>
>> Writes from the CPU to PCI memory are always posted. However, the posted
>> write buffer size is usually quite limited and so this probably will
>> still cause CPU overhead when writing any significant amount of data
>> this way.
>>
>>
>
>
>
>
>