Received-SPF: pass (google.com: domain of linux-kernel+bounces-205086-linux.lists.archive=gmail.com@vger.kernel.org designates 2604:1380:4601:e00::3 as permitted sender) client-ip=2604:1380:4601:e00::3;
Message-ID: <0efcd0a4-569b-44d0-932f-5f81cf07b916@eideticom.com>
Date: Thu, 6 Jun 2024 15:32:22 -0600
User-Agent: Mozilla Thunderbird
Subject: Re: [PATCH 0/6] Enable P2PDMA in Userspace RDMA
To: Zhu Yanjun <zyjzyj2000@gmail.com>, linux-rdma@vger.kernel.org,
 linux-kernel@vger.kernel.org, linux-pci@vger.kernel.org, linux-mm@kvack.org
Cc: Jason Gunthorpe <jgg@ziepe.ca>, Leon Romanovsky <leon@kernel.org>,
 Bjorn Helgaas <bhelgaas@google.com>, Logan Gunthorpe <logang@deltatee.com>,
 Greg Kroah-Hartman <gregkh@linuxfoundation.org>, Tejun Heo <tj@kernel.org>,
 "Rafael J. Wysocki" <rafael@kernel.org>,
 Andrew Morton <akpm@linux-foundation.org>,
 Mike Marciniszyn <mike.marciniszyn@intel.com>,
 Michael Guralnik <michaelgur@nvidia.com>,
 Dan Williams <dan.j.williams@intel.com>, Ard Biesheuvel <ardb@kernel.org>,
 Valentine Sinitsyn <valesini@yandex-team.ru>, Lukas Wunner <lukas@wunner.de>
References: <20240605192934.742369-1-martin.oliveira@eideticom.com>
 <285e6cdb-f765-4969-ab16-abc53ad66a95@linux.dev>
Content-Language: en-US
From: Martin Oliveira <martin.oliveira@eideticom.com>
In-Reply-To: <285e6cdb-f765-4969-ab16-abc53ad66a95@linux.dev>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Precedence: bulk
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0:
	=?utf-8?B?MVNmQklGdFA3Wm9tZnR2TkswS0xrTUtLa2FjTzV6emRvVjFHSzhNT2hxeGx0?=
 =?utf-8?B?NVFCdGYyT2ZaQ3R0SUsvTyticHFCMWgvQlEzUjAzcm9lc2xORkFoZ3FVN0Nn?=
 =?utf-8?B?Lzd1Q3BZdkNvbmVoZ05rRjhtQ1hmYlVYZ2pIV1UraW1jQy9HMkJCSEhVaVI5?=
 =?utf-8?B?UmZYWmxpR1c2UXJBN2tEUnVnUG42S3BqTy9SQ1V1bC9ta1pMcloxZkpMY1h0?=
 =?utf-8?B?VkZqSHRKUjlpb25nY0Z2aXJwNHJGTUVVajltZUdlMDVweFhIU01TTVNsb3Mv?=
 =?utf-8?B?MHZFYklBcEgrbDhqajlUWElwdkNYYmhXM3FzVDFqRUJDd3F0WWlkV0pSMVRm?=
 =?utf-8?B?emZEVlpHRWxrYWFtNzh2YThjT3FQUnk4VTJBNFpEcXBlbllUN1JqNklPWGtZ?=
 =?utf-8?B?NW14YWYzdVowKzI3VjY2ZklhMnJaNElEa1VMT1FJbHFMQXhXbVJ3UjVMbFBD?=
 =?utf-8?B?c09tZ09JTTRFNy9hUWNkT3RyQ1QxYUNEbnpsQUJlaG1DVlYvTXpVcjloRjZj?=
 =?utf-8?B?cG5NcDhuVlJaRzRSZnNub3lEbVB2V0hlRHhUMUVQWVF0MkVYUmx6RFFucmo3?=
 =?utf-8?B?NEg3ZUpaNDRqQTJXcWRLWS9QS0VKSXJhbGIxZGtwdnlXMHdsRlNLeDdwcDJl?=
 =?utf-8?B?dlljYkFSbTA4ancwaDFQNVFKWHJBU1k5WGpLYVZsRkNkeEVuY2YzYlFLNEtK?=
 =?utf-8?B?bkVjWDdLcXZJdEVLeHdjeDBGeXZSNjVRNlUrQ21QQzJ3VmdtTitabUIxazA5?=
 =?utf-8?B?ZlVJd01XSkNXMHZtdmt6Q2ViOHVSVE9rbklQNmtuZGs3UWR2OWt2TUszS0xv?=
 =?utf-8?B?L1pzVHN4d29MY2prdWVOTDFhVlA3Nmw1SUdTKzJNRUJyRlBUTGZIT2tUTjA2?=
 =?utf-8?B?YWpBOTJkRGxIU0JyZXM4TU9maHVDZkVBanJkTkJ2bGViOGZwYVk2b0MwdGlC?=
 =?utf-8?B?T0JqeWZGVmZBRUM0NU5PZkppRmUwZ0owSkM2SmxURW1CMmQ4MFk0ZjJrdlEr?=
 =?utf-8?B?Vjh4bnROZDFMZjV5TkpuMnp5eXlUZ3FBT1NSaTkzTUh1NE1GSS9sMlVtS1NP?=
 =?utf-8?B?NjlXTmlaSGFUMUs0ZWlwWkdJc01sOHIyMmpUOXF3RDVPMXdsMC9oUGVkM3U2?=
 =?utf-8?B?SUVtKzJSaS90YVQvTS82a0ltUGN3ZWxteFZoWVUxTlJReEF3OFlQYlhiMy9u?=
 =?utf-8?B?eXNQWUF6REtQY0dTL09pV0o1SThtdmp3K24yZFI0T3B1MXlvTlkyekp0ZmpT?=
 =?utf-8?B?U2w1MDFlblp5amxDcCtwUWhuczM5NEJENWZLSmZWa2FVN01RMkY5UERmRVdF?=
 =?utf-8?B?Qm95N2E1WmR1KzlpdzBVN29ETVpBaUNQQ3JKWTN4eVBuMGZuS2h4Rnd4MG5Y?=
 =?utf-8?B?ZGk5MnhTWjBSZG84VjRheW1ZZnI3S1VyREZjRi8yenpwR3lGYVE5dFo1Rkts?=
 =?utf-8?B?YVVQeGNQeHFOSDUwbVE1NWFDWWZnMjE1VjA2eWtBUE0vRStxNjdMZTJjcENB?=
 =?utf-8?B?NkVHTUZQS0ZzN29oUUFLdDBvaXB5T3ZiczdldGFQRHpiNnpDMWF6TzNYMzli?=
 =?utf-8?B?Y1llN2JKaUdCdkFBMFZ0d1RqaFlTMEdOdktvcG5SV0RNVERqdXhRakxnS3p5?=
 =?utf-8?B?WTcvbUNIV3I2ZEh3K0pXMElJSjJma1FVZFcvK2hzMGp2TzJoMnNZU2s2VXNJ?=
 =?utf-8?B?aUM3cXp3RS9LT2phNTNOc25uZzQ3cEJBazJ0NUxBbFA5TWVLM1h1clVKVHkv?=
 =?utf-8?B?RlNqOStzRlFta1JJa2pEalNnVEwrYUYxUXpkM1lSRUY0THdJSE4wVlN5MURz?=
 =?utf-8?B?WXpzb2lpMmlXTFZBMDlNQU1nOGt4ZTZqRTg0R3hnQlBoYXBKREtCa3A0b3R6?=
 =?utf-8?B?S09Uck8rT2VWNHM4MVVxR3MxWHdzbHhrM2NTNVZqU014ODFHcDNtSHVPbjJJ?=
 =?utf-8?B?VVVlNzRvYWwzbStodXNaR1p2bnoxYkVVTHBxcGwrd2RReDFPdGtxc09Jam5J?=
 =?utf-8?B?QnRJdm96bDM2UXlDbW9BM2VXYnJvM3R3S1pJUFFSQlgrNU1wNVpZWXNSN2Z1?=
 =?utf-8?B?T3AzYlZUOVg2c1RudmZWNjBldmEzdU1saVR3dGgyRFZJdWlPVDV6d25FU3Vn?=
 =?utf-8?B?aHhwU2UvVkRWREZEQ0t5RjE2SUduYjJxWXhjelJHeS8zRXRKTzFQWndkb0s2?=
 =?utf-8?B?NWc9PQ==?=
X-OriginatorOrg: eideticom.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 51be555c-1565-4ec7-8022-08dc8670280b
X-MS-Exchange-CrossTenant-AuthSource: MW3PR19MB4250.namprd19.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Jun 2024 21:32:24.6665
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 3490cd4b-0360-4377-abb1-15f8c5af8fc2
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 0FJXVO/aRG9m3anZcbY2dXfT20WZMvnzcKZaQSmSgt8PpY8KxWsde4osPC6Z7YLIKpihsvCCSf2WrfptX4V55oyaHJTGtE/g6uPcWUjNAg0=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR19MB4574

On 2024-06-06 02:53, Zhu Yanjun wrote:
> On 05.06.24 21:29, Martin Oliveira wrote:
>> This patch series enables P2PDMA memory to be used in userspace RDMA
>> transfers. With this series, P2PDMA memory mmaped into userspace (ie.
>> only NVMe CMBs, at the moment) can then be used with ibv_reg_mr() (or
>> similar) interfaces. This can be tested by passing a sysfs p2pmem
>> allocator to the --mmap flag of the perftest tools.
> 
> Do you mean the following --mmap flag?
> "
> --mmap=file  Use an mmap'd file as the buffer for testing P2P transfers.
> "

Yes

> I am interested in this. Can you provide the full steps to make tests
> with this patch series
First start the server with:

ib_read_bw

Then run a client with something like this:

ib_read_bw --mmap /sys/bus/pci/devices/0000\:c5\:00.0/p2pmem/allocate <host>

Martin