Return-Path: <linux-kernel-owner@vger.kernel.org>
Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand
	id S1751411AbcCFIxi (ORCPT <rfc822;w@1wt.eu>);
	Sun, 6 Mar 2016 03:53:38 -0500
Received: from mail-am1on0066.outbound.protection.outlook.com ([157.56.112.66]:6992
	"EHLO emea01-am1-obe.outbound.protection.outlook.com"
	rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP
	id S1751138AbcCFIxa (ORCPT <rfc822;linux-kernel@vger.kernel.org>);
	Sun, 6 Mar 2016 03:53:30 -0500
Authentication-Results: spf=pass (sender IP is 193.47.165.134)
 smtp.mailfrom=mellanox.com; vger.kernel.org; dkim=none (message not signed)
 header.d=none;vger.kernel.org; dmarc=pass action=none
 header.from=mellanox.com;
Subject: Re: [PATCHv9 1/3] rdmacg: Added rdma cgroup controller
To: Parav Pandit <pandit.parav@gmail.com>, Tejun Heo <tj@kernel.org>
References: <1456859137-13646-1-git-send-email-pandit.parav@gmail.com>
 <1456859137-13646-2-git-send-email-pandit.parav@gmail.com>
 <20160302173949.GG29826@mtj.duckdns.org>
 <CAG53R5UAmTP9-m77-j2tPGZ+z8AicuVvUB_++cRUbQY-EwaBYw@mail.gmail.com>
 <CAG53R5VYnTMzG4DchY2DKgveeeXbKcjUWQpOOjCNQuY-f7g9bg@mail.gmail.com>
 <CAG53R5Wwr41Ma4AbTG==4VcOGvdO=t=be8z0Lkfq0YukuBtCzg@mail.gmail.com>
 <20160305125215.GC3567@htj.duckdns.org>
 <CAG53R5V-fhbVqZWroAkvDpgjNWchnO87G47-iXqSGg41sY1A5Q@mail.gmail.com>
CC: <cgroups@vger.kernel.org>, <linux-doc@vger.kernel.org>,
        <linux-kernel@vger.kernel.org>, <linux-rdma@vger.kernel.org>,
        <lizefan@huawei.com>, Johannes Weiner <hannes@cmpxchg.org>,
        Doug Ledford <dledford@redhat.com>, Liran Liss <liranl@mellanox.com>,
        "Hefty, Sean" <sean.hefty@intel.com>,
        Jason Gunthorpe <jgunthorpe@obsidianresearch.com>,
        Jonathan Corbet <corbet@lwn.net>, <james.l.morris@oracle.com>,
        <serge@hallyn.com>, Or Gerlitz <ogerlitz@mellanox.com>,
        Matan Barak <matanb@mellanox.com>, <akpm@linux-foundation.org>,
        <linux-security-module@vger.kernel.org>
From: Haggai Eran <haggaie@mellanox.com>
Message-ID: <56DBEC64.6090805@mellanox.com>
Date: Sun, 6 Mar 2016 10:37:56 +0200
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101
 Thunderbird/38.6.0
MIME-Version: 1.0
In-Reply-To: <CAG53R5V-fhbVqZWroAkvDpgjNWchnO87G47-iXqSGg41sY1A5Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
X-Originating-IP: [10.0.52.254]
X-EOPAttributedMessage: 0
X-Microsoft-Exchange-Diagnostics: 1;AM1FFO11OLC010;1:6341zMhYOtT8jzvAPk1NTS5zibxW6YuVsCK67m+RSoudokuwXWg3SpFT3eXCK34/f1Ru2aK7Ss7TaBIflx9125wvR7VwRczeI3hc3HAL4FlkxmGb7vq6Fmjys+mBDwMHW2HHZxJ9QAWyCFoU6C0qzmjp+eN9fqo66j1pZll8hcNb8bzSBR7RAue/mivDdTXdXMS7tVnId8qwPw1BBZoaQrHMnEvcAPonIOwBFaRcrBGz5xDAIl1Q95SL0Ris7B7GOAZt+iQ3/LxO+LY5J7BhXH0fmgoFeGLCBbMNjoxbB3S10zLyFapI8ZQLuW0/udIMVUzY/U8yH1yLnL688e6yN8h+K5Sn8StjxCZ241RwaJI39jFfWy/zkyWYoqUlqGU1qTqTkJGc2XbqcX3CpoQYM4Hpt6kYcA2J5jPfHc2OyPuSy94WEAg7Seq0eFw5CwMhzEbEHoeTXJysTOL/vQcZGA==
X-Forefront-Antispam-Report: CIP:193.47.165.134;CTRY:IL;IPV:NLI;EFV:NLI;SFV:NSPM;SFS:(10009020)(6009001)(2980300002)(438002)(24454002)(199003)(479174004)(189002)(33656002)(47776003)(87936001)(50986999)(65806001)(65956001)(87266999)(54356999)(76176999)(23676002)(64126003)(77096005)(2950100001)(5008740100001)(106466001)(5004730100002)(1096002)(1220700001)(81166005)(2906002)(230700001)(3846002)(6116002)(586003)(4001350100001)(189998001)(5001770100001)(50466002)(92566002)(36756003)(11100500001)(93886004)(6806005)(83506001)(86362001)(3940600001);DIR:OUT;SFP:1101;SCL:1;SRVR:AMSPR05MB129;H:mtlcas13.mtl.com;FPR:;SPF:Pass;MLV:sfv;A:1;MX:1;LANG:en;
X-Microsoft-Exchange-Diagnostics: 1;AMSPR05MB129;2:zY37ppCBbdEjnnM98MMN2sLpK30LANGTDxR4BqyG8P4Ezkve55Dn60ZYgLS2UKo3Y8H39c9D96pAjQUxtPu1iWw8yr3pYNyKZF0LN6Uhg0OVQ8TOIiQicVnH1D/i/k9hXVyVIlYxsViyRrkd70vmJg==;3:YqJwRD1DnZPhuA4PdnzaEgBOH36DY4f2ma7/PhZk04JOh1EgNKdwJ3SyFC5k/UqdfVPOjMLo9QcSSnse4m2mDi1fwElVjmFbqm5Y+K/5+xHLz8UizbJjsm05ymtlubxudVZ+q/NOzYXufDp6luPUmLxaA1uVAcHIpsMZLu7Tb7TZsRPycnlFLxICgRsO7KLmWwY2beSEZ8SFkjxn80G0oQVKYpTsAcYO2H9F6mEwfnEkxXSpWNv+w+zsXmY33CwrxqBbdTVSWe0e3oNmx1EbUw==;25:zVaAOhq96OdtS7+5ia9tMwfxaGIx5qe4/2acUaD1J8Ee0Uz+AaD2eo82ZZqpIvbsHapW1t+LGCqnZ/N3hucRky0elq1ZvL9waBHbsvvblE38r7wwtJJ9T00OSMAi1DtIoBieepOwdk+0vof+JedMBF8vbq2cFwRVT9Jg2HqWAHcyLcXhXnaOo1CGdzmYtA0WGrKUezU4cTfJ/yyxlXEPngqMjWRJ01MeWzt9LP9VP+WirPY52HeZdm/aob9iEYehlzxrUHOxcUfLAK6YycYc8ogJhtFbmymj6tCWNxttUm2o3Z8OqH0PNvZb3QsXVz/dDUlptUGKRF0llOHoXsTQWw==
X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(8251501001);SRVR:AMSPR05MB129;
X-MS-Office365-Filtering-Correlation-Id: 66c20ec2-2cb6-4c8d-b8fb-08d3459ab944
X-Microsoft-Exchange-Diagnostics: 1;AMSPR05MB129;20:mEMCK8adQpRE6c0KeORAaJukmGwGwgrzpN6Hglk69UJXUz344IGWzLo1shZEtm7rcOAtvYBBjaufpLCTuiUxNmotox+ykW04i4neFOUpk6TvCQqnY62T+Jcv8EiVIcbPaPquTuISdhqyVvZ8HdEs88pdSkeRARlUnDaItjZcedBAPreUtScEu3nzwYM6jzdQ4fOdbpdB812yQt/fFJARz1ihq02gnOrpikgQns/Z71ob+lrW2kpGaBZVPbg+JOJ3ROApN0Ww+sgxgSp/JRQISYnJXsYFrzM9xj9tjqqc7QAFogSCv9JPIjVoPz3j7l7fOKdXm3ATxDqvf5GkDF+Pegszjb6CQsHZAk6K+x4xw95fc84wSp+rMWt6uPCr7sZaZxIvkUY2gU8QrP7dDl+3ZqWg71m1nkr1xxv/tcZQq2CKLtvKy3icp4txGwrYm5ZfLH1xpHVl2ee6rIkdL0/r2Dx4xL3kT3V4QRdVbmj+cTdo/p3WfVKgVgoMw9N5ibWZ
X-Microsoft-Antispam-PRVS: <AMSPR05MB12949D75609F4187994A240C1B00@AMSPR05MB129.eurprd05.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:;
X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(601004)(2401047)(5005006)(13018025)(13017025)(13015025)(13024025)(13023025)(8121501046)(3002001)(10201501046);SRVR:AMSPR05MB129;BCL:0;PCL:0;RULEID:;SRVR:AMSPR05MB129;
X-Microsoft-Exchange-Diagnostics: 1;AMSPR05MB129;4:Vl3lyqst1y8mUZbimaJF+QqXJ1UK0wgjfucwiDO/SLTbN3dHJsaNOF+wPBFrHAryY7CyyHe9uofqk1CW7v42tIs70qKZVeiWAVRBF66OSUd9eQtWFbnD4LQg9HGzvUhabOi4H0cfjnRWSw9LjP6JOcigbswK9UeU4lHSnrSVKjwoXTGvkd7RKWz0LZjAWX1l1F1PaZDZl3USTxGag1sqSPUIhzF6vGpoLulYJNNQ3A3r7dPRVqFnesAG8l2jkIRQKngCmXKykOaRs5ZgsZzy8e/NrMnXCW2F/frs1NciW886P8MPHURURe1Enx4Vd1kShXm7ycqMPF/bErDaQJlHHRxV18Osb+FUbDyoyz2txTgd2Td8D/XQLPYDIxe08spzV0JpPfS2uVBRQCM+Qp4gCOhUBrRPtKgPxQWn4PxN5lIbXw50uNy+zv5Q+G5BTeL7vO7SB5BPy3R2eqDPunvyow==
X-Forefront-PRVS: 087396016C
X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtBTVNQUjA1TUIxMjk7MjM6ZDlzallXUkJMYjRiZTlMSXJ0anNKckkrRkxo?=
 =?utf-8?B?Snk3aFBtOG9heC9tMXdvZFRnQUhSWGdRYmY4eHlhcVhuOTZ2RGJ5YWx3bmxI?=
 =?utf-8?B?WXI0VkcrdlVSNUJkZWZpZVd4TS9ndGIzYkZCbEpqckNSYk5yZmpjaGM1TWpX?=
 =?utf-8?B?bEJ5Z0JrbVk3ZlVicG1wYVMwaWlSMkFCOGNSUGJoTlFzQjF4Y3dxTXZ4UHNh?=
 =?utf-8?B?cTNENEdDeTRuMmFrZEY0ZXVhNnVMak5mTVRtNkhrbFBFdDZDWXB4ekVyTzFk?=
 =?utf-8?B?OEhET0xXVXJjL3Z0d1piZkZPKzMrbEJWUnZCakhQME4rakdjSDdMM24vTzZD?=
 =?utf-8?B?MGRDcDdkMG9XSXNBVGRENDloRWdycEFGMVdWQnNsMHJ2MHhObmVxTzc0aGND?=
 =?utf-8?B?QWNDcFlvLy9PQVFkV21lZ1g3WlhkZ0F0L0RoV3Evck5JeEM3UjN1MGt4bVNw?=
 =?utf-8?B?Q0VaaHVoV2p5UzRXRGdyWnVoUkM1amE0QmRISFE1a2FNZEVxVzc2RkZxNGpW?=
 =?utf-8?B?Q2d4eGJVSzlza29QTS9rZG12R2JZWHBGWWc2SnBvMlVGNUpwK2tNNksxTC9K?=
 =?utf-8?B?S1RYbnVYV094UUpRWlVmZlp4cDF1WmgzK1E3UEZnYkk2SXZIRzlLb2dYZkw4?=
 =?utf-8?B?WEo3V3ZoTXZFWWthdFNGaFVsNUNvcW1IS3NPd2lkSmFVVWhYbHUxMXV4cm5I?=
 =?utf-8?B?dndNMmw5M2tkRDdkNmlhT3dWa3ZLTzd3RmFMWXE4bFREay9ORG9LNHhlMGtQ?=
 =?utf-8?B?Yk12YXdscDBQQWZTRk5Hb0NWbXdzbGJ5aHBBOXgwanZhejk5UzJsTEtHQjVw?=
 =?utf-8?B?MXhsRExNWGw2Q2xCNWQ1MEdOclI2SXkwMy9IaHdYOXRwNUxMZ1A3c1o4R0dU?=
 =?utf-8?B?NmR0dGYzWXpTU1FPNkZTUldFbEJISEl0b1dWcnJzZDJISEFMdmxZMloxbitW?=
 =?utf-8?B?dGoxeEJzNjdrQ1llTWNHZnZtV3R2OHZkUURNekFYdWV0NW1FNmdYb2xRdm1G?=
 =?utf-8?B?WFJPblpEcXE0U2hPYnZBMnBXY01iK3RJNXhmZitaYkdMZmRkazB6aW1hTEd6?=
 =?utf-8?B?WnMzTUIzdmMyZnpWUWxXN3VJY3NpRFhmWi9iaklidmZ0THRGNmVNQmNWSUUx?=
 =?utf-8?B?eG91T21UZ1FocmptVTY1Rys2Nmw0YldWU2dPNDVZV2RkRVZaejB2TXV6dklW?=
 =?utf-8?B?Tm92K3B1RXFjUDlzc3VKNHpuWXFmRDZCSWwrYXIwWFdrdFBZN0hHZXFwS2Jz?=
 =?utf-8?B?Tkk5RUVzT1QzMStOZ3VHbWJ4OFNTRVQ3N29kRDVsa1kvRFJnazIxeDlPbkds?=
 =?utf-8?B?dGVFVkxkdGRsMGVDcDBhRFYvUElpRTEwZE4reDNsU0ZuOElnOGMyd0RDVllo?=
 =?utf-8?B?RmNyVEtCZGpweFpxVGdMdU1FK0pDaWZIUUJuSnZCZ1dJMDI3M3h4LzNFY21T?=
 =?utf-8?B?Q3F1aTEvTWtvLzhzcTA5NE9oR0daczVkOGlIWDU3dDlhZzBjeVY4dndqcEN1?=
 =?utf-8?Q?36mveb6HTtUP9qa6w/rzSwZI=3D?=
X-Microsoft-Exchange-Diagnostics: 1;AMSPR05MB129;5:rl+/DYVW7Vo57+2jaJbp97J3HHkQ35vfWeGZtqRCh7iaxpBIfiTpEReDka0O5oa6VgqTr439Uo7H2+nqIskZyEclZn3L7Ieayo+Hh8OC3aO504ynQsHHMBicA9KEq50YDHi1nn+fNRDBlIooK3VfDg==;24:MtGbH9cYgqtx5tkHHVHQzn6QkAwWqDDFpL7yQEiwgBKq9RVGkyqhQmViW4I/2+KjovKOwtDCLT3nPjY4i3k525DttA0uNTn220CgVz/S1N4=
SpamDiagnosticOutput: 1:23
SpamDiagnosticMetadata: NSPM
X-OriginatorOrg: Mellanox.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Mar 2016 08:38:42.3224
 (UTC)
X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=a652971c-7d2e-4d9b-a6a4-d149256f461b;Ip=[193.47.165.134];Helo=[mtlcas13.mtl.com]
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AMSPR05MB129
Sender: linux-kernel-owner@vger.kernel.org
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org
Content-Length: 506
Lines: 13

On 05/03/2016 19:20, Parav Pandit wrote:
>> > 3 is fine but resource [un]charging is not hot path?
> charge/uncharge is hot path from cgroup perspective.

Most of the resources the RDMA cgroup handles are only allocated at
the beginning of the application. The RDMA subsystem allows direct
user-space access to the devices, so most of the hot path operations
don't go through the kernel at all.

It is true though that for some applications MR registration and 
de-registration is in the hot path.

Haggai