Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <a8ce5c48-3efc-5ea3-6f5c-53b9e33f65c7@virtuozzo.com>
Date:   Thu, 6 Oct 2022 10:34:52 +0300
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
 Gecko/20100101 Thunderbird/102.3.1
Subject: Re: [PATCH v4 2/7] Enable balloon drivers to report inflated memory
To:     Nadav Amit <nadav.amit@gmail.com>
Cc:     "Michael S. Tsirkin" <mst@redhat.com>,
        David Hildenbrand <david@redhat.com>,
        Andrew Morton <akpm@linux-foundation.org>, kernel@openvz.org,
        Linux Virtualization <virtualization@lists.linux-foundation.org>,
        LKML <linux-kernel@vger.kernel.org>, linux-mm@kvack.org
References: <20221005090158.2801592-1-alexander.atanasov@virtuozzo.com>
 <20221005090158.2801592-3-alexander.atanasov@virtuozzo.com>
 <88EDC41D-408F-4ADF-A933-0A6F36E5F262@gmail.com>
From:   Alexander Atanasov <alexander.atanasov@virtuozzo.com>
In-Reply-To: <88EDC41D-408F-4ADF-A933-0A6F36E5F262@gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?eURLbzIxUWpDYXNZZWRmbWpKTjNSdTJoakJ1eGczK2JrVnNiOUVsb0lqQ0Qr?=
 =?utf-8?B?bXVia3VLNTFyVHV6QnhMRDBBTllhQXNIc0J2ZmFxbFV1b0hjMThRZVlXU1k2?=
 =?utf-8?B?T3pzN1Joa0t6MnlQaXArT1N6OG5kaytteXBaNEtOc0FENnkzU2M3ZkNuM1hP?=
 =?utf-8?B?TndodXJQUkhtVytpaDNyalJNQVMzYllSaWxvUkZiK2FEemEzbzJHOTdaUi8r?=
 =?utf-8?B?NGZRUCt5RDY2MEFza29BNVlHVWpZeGtzVUkxZGpEQlFXQVJwaE1sMU1uTjg1?=
 =?utf-8?B?WVZoNGJNTFV6bFhTQ2pvZi8rYy9YRTA1VUk3MXE4NmZUSHhFUkwwY0x5ejBk?=
 =?utf-8?B?MGc5QmdWQWp6ck5UWU8ydENBdUZqU01ORkdkY294djlhRThBUUJHVXUwTmR3?=
 =?utf-8?B?ZEhvSXUzTzl4V0ZTL3dLV0tiMDl5elpFVmJjTkwvOGY2dXl3b2N2OWtFOThw?=
 =?utf-8?B?T0lvTEZJNDliL1FOYU5LMDdyQnlJZkFzcXVWdFZmelNhVm5tVkZReDZ6cWR3?=
 =?utf-8?B?VXlXMk51QW9UR3dJTzJIb3VnOFQ1b01TeWlhdnUzVStXY0VpS3Q0Z1ZmODhG?=
 =?utf-8?B?OU5STzh5dmNuOGY1bWxUODNhWWpEUGxZQmR2d0pUQ1pJTm01MWF1RkZFdzEr?=
 =?utf-8?B?V2l5YmZvUHdKd3RQemFkdkkyY3hVOTlib3RBbTdYWUx4OWZMWkthRWpFS25n?=
 =?utf-8?B?bkFXMzJsbHNqUnVaSEhJalllT0NCZm5HY2NpNVM4ZWYvRGdMSzJBM3ZiYi94?=
 =?utf-8?B?MFowcGJJeDdtRE5aWUMyVm5wQmFPcjVpSGFUUVZqejdlSzU4MEx2aURGRkRa?=
 =?utf-8?B?OS8vQ0RGQmo0cnRNOFM4bnNraW5ldG9ZdjE2WExhZnRnRWtEMFROUnZiSG9z?=
 =?utf-8?B?dnFzS0UrcSt6N1h4SldldURJWk1iT2JNZDJXUGp4OUdzQjNENEpPdHdZdWsy?=
 =?utf-8?B?VUxiUzR2WEdFbnN5NVpIVGZYS080L0ZSMGVNUk5hSTJRR0d0MUNPL0NFNVRG?=
 =?utf-8?B?Z1pmZzhMVEE1Y2FlK1J2azA4ZHIrUFFWb0cxZWJyZEVCK2NKYlFQMzZ2QzBz?=
 =?utf-8?B?Nkp3UDlvRTR2dGplb29oalpQSzI1ME9KMythQWJtdzY4NW9DVXJnbUlqeHI5?=
 =?utf-8?B?MThFQUFUTVZmZlVCWkUySnptRG9Za202WUFUNU5jdUVWa1I2aEVYd3kvR1V6?=
 =?utf-8?B?bHZVK05NS2RnVEQrOTdiWUZmem53azRVazdXV1gzS1pQUEVsaEpzbkVWRnF5?=
 =?utf-8?B?L0dINktGL0liZGhLZjRWNkVqd0tBcGhhMndlWCtuQW43RVE1MzhUQlpyQWtV?=
 =?utf-8?B?aFZBZFI2dnZTZHl0WkN0WnJBa1RsbTNxZllFZVFiaXRxYmZ1OTYwQzRnQmhl?=
 =?utf-8?B?YlQxcXpHUlZRWURWajhZNkNzMjVOdEYzZFZ6b1pMV2xvL3NzWmpTUjliWWZO?=
 =?utf-8?B?YVovL2ltYjJCOGZKWlNpMXN2bWNpM3UrbXREeTlENitlQnVrbnViRkNqODZJ?=
 =?utf-8?B?b3NYZ0xUbFE4TXRWYy9YSHN3UGMvcXQ4MGtiV3Zabk8wZHNweXc0MFVPSFNu?=
 =?utf-8?B?OUt0MVdZbGRRQ1dsc1cvemN6Q0IzaFpHV3VFWUpadXAvOVU4NHpSSGh0VHBR?=
 =?utf-8?B?ZCtPM0FHZ0RuaWxxNEROZ1ZjRVRvV2JDeTFqV3ZBNVJrK3k2MWtSaDVBZW9u?=
 =?utf-8?B?U3EveGZ1SUlON1RNNnJtY2g4eG8rWDFvREJvOWFQUjkwWk5CTnZpSVhtOFp0?=
 =?utf-8?B?YjFCcGphSkM5dGpnVDM5bWVPc0ZYSjZlM0JUa2lQZ0ErbFlWRFJGVjRXemM4?=
 =?utf-8?B?NG8wajBHUFk4VGkreEd2UVBIRlZlV3A4TEthL1F2S05VSzM1Z0NPclp1MktL?=
 =?utf-8?B?MzVCVHRlQ004RFh4T1FXbFV4cm1qN0FlQUtTOU5pUkJBNHlmd3pXYW9Bekor?=
 =?utf-8?B?b3AyOEtRQ093NnQ0d3RSTi9PSkF3UEM2N29HZTQwSUREdVNrYUd4UFNDT0Z6?=
 =?utf-8?B?dHlqRUJtRkdjWnVwbWREajZ3c3lEOGhNNXpBaUpWM1BnUFZrTXI0eE9ZNlZF?=
 =?utf-8?B?QzJkYTMxQ0ZnelVLeERzVHExVjVuTEtZbGFLWlI1SFdsZFZvUEpMdEVvMTJ6?=
 =?utf-8?B?ZVRERWFFTkRKa01CY3pIZ0JDYWRNUE1mNXRJZ0d1QkxYd1ZzZmFXWWJMdjh0?=
 =?utf-8?B?NFE9PQ==?=
X-OriginatorOrg: virtuozzo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: ace9cf16-1180-481d-642a-08daa76d42e3
X-MS-Exchange-CrossTenant-AuthSource: VE1PR08MB4765.eurprd08.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Oct 2022 07:34:54.4006
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 0bc7f26d-0264-416e-a6fc-8352af79c58f
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: wozNDqm6046vwisxxpm1gHNV+enNi6Tqf0Vi9b/RfGALEPcd/Tenr4vdy82spL717MR/joDlcNeM9cwhq/JA8zgGSGYugkbmi2jLZhp1o5JH7o+h1+977ArGpXWjlADL
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS4PR08MB7531
X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,NICE_REPLY_A,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hello,


On 5.10.22 20:25, Nadav Amit wrote:
> On Oct 5, 2022, at 2:01 AM, Alexander Atanasov <alexander.atanasov@virtuozzo.com> wrote:
> 
>> Add counters to be updated by the balloon drivers.
>> Create balloon notifier to propagate changes.
> 
> I missed the other patches before (including this one). Sorry, but next
> time, please cc me.

You are CCed in the cover letter since the version. I will add CC to you
in the individual patches if you want so.

> 
> I was looking through the series and I did not see actual users of the
> notifier. Usually, it is not great to build an API without users.


You are right. I hope to get some feedback/interest from potential users 
that i mentioned in the cover letter. I will probably split the notifier
in separate series. To make it usefull it will require more changes.
See bellow more about them.


> [snip]
> 
>> +
>> +static int balloon_notify(unsigned long val)
>> +{
>> +	return srcu_notifier_call_chain(&balloon_chain, val, NULL);
> 
> Since you know the inflated_kb value here, why not to use it as an argument
> to the callback? I think casting to (void *) and back is best. But you can
> also provide pointer to the value. Doesn’t it sound better than having
> potentially different notifiers reading different values?

My current idea is to have a struct with current and previous value,
may be change in percents. The actual value does not matter to anyone
but the size of change does. When a user gets notified it can act upon
the change - if it is small it can ignore it , if it is above some 
threshold it can act - if it makes sense for some receiver  is can 
accumulate changes from several notification. Other option/addition is 
to have si_meminfo_current(..) and totalram_pages_current(..) that 
return values adjusted with the balloon values.

Going further - there are few places that calculate something based on 
available memory that do not have sysfs/proc interface for setting 
limits. Most of them work in percents so they can be converted to do 
calculations when they get notification.

The one that have interface for configuration but use memory values can 
be handled in two ways - convert to use percents of what is available or 
extend the notifier to notify userspace which in turn to do calculations 
and update configuration.

> Anyhow, without users (actual notifiers) it’s kind of hard to know how
> reasonable it all is. For instance, is it balloon_notify() supposed to
> prevent further balloon inflating/deflating until the notifier completes?

No, we must avoid that at any cost.

> Accordingly, are callers to balloon_notify() expected to relinquish locks
> before calling balloon_notify() to prevent deadlocks and high latency?

My goal is to avoid any possible impact on performance. Drivers are free 
to delay notifications if they get in the way. (I see that i need to 
move the notification after the semaphore in the vmw driver - i missed 
that - will fix in the next iterration.)
Deadlocks - depends on the users but a few to none will possibly have to 
deal with common locks.


-- 
Regards,
Alexander Atanasov