Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <04e5a2e4-052d-0f80-d642-4e104307f38b@virtuozzo.com>
Date:   Fri, 14 Oct 2022 15:50:37 +0300
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
 Gecko/20100101 Thunderbird/102.3.2
Subject: Re: RFC [PATCH v4 2/7] Enable balloon drivers to report inflated
 memory
To:     David Hildenbrand <david@redhat.com>,
        Nadav Amit <nadav.amit@gmail.com>
Cc:     "Michael S. Tsirkin" <mst@redhat.com>,
        Andrew Morton <akpm@linux-foundation.org>, kernel@openvz.org,
        Linux Virtualization <virtualization@lists.linux-foundation.org>,
        LKML <linux-kernel@vger.kernel.org>,
        Linux MM <linux-mm@kvack.org>
References: <20221005090158.2801592-1-alexander.atanasov@virtuozzo.com>
 <20221005090158.2801592-3-alexander.atanasov@virtuozzo.com>
 <88EDC41D-408F-4ADF-A933-0A6F36E5F262@gmail.com>
 <a8ce5c48-3efc-5ea3-6f5c-53b9e33f65c7@virtuozzo.com>
 <42C75E59-696B-41D5-BD77-68EFF0B075C6@gmail.com>
 <d55338c4-d15f-14ec-c057-806a5d5aa618@virtuozzo.com>
 <71E14334-CA3B-45FB-A854-7A8D6649C798@gmail.com>
 <b7dd38ba-9ff9-6b4c-2460-d4b1ee3bb3f0@virtuozzo.com>
 <1118F098-972A-4F58-8EE1-270A06E4F9D1@gmail.com>
 <7ba328e5-3bc8-cb22-f00c-eddb8aea9a06@virtuozzo.com>
 <063efd58-8373-90ea-7c5e-9d0e9161d2ba@redhat.com>
From:   Alexander Atanasov <alexander.atanasov@virtuozzo.com>
In-Reply-To: <063efd58-8373-90ea-7c5e-9d0e9161d2ba@redhat.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?MEN5OXdHaGlrOXNRa0xkaTVvYlpSa1RwLzJJSGhmMDZWOUU2aEl0ZmFYSWkw?=
 =?utf-8?B?RVprMzhCT0cxSHpOTGJ2NVNJTUtnRVNEREtwazRhR2NRSnhlMXlRRFJHNDN4?=
 =?utf-8?B?VWFXRllqVFJLR3phdnE4OEttcWJjeEk4NEZVWnZJOGxlM0VoSExORWhpbVdj?=
 =?utf-8?B?RUZFakpxVE1QMEx1bmZtZ0Q2czluenlLN2tqOVJWSHUwdXAyakRMaGFmdGl6?=
 =?utf-8?B?UEVldkV6bnZkdjJZbFVaQkZNMkpheUdKSzNQOHV1dUVMdk16bHhWMzNhc0xh?=
 =?utf-8?B?TEVnN0Rid2N3eWZrYWVvWUh2ZWVrWllVM3V0c3R2TGx2T1NvT09xcnJvOTVo?=
 =?utf-8?B?ZE4ySWkvOHVRaGlac3o3N215MHNlMlVYYXFEV3BUbElzZXNVUWowSDdzOHBw?=
 =?utf-8?B?MnVaWmFBT2FWd3hFaDBZSnBFUXBNVVZ2QlM3YkNqQVZodTVvYzM3MlJlazdx?=
 =?utf-8?B?Q2JnOW4zTGk4YmRlTGZ6QUMreGk3K2hVNjZ5VEtQTHRGMThkek9Wc2FiWS9Y?=
 =?utf-8?B?cXJkNk14cExkb3BwRmF4a0pOakVLV2tsVGRWdDMvU3dPd0x4M2NKV20zd3dI?=
 =?utf-8?B?K3FQZmpVU2VXRFBPNTVjVFdIS2tMa1BmZmZhdDl5REF2S0ZkcnMwUmtFaGN5?=
 =?utf-8?B?YXMzN2hsWXZVK0lETldsMjdFVTdaa1dxelVzZldzdnVic2M2cjFvSW5BeG9h?=
 =?utf-8?B?ZFM2MGp5L1NpRDA0cFlUYi9IQldDTmFZQlhRNmVsVDJvcWNOYlo1WHpIWHZU?=
 =?utf-8?B?cFpvM1p5UXVlTlhEbmRTclZkcytBbjUxeFJnZlRESmRTZTNUMnozd2tIZkpZ?=
 =?utf-8?B?aWpkU1pyV0hOOVVLTUdKbTl1R3ByTkppWGtNdGkrSit2eGNBb2pnSW5wVmI3?=
 =?utf-8?B?NFJlUFB4eG42R2V1ay8vV29XWmlDVHpjQm1RcGNTNGY0ekgwK0J6SWRkbjQ3?=
 =?utf-8?B?ZXNqSUJ0VUFqNi9jbVlMQk9zU2Z1d2ZFMFJxcGtVVHR0ZythOHdjTm9SdVUz?=
 =?utf-8?B?ODdkLzBhVmJjMEhoZTZiKzNWMlR3S0dOOENwekVURlFHUVpQSHBNcm03YVNh?=
 =?utf-8?B?bS9qMU80WXBUREd2cDE5cHdtV0JyZGhSeWNrclBuRVlPTUVQcWFWNjQ2Znhp?=
 =?utf-8?B?ZnA0SUpqdFBqdDFuVEVqUWU3QmI5RzFoaEQ4K2V1TXk1NW5IdllhL2ZNc29z?=
 =?utf-8?B?RGhXQ1FGdXJDZEkyQ01UalB0OGNhWHhQRVFRMmQ1M0NUaUk0djFram5YSkpQ?=
 =?utf-8?B?R3dKaDd4K1gzRzQ0cVFOTU5NWTA4YTRXYVhlOVZiQXNFeEdOZDhlU2FOSUpX?=
 =?utf-8?B?bWFRZWxYekNUNENQdUFZUzh3NURTQnh5VENaN1d5TjJUN0t2SmFEaHZSSzZM?=
 =?utf-8?B?clFCZjAya2VxdlF3Wm1VV256RGI2aTBYeG5zb1oxd1paMDRaWUdHcklFT2hy?=
 =?utf-8?B?MWpKazhPSTV5RnVna2l6cThZNDhRb2VnL0VKUkJIek9VOVZBd0syTytmeXNB?=
 =?utf-8?B?QlhSQnJXUnFkSXh2R25RSThCVFo5RDVVTmt4TzRzOVZYZkhRZTh6dlQzdmxp?=
 =?utf-8?B?Zkt4aVdGaWRhQU43NXlMTVNUMFcyb2JyZVpMdnNwQm9iMGRmRGFCWGtLVmJT?=
 =?utf-8?B?Y054NFpVWXRKeTExbjFOMHBIMW01aHBZMFdZQkJPRGtjYmxTSGF6RGtUZWll?=
 =?utf-8?B?dk9ENWMxbGlqSkhqZkI0Tit3NkE0azRacEQxSmJCblhjQ0tHbjNwSHRhYW9n?=
 =?utf-8?B?a0ZJeDVOdy9ZeWptekRnc25jMHdzcjh0UjZiSC9sdUJhMDl5enJMakRtZUU5?=
 =?utf-8?B?N0RGMU85QnJpdC80RW1seGxPWXRqNWE1NzFTejNEd1ZLS2VRWCtBUzErbHkv?=
 =?utf-8?B?eXdWNGV4d2txSzduM1oybnE1bmgwbG9TbjB5cWRGZm5ac0dOcE0zVit2UCtv?=
 =?utf-8?B?d1ByaFhlZDZxcEVkU1BlUVU5aVlJMEpubTIycE9sL3FTeUNYZC9RckU0U1VJ?=
 =?utf-8?B?cE51K0I4UGsrSHF2Nkt4SHBDTmFMK0FuWU5OOXhDcXZXaHVoYlJ2TnVKYkVi?=
 =?utf-8?B?MU5GcnAwdWNLSmUwYlJTazlLVjJQOC91TWpLbkZ2Zno5amRoRTBhZTJxS1oz?=
 =?utf-8?B?YzRweXZPVjRnMSsyM2srdzRBZzIrMUNqSjc1VXJWTDZ6WXBvQnVuVVNHNFZ5?=
 =?utf-8?B?N1E9PQ==?=
X-OriginatorOrg: virtuozzo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: dc95fbc3-7c7c-4fc3-a246-08daade2b258
X-MS-Exchange-CrossTenant-AuthSource: VE1PR08MB4765.eurprd08.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Oct 2022 12:50:39.3651
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 0bc7f26d-0264-416e-a6fc-8352af79c58f
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 6cEhYv9bhHD6n9tzWvWBvVKP0STl383GR6i6OSQG2MJZU7mNR0WnQhjfdw62U09N2KPOLLFhCFME6XhUHQTwxjlSVTYynKo2/939IYlxmVTSB32YN+t8bMrKKt6SeGjo
X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR08MB5344
X-Spam-Status: No, score=-4.0 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,NICE_REPLY_A,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE
        autolearn=ham autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hello,

On 11.10.22 12:23, David Hildenbrand wrote:
>>>>> Sounds to me that all you want is some notifier to be called from
>>>>> adjust_managed_page_count(). What am I missing?
>>>>
>>>> Notifier will act as an accumulator to report size of change and it 
>>>> will make things easier for the drivers and users wrt locking.
>>>> Notifier is similar to the memory hotplug notifier.
>>>
>>> Overall, I am not convinced that there is any value of separating the 
>>> value
>>> and the notifier. You can batch both or not batch both. In addition, 
>>> as I
>>> mentioned, having two values seems racy.
>>
>> I have identified two users so far above - may be more to come.
>> One type needs the value to adjust. Also having the value is necessary
>> to report it to users and oom. There are options with callbacks and so
>> on but it will complicate things with no real gain. You are right about
>> the atomicity but i guess if that's a problem for some user it could
>> find a way to ensure it. i am yet to find such place.
>>
> 
> I haven't followed the whole discussion, but I just wanted to raise that 
> having a generic mechanism to notify on such changes could be valuable.
> 
> For example, virtio-mem also uses adjust_managed_page_count() and might 
> sometimes not trigger memory hotplug notifiers when adding more memory 
> (essentially, when it fake-adds memory part of an already added Linux 
> memory block).
> 
> What might make sense is schedule some kind of deferred notification on 
> adjust_managed_page_count() changes. This way, we could notify without 
> caring about locking and would naturally batch notifications.
> 
> adjust_managed_page_count() users would not require changes.

Making it deferred will bring issues for both the users of the 
adjust_managed_page_count and the receivers of the notification - 
locking as first. And it is hard to know when the adjustment will 
finish, some of the drivers wait and retry in blocks. It will bring 
complexity and it will not be possible to convert users in small steps.

Other problem is that there are drivers that do not use 
adjust_managed_page_count().

Extending the current memory hotplug notifier is not an option too much 
things can break.

I think some new option CONFIG_DYN_MEM_CONSTRAINTS or a better name.
Add a dynmem_notifier that bring size changes to the subscribers.
CONFIG_DYN_MEM_CONSTRAINTS to be able to convert current __init 
functions without growing kernel in size when not using it.

One idea about the absolut values in sysfs/proc is to check if the 
option is set by the user or it is the same as was calculated at init 
time - if it is not set by the user it can be adjusted up/down by 
percent of the change in memory - it may require min/max value boundaries.

Does anyone know - if it is possible to know if a sysfs/proc file has 
been written to since boot?


-- 
Regards,
Alexander Atanasov