Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20;
Message-ID: <b43de131-24dc-192c-f5f6-09bacee52a00@virtuozzo.com>
Date:   Wed, 10 Aug 2022 10:50:10 +0300
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0)
 Gecko/20100101 Thunderbird/102.1.1
From:   Alexander Atanasov <alexander.atanasov@virtuozzo.com>
Subject: Re: [PATCH v1 1/2] Enable balloon drivers to report inflated memory
To:     "Michael S. Tsirkin" <mst@redhat.com>
Cc:     Jonathan Corbet <corbet@lwn.net>,
        Andrew Morton <akpm@linux-foundation.org>, kernel@openvz.org,
        David Hildenbrand <david@redhat.com>,
        Wei Liu <wei.liu@kernel.org>, Nadav Amit <namit@vmware.com>,
        linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org,
        linux-doc@vger.kernel.org, linux-mm@kvack.org
References: <7bfac48d-2e50-641b-6523-662ea4df0240@virtuozzo.com>
 <20220809094933.2203087-1-alexander.atanasov@virtuozzo.com>
 <20220809063111-mutt-send-email-mst@kernel.org>
 <d8fd3251-898d-89fe-226e-e166606c6983@virtuozzo.com>
 <20220810020330-mutt-send-email-mst@kernel.org>
In-Reply-To: <20220810020330-mutt-send-email-mst@kernel.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?c3VJNUJaUGRHU25EUE5vZDYzMGx3ejFPd3d5bGJ4UFZaUTdFWStkN0V4WlE0?=
 =?utf-8?B?cm9JU0VqQU9XaElUdWxPN3prR1o4dTlEbDdSNDVOaXNwdFRZcENXTndPY2RW?=
 =?utf-8?B?Y1BPQU5Gelg1QkdYRTEwa29WdlRONXZOdERZWVh1UG5xNXJIRHI4b2RlNzJs?=
 =?utf-8?B?OWJpYUN4UjBkRVNCMXh0UnFKRnRsS3JvKzZZMnpnOVhNbk9lclZaNjE1ZTlZ?=
 =?utf-8?B?ZEtPU3phMXl2RW1sak1lMEJFSmpZUFdpZjJhaWtjbkVqOGV5YlpQb3NiWTIw?=
 =?utf-8?B?dlpnVTZ5R0U1SzdXUk9aTFhhNWtmQ2pHcWo0TzR5MDRmMTRqeHM0elFxQ1Bp?=
 =?utf-8?B?WnJOUWo0MHNVYzBTenlDZmFWUS9xY2sveHU0NjhQMkNyTmljTzE3T0lRQVVC?=
 =?utf-8?B?dU9qKzFpOVZxRWRMQWtHcnVwQ1JQVFIxQmtmVzA4V1BJMGRhckY0L0JGUzAw?=
 =?utf-8?B?UlBpWXFPN2h2TTdsV0pOa1Exd3hvdlpzTDlxQXhoMllGVFROVjZYZjdYcFZI?=
 =?utf-8?B?bHpkZGx5a1VtYWdiZ3lJL0o3Z0RZWGdtcTJQV2NNQU5JNGltREtaMXVJSExw?=
 =?utf-8?B?Z3RwQjgzRmtnLzZ5VXZZN2ZhNHV0Y21FUWZYZ3lMQzA2VmM3TnN3OGxzaW1B?=
 =?utf-8?B?KzNRa2dNK2JBMTQxVjNIbmR0VHJzVnNqSm9pcDVKcno5eXFQZ0o0aXpnYmhl?=
 =?utf-8?B?bVcvc016VVpsb1I1M2gvaTY3RWtLcVRmQVhFZkNEYTByNDl5NSt0N29RaHE0?=
 =?utf-8?B?MHRCdHNjTWxMd0dqZ1lybEJEYjAyWFBFTFdxc1NKU1pMSzVDZlBRbjlWRUtN?=
 =?utf-8?B?SlBPbXRjK1prSUwvamQ1SlY3Wk9PeUQ3VjNlTk90MGk5VDBsTC9wYnp6K1p0?=
 =?utf-8?B?TE8zUi9SbkhyazJmaE0yb3FZTmtnTFJVSnFXeTNDejl6a3FiZjJ0alU2cWtZ?=
 =?utf-8?B?dVlWOUVBaDB2Z0R6eXR6SlJ1SCtqRGJtZVNCV3YvdXdkRnhaT2R6dm9oRi8x?=
 =?utf-8?B?QVFtcCtJN2FsSkVmU0VudVFsaVgzcFJuMW03dFhPSndjY2cvcC9rYlN4eHYy?=
 =?utf-8?B?R0djcHMxbHZyaExQd3BSZVhMTkZQT2lnUERjaFlUYUViRDRDcnQ1QVUwSjdC?=
 =?utf-8?B?Qkw4UTZLakRFK2VpMHpSNnpjamZ5M1lkMyszVnBMVmdpRHZmUFdYRzl2Z2tj?=
 =?utf-8?B?SDdYQkIzZDU1SGNUYk1nQzczR0dEc0h0bGNEVzQ0ZC9IeDQ0WjB0aWd5cGRT?=
 =?utf-8?B?MVZLM2x4Z1licVpJOFlFUXZTdlpnaXVNeXBXbWVjN3dkL1Bzd1VZQnJsdGtG?=
 =?utf-8?B?WXhQL1ptemRSQ1pheFNOYkwyallIRHFTUExnZk52Y2dibFVKMGVxVUpReHVQ?=
 =?utf-8?B?STVwZVV5b3BjMEN5czNZa1l3dENORENJUjZnLzhqaExnbDd3cDhNeUVZV1pS?=
 =?utf-8?B?L255OEUySGVZWFRQV1ZTY1ZsKzF0QVRNb2d5UWZzcE94Ni9sOGU2OU9XdVRM?=
 =?utf-8?B?bEJDbzNudmVSSGkzeFFwQWErSHExVmpXdHhiUFE3VzJCZnpqUGpPcGt5WFVD?=
 =?utf-8?B?UCs3SlhINWdYb1lmOXoxOW9Ibm1UZlN3ZGduWVpRM2R3TEE1eWxFQ3hRbXo4?=
 =?utf-8?B?b2dhREpoWUlSaVVGdXZ3dWIwWlBxSjRSQXI1Q01IOTcvdUtSUkpjNmpBLzY3?=
 =?utf-8?B?aXBaaXQ3MkQyM3VJNElOTzJMWG5RTFpWMkhBNzRDUit5ME9UUTFndFNnN3Nt?=
 =?utf-8?B?a29RSkwyVEppMjVXUWE5STlWMXFLWCt6Q252ejZzNEI2QUYrYklPUkI4NHhh?=
 =?utf-8?B?NFU5TjRPdEhQMjgzc0NUSzRJNGZVbFRLSlpjWG1DaXJnSDBQWkY0NTA2SnU3?=
 =?utf-8?B?Zk5wZzB5RTRpTkMzMzg1Mkl5YU1oWi9MM0I2cVdMRWdTOEpVazR0THFCeHlI?=
 =?utf-8?B?V0hiRGdUb2JTWU5RVkluajNxS2k3NlFkQmVCL1BMRGNybHNZWUQxL3plWUx1?=
 =?utf-8?B?RlF6allpMXAwZ0lHaTNJUEEvY0FFK1FPT2xkcTFCc2FyTEZ6UXRnWnNFSGdR?=
 =?utf-8?B?N3ZWampTUjNWMWhpQVdsczJDbWt4M1J1WmhlTWVCVWZObDlERHVPS2dacGdI?=
 =?utf-8?B?UXdFZEg3bVZFNi9PMHcxbVVoTVRpRU9QRzlqYlRHYjdoWW04cjY3K0lFaXBj?=
 =?utf-8?Q?56erYFejgVAHOo6Wc/6RXS8=3D?=
X-OriginatorOrg: virtuozzo.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 2911d5b5-d2da-4f2d-5041-08da7aa4f681
X-MS-Exchange-CrossTenant-AuthSource: DBBPR08MB4758.eurprd08.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Aug 2022 07:50:15.6803
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 0bc7f26d-0264-416e-a6fc-8352af79c58f
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: HpFC02PVfGx1yB8JU2OW0ZMTC08QVHdNZdQsJvWdd6KVfbdJlIBEPZKPTZ/KT8T/eNjKWCC4Z9fo1l+V6Z2zFNUyMU/RcF7xeZ2ojEKlUcG8feaABNRamiNrDlPoDUlx
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0802MB2135
X-Spam-Status: No, score=-1.1 required=5.0 tests=BAYES_00,DKIM_SIGNED,
        DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FORGED_SPF_HELO,NICE_REPLY_A,
        RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H2,SPF_HELO_PASS,SPF_NONE,
        T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.6
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on
        lindbergh.monkeyblade.net
Precedence: bulk
List-ID: <linux-kernel.vger.kernel.org>
X-Mailing-List: linux-kernel@vger.kernel.org

Hello,

On 10.08.22 9:05, Michael S. Tsirkin wrote:
> On Wed, Aug 10, 2022 at 08:54:52AM +0300, Alexander Atanasov wrote:
>> On 9.08.22 13:32, Michael S. Tsirkin wrote:
>>> On Tue, Aug 09, 2022 at 12:49:32PM +0300, Alexander Atanasov wrote:
>>>> @@ -153,6 +156,14 @@ static int meminfo_proc_show(struct seq_file *m, void *v)
>>>>    		    global_zone_page_state(NR_FREE_CMA_PAGES));
>>>>    #endif
>>>> +#ifdef CONFIG_MEMORY_BALLOON
>>>> +	inflated_kb = atomic_long_read(&mem_balloon_inflated_kb);
>>>> +	if (inflated_kb >= 0)
>>>> +		seq_printf(m,  "Inflated(total): %8ld kB\n", inflated_kb);
>>>> +	else
>>>> +		seq_printf(m,  "Inflated(free): %8ld kB\n", -inflated_kb);
>>>> +#endif
>>>> +
>>>>    	hugetlb_report_meminfo(m);
>>>>    	arch_report_meminfo(m);
>>>
>>>
>>> This seems too baroque for my taste.
>>> Why not just have two counters for the two pruposes?
>>
>> I agree it is not good but it reflects the current situation.
>> Dirvers account in only one way - either used or total - which i don't like.
>> So to save space and to avoid the possibility that some driver starts to use
>> both at the same time. I suggest to be only one value.
> 
> I don't see what would be wrong if some driver used both
> at some point.

If you don't see what's wrong with using both, i might as well add
Cached and Buffers - next hypervisor might want to use them or any other 
by its discretion leaving the fun to figure it out to the userspace?

Single definitive value is much better and clear from user prespective 
and meminfo is exactly for the users.

If a driver for some wierd reason needs to do both it is a whole new 
topic that i don't like to go into. Good news is that currently no such 
driver exists.

> 
>>
>>> And is there any value in having this atomic?
>>> We want a consistent value but just READ_ONCE seems sufficient ...
>>
>> I do not see this as only a value that is going to be displayed.
>> I tried to be defensive here and to avoid premature optimization.
>> One possible scenario is OOM killer(using the value) vs balloon deflate on
>> oom will need it. But any other user of that value will likely need it
>> atomic too. Drivers use spin_locks for calculations they might find a way to
>> reduce the spin lock usage and use the atomic.
>> While making it a long could only bring bugs without benefits.
>> It is not on a fast path too so i prefer to be safe.
> 
> Well we do not normally spread atomics around just because we
> can, it does not magically make the code safe.
> If this needs atomics we need to document why.

Of course it does not. In one of your comments to my other patches you 
said you do not like patches that add one line then remove it in the 
next patch. To avoid that i put an atomic - if at one point it is clear 
it is not required i would be happy to change it but it is more likely 
to be need than not. So i will probably have to document it instead.

At this point the decision if it should be or should not be in the 
meminfo is more important - if general opinion is positive i will 
address the technical details.

-- 
Regards,
Alexander Atanasov