2017-12-29 08:58:45

by Xishi Qiu

[permalink] [raw]
Subject: [RFC] mm: why vfree() do not free page table memory?

When calling vfree(), it calls unmap_vmap_area() to clear page table,
but do not free the memory of page table, why? just for performance?

If a driver use vmalloc() and vfree() frequently, we will lost much
page table memory, maybe oom later.

Thanks,
Xishi Qiu


2018-01-11 01:27:26

by Xishi Qiu

[permalink] [raw]
Subject: Re: [RFC] mm: why vfree() do not free page table memory?

On 2017/12/29 16:58, Xishi Qiu wrote:

> When calling vfree(), it calls unmap_vmap_area() to clear page table,
> but do not free the memory of page table, why? just for performance?
>
> If a driver use vmalloc() and vfree() frequently, we will lost much
> page table memory, maybe oom later.
>
> Thanks,
> Xishi Qiu
>

ping

>
> .
>



2018-01-17 09:16:05

by Vlastimil Babka

[permalink] [raw]
Subject: Re: [RFC] mm: why vfree() do not free page table memory?

On 12/29/2017 09:58 AM, Xishi Qiu wrote:
> When calling vfree(), it calls unmap_vmap_area() to clear page table,
> but do not free the memory of page table, why? just for performance?

I guess it's expected that the free virtual range and associated page
tables it might be reused later.

> If a driver use vmalloc() and vfree() frequently, we will lost much
> page table memory, maybe oom later.

If it's reused, then not really.

Did you notice an actual issue, or is this just theoretical concern.

> Thanks,
> Xishi Qiu
>

2018-01-17 09:49:26

by Xishi Qiu

[permalink] [raw]
Subject: Re: [RFC] mm: why vfree() do not free page table memory?

On 2018/1/17 17:16, Vlastimil Babka wrote:

> On 12/29/2017 09:58 AM, Xishi Qiu wrote:
>> When calling vfree(), it calls unmap_vmap_area() to clear page table,
>> but do not free the memory of page table, why? just for performance?
>
> I guess it's expected that the free virtual range and associated page
> tables it might be reused later.
>

Hi Vlastimil,

If use vmalloc/vfree different size, then there will be some hols during
VMALLOC_START to VMALLOC_END, and this holes takes page table memory, right?

>> If a driver use vmalloc() and vfree() frequently, we will lost much
>> page table memory, maybe oom later.
>
> If it's reused, then not really.
>
> Did you notice an actual issue, or is this just theoretical concern.
>

Yes, we have this problem on our production line.
I find the page table memory takes 200-300M.

Thanks,
Xishi Qiu

>> Thanks,
>> Xishi Qiu
>>
>
>
> .
>



2018-01-17 13:14:46

by Vlastimil Babka

[permalink] [raw]
Subject: Re: [RFC] mm: why vfree() do not free page table memory?

On 01/17/2018 10:48 AM, Xishi Qiu wrote:
> On 2018/1/17 17:16, Vlastimil Babka wrote:
>
>> On 12/29/2017 09:58 AM, Xishi Qiu wrote:
>>> When calling vfree(), it calls unmap_vmap_area() to clear page table,
>>> but do not free the memory of page table, why? just for performance?
>>
>> I guess it's expected that the free virtual range and associated page
>> tables it might be reused later.
>>
>
> Hi Vlastimil,
>
> If use vmalloc/vfree different size, then there will be some hols during
> VMALLOC_START to VMALLOC_END, and this holes takes page table memory, right?

Possibly. But to free a page table page, there has to be contiguous
aligned 2MB hole.

>>> If a driver use vmalloc() and vfree() frequently, we will lost much
>>> page table memory, maybe oom later.
>>
>> If it's reused, then not really.
>>
>> Did you notice an actual issue, or is this just theoretical concern.
>>
>
> Yes, we have this problem on our production line.
> I find the page table memory takes 200-300M.

Well, can you verify that it's really due to vmalloc holes? And that the
holes are there because of an unfortunate sequence of vmalloc/vfree, and
not due to some bug in vmalloc failing to reuse freed areas properly?
And do the holes contain enough 2MB aligned ranges to make it possible
to free the page tables?

Vlastimil

> Thanks,
> Xishi Qiu
>
>>> Thanks,
>>> Xishi Qiu
>>>
>>
>>
>> .
>>
>
>
>

2018-01-17 14:17:15

by Matthew Wilcox

[permalink] [raw]
Subject: Re: [RFC] mm: why vfree() do not free page table memory?

On Wed, Jan 17, 2018 at 05:48:57PM +0800, Xishi Qiu wrote:
> > Did you notice an actual issue, or is this just theoretical concern.
>
> Yes, we have this problem on our production line.
> I find the page table memory takes 200-300M.

200MB? That's mapping 800GB of virtual address space. That must be
quite the module you're loading there ...