2007-01-23 13:02:42

by Yu-Chen Wu

[permalink] [raw]
Subject: Could convert a buffer that allocated by vmalloc to pages?

Hi,
I write a driver have a big buffer (16MB,allocated by vmalloc).
I want to use the buffer to do DMA transmission so I need getting the pages
of the buffer.
Have any kernel API can do this?
My platform is x86_64 and 2GB RAM

THX


2007-01-23 13:12:35

by Anton Altaparmakov

[permalink] [raw]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

On Tue, 2007-01-23 at 21:04 +0800, Yu-Chen Wu wrote:
> Hi,
> I write a driver have a big buffer (16MB,allocated by vmalloc).
> I want to use the buffer to do DMA transmission so I need getting the pages
> of the buffer.
> Have any kernel API can do this?
> My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton
--
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/

2007-01-23 14:13:34

by Yu-Chen Wu

[permalink] [raw]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

Hi Anton,
Thanks for r your answer.
I tried vmalloc_to_page() and I have some question.
I print the "pages" in vm_struct structure of the buffer to compare the
address get from vmalloc_to_page(), result as follows:

//===source code====
L2cache=vmalloc(L2SIZE);// L2SIZE=40960
printk(KERN_INFO "find_vm_struct OK:%x
addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
for(i=0;i<L2vm->nr_pages;i++)
{
if(L2vm->pages[i])
printk("page allocated:%x\n",page_address(L2vm->pages[i]));
}
tpage=vmalloc_to_page(L2cache);
printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
//===========info of dmesg==================
[ 1561.768471] page allocated:73d65000
[ 1561.768474] page allocated:781e9000
[ 1561.768476] page allocated:6203f000
[ 1561.768478] page allocated:57fdf000
[ 1561.768481] page allocated:56ed4000
[ 1561.768483] page allocated:56ed5000
[ 1561.768485] page allocated:64ab6000
[ 1561.768488] page allocated:7cc1e000
[ 1561.768490] page allocated:60ea8000
[ 1561.768492] page allocated:60ea9000
[ 1561.768497] vmalloc_to_page tpage :7fcf7e18

Why the page address get from vmalloc_to_page is different with the first
page address of the vm_struct (73d65000)?

THX
-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of Anton Altaparmakov
Sent: Tuesday, January 23, 2007 9:12 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

On Tue, 2007-01-23 at 21:04 +0800, Yu-Chen Wu wrote:
> Hi,
> I write a driver have a big buffer (16MB,allocated by vmalloc).
> I want to use the buffer to do DMA transmission so I need getting the
pages
> of the buffer.
> Have any kernel API can do this?
> My platform is x86_64 and 2GB RAM

vmalloc_to_page()...

See mm/memory.c for the function and how to use it.

Best regards,

Anton
--
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/

2007-01-23 14:50:36

by Anton Altaparmakov

[permalink] [raw]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

On Tue, 23 Jan 2007, Yu-Chen Wu wrote:
> I tried vmalloc_to_page() and I have some question.
> I print the "pages" in vm_struct structure of the buffer to compare the
> address get from vmalloc_to_page(), result as follows:

Both the code you are showing and your question do not make any sense
to me... You need to show all of the code not some random fragments...
What the heck is L2vm for a start?

Best regards,

Anton

> //===source code====
> L2cache=vmalloc(L2SIZE);// L2SIZE=40960
> printk(KERN_INFO "find_vm_struct OK:%x
> addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
> for(i=0;i<L2vm->nr_pages;i++)
> {
> if(L2vm->pages[i])
> printk("page allocated:%x\n",page_address(L2vm->pages[i]));
> }
> tpage=vmalloc_to_page(L2cache);
> printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
> //===========info of dmesg==================
> [ 1561.768471] page allocated:73d65000
> [ 1561.768474] page allocated:781e9000
> [ 1561.768476] page allocated:6203f000
> [ 1561.768478] page allocated:57fdf000
> [ 1561.768481] page allocated:56ed4000
> [ 1561.768483] page allocated:56ed5000
> [ 1561.768485] page allocated:64ab6000
> [ 1561.768488] page allocated:7cc1e000
> [ 1561.768490] page allocated:60ea8000
> [ 1561.768492] page allocated:60ea9000
> [ 1561.768497] vmalloc_to_page tpage :7fcf7e18
>
> Why the page address get from vmalloc_to_page is different with the first
> page address of the vm_struct (73d65000)?
>
> THX
> -----Original Message-----
> From: [email protected]
> [mailto:[email protected]] On Behalf Of Anton Altaparmakov
> Sent: Tuesday, January 23, 2007 9:12 PM
> To: Yu-Chen Wu
> Cc: [email protected]
> Subject: Re: Could convert a buffer that allocated by vmalloc to pages?
>
> On Tue, 2007-01-23 at 21:04 +0800, Yu-Chen Wu wrote:
> > Hi,
> > I write a driver have a big buffer (16MB,allocated by vmalloc).
> > I want to use the buffer to do DMA transmission so I need getting the
> pages
> > of the buffer.
> > Have any kernel API can do this?
> > My platform is x86_64 and 2GB RAM
>
> vmalloc_to_page()...
>
> See mm/memory.c for the function and how to use it.
>
> Best regards,
>
> Anton
>

--
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/

2007-01-23 15:38:31

by Yu-Chen Wu

[permalink] [raw]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

Hi Anton,
All of the code as below:
//==============================================
extern struct vm_struct *vmlist;
struct vm_struct *vmlist2,*L2vm;

int find_vm_struct(void *addr)
{
struct vm_struct **p;
int i;
struct page *pg;
printk("&vmlist=%x\n",&vmlist);
for (p = &vmlist ; (L2vm = *p) != NULL ;p = &L2vm->next) {
if (L2vm->addr == addr)
goto found;
}
printk(KERN_INFO "find_vm_struct filed\n");
return 0;
found:
printk(KERN_INFO "find_vm_struct OK:%x addr:%x
nr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
for(i=0;i<L2vm->nr_pages;i++)
{
if(L2vm->pages[i])
printk("page
allocated:%x\n",page_address(L2vm->pages[i]));
}
return 1;

}


static int __init mymodule_init()
{
L2cache=vmalloc(40960);

if(L2cache)
{
struct page *tpage;
printk(KERN_INFO "L2 cache allocat success,
address:%x\n",L2cache);
read_lock(&vmlist_lock);
find_vm_struct(L2cache);
read_unlock(&vmlist_lock);
tpage=vmalloc_to_page(L2cache);
printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
}
else
{
printk(KERN_INFO "L2 cache allocat failed\n");
return -1;
}
return 0;
}
//===============================================================
The mymodule_init() is the initial function of my moudle, it will call
vmalloc to malloc a memory area(big buffer), the buffer will be used to do
DMA transmission.
If allocated the buffer successfuly, it will find the vm_struct of the
buffer, the address of vm_struct will be stored in L2vm.
If found the vm_struct, it will show all pages of the big buffer.
You can see the page get from vmalloc_to_page() is different to all of the
pages get form vm_struct.

Is it possible that the buffer allocated by vmalloc be used to do DMA
transmission?

THX
-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of Anton Altaparmakov
Sent: Tuesday, January 23, 2007 10:50 PM
To: Yu-Chen Wu
Cc: [email protected]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

On Tue, 23 Jan 2007, Yu-Chen Wu wrote:
> I tried vmalloc_to_page() and I have some question.
> I print the "pages" in vm_struct structure of the buffer to compare the
> address get from vmalloc_to_page(), result as follows:

Both the code you are showing and your question do not make any sense
to me... You need to show all of the code not some random fragments...
What the heck is L2vm for a start?

Best regards,

Anton

> //===source code====
> L2cache=vmalloc(L2SIZE);// L2SIZE=40960
> printk(KERN_INFO "find_vm_struct OK:%x
> addr:%xnr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
> for(i=0;i<L2vm->nr_pages;i++)
> {
> if(L2vm->pages[i])
> printk("page allocated:%x\n",page_address(L2vm->pages[i]));
> }
> tpage=vmalloc_to_page(L2cache);
> printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
> //===========info of dmesg==================
> [ 1561.768471] page allocated:73d65000
> [ 1561.768474] page allocated:781e9000
> [ 1561.768476] page allocated:6203f000
> [ 1561.768478] page allocated:57fdf000
> [ 1561.768481] page allocated:56ed4000
> [ 1561.768483] page allocated:56ed5000
> [ 1561.768485] page allocated:64ab6000
> [ 1561.768488] page allocated:7cc1e000
> [ 1561.768490] page allocated:60ea8000
> [ 1561.768492] page allocated:60ea9000
> [ 1561.768497] vmalloc_to_page tpage :7fcf7e18
>
> Why the page address get from vmalloc_to_page is different with the first
> page address of the vm_struct (73d65000)?
>
> THX
> -----Original Message-----
> From: [email protected]
> [mailto:[email protected]] On Behalf Of Anton
Altaparmakov
> Sent: Tuesday, January 23, 2007 9:12 PM
> To: Yu-Chen Wu
> Cc: [email protected]
> Subject: Re: Could convert a buffer that allocated by vmalloc to pages?
>
> On Tue, 2007-01-23 at 21:04 +0800, Yu-Chen Wu wrote:
> > Hi,
> > I write a driver have a big buffer (16MB,allocated by vmalloc).
> > I want to use the buffer to do DMA transmission so I need getting the
> pages
> > of the buffer.
> > Have any kernel API can do this?
> > My platform is x86_64 and 2GB RAM
>
> vmalloc_to_page()...
>
> See mm/memory.c for the function and how to use it.
>
> Best regards,
>
> Anton
>

--
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/

2007-01-23 15:42:29

by Kyle McMartin

[permalink] [raw]
Subject: Re: Could convert a buffer that allocated by vmalloc to pages?

On Tue, Jan 23, 2007 at 10:15:33PM +0800, Yu-Chen Wu wrote:
> printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);
> //===========info of dmesg==================
<snip>
> [ 1561.768492] page allocated:60ea9000
> [ 1561.768497] vmalloc_to_page tpage :7fcf7e18
>
> Why the page address get from vmalloc_to_page is different with the first
> page address of the vm_struct (73d65000)?
>

Memory returned by vmalloc is only virtually contiguous, not physically
contiguous. If you're allocating memory for DMA, see the interface
documented in Documentation/DMA-mapping.txt for more information.

-- Kyle

2007-01-23 19:36:48

by Anton Altaparmakov

[permalink] [raw]
Subject: RE: Could convert a buffer that allocated by vmalloc to pages?

Hi,

On Tue, 23 Jan 2007, Yu-Chen Wu wrote:
> All of the code as below:
> //==============================================
> extern struct vm_struct *vmlist;
> struct vm_struct *vmlist2,*L2vm;
>
> int find_vm_struct(void *addr)
> {
> struct vm_struct **p;
> int i;
> struct page *pg;
> printk("&vmlist=%x\n",&vmlist);
> for (p = &vmlist ; (L2vm = *p) != NULL ;p = &L2vm->next) {
> if (L2vm->addr == addr)
> goto found;
> }
> printk(KERN_INFO "find_vm_struct filed\n");
> return 0;
> found:
> printk(KERN_INFO "find_vm_struct OK:%x addr:%x
> nr_pages:%d\n",L2vm,L2vm->addr,L2vm->nr_pages);
> for(i=0;i<L2vm->nr_pages;i++)
> {
> if(L2vm->pages[i])
> printk("page
> allocated:%x\n",page_address(L2vm->pages[i]));

You are printing "page_address()" of each of the pages here.

[snip]
> find_vm_struct(L2cache);
> read_unlock(&vmlist_lock);
> tpage=vmalloc_to_page(L2cache);
> printk(KERN_INFO "vmalloc_to_page tpage :%x\n",tpage);

You are printing "tpage" instead of page_address(tpage)" here so of course
it will not be the same as what you did above where you printed the
page_address() instead of the pages themselves...

> Is it possible that the buffer allocated by vmalloc be used to do DMA
> transmission?

Only if you do it page by page as the pages are not physically contiguous,
i.e. you would have to call vmalloc_to_page() for each page in the
vmalloced area and then create a scatter-gather DMA operation working on
each page in sequence. I suspect this is not what you want...

You will need to read up on doing DMA mappings from the kernel to learn
how to make memory physicall contiguous. Hint start with reading
Documentation/DMA-API.txt and DMA-mapping.txt...

Best regards,

Anton
--
Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @)
Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK
Linux NTFS maintainer, http://www.linux-ntfs.org/