Subject: Question about dma_alloc_coherent and iommu
From: Robert Walsh <rjwalsh@durables.org>
To: Linux Kernel <linux-kernel@vger.kernel.org>
Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-cQ2G+7ML3GvEX4QHIEs8"
Date: Fri, 26 May 2006 11:55:18 -0700
Message-Id: <1148669718.3665.11.camel@phosphene.durables.org>
Mime-Version: 1.0
Sender: linux-kernel-owner@vger.kernel.org
Content-Length: 1884
Lines: 55


--=-cQ2G+7ML3GvEX4QHIEs8
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable

Hi there,

Our driver (the ipath driver in drivers/infiniband) uses
dma_alloc_coherent to allocate buffers that our device will DMA into.
We use a 64-bit DMA mask.  Although we don't set a consistent DMA mask,
it doesn't seem to matter whether we do or not for the following
problem.

Everything works fine on 2.6.16: when the device tells us it's DMA'd
into a buffer, the data is there and everyone is happy.  It also works
fine on kernels from 2.6.9 through 2.6.15, but only as long as there is
4GB or less of memory on the machine.  On our machines with > 4GB
memory, the buffers do not appear to have had anything DMA'd into them.

If we use "iommu=3Doff" on the kernel boot line, the problem goes away and
the data starts appearing.

Has anyone seen this behaviour on other devices?  Are we missing
something in the device setup, maybe?  As I mentioned, setting a
consistent DMA mask doesn't help, no matter whether we set it to 64-bits
or 32-bits.  Setting the regular DMA mask to 32-bits doesn't help
either: the problem still crops up.

Regards,
 Robert.

--=20
Robert Walsh
Amalgamated Durables, Inc.  -  "We don't make the things you buy."
Email: rjwalsh@durables.org

--=-cQ2G+7ML3GvEX4QHIEs8
Content-Type: application/pgp-signature; name=signature.asc
Content-Description: This is a digitally signed message part

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.3 (GNU/Linux)

iD8DBQBEd08WbZtqSALM5CYRAshNAJ9BTUO12N/vBI2/ss/6BkuGOS1oEwCg43rt
CZCYY5dmZFhuf6GIEdShHlg=
=NSBX
-----END PGP SIGNATURE-----

--=-cQ2G+7ML3GvEX4QHIEs8--

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/