My practical experience with 2.2.20pre7aa1:
3 machines _without_ swap space (disabled),
2 UP's with 512 MiB memory,
one dual SMP with 1024 MiB memory,
no problems since months and 20pre#aa#.
Latency is minor than _with_ swap!
Mario
PS Not in lkml, so cc if needed.