Have you tried what is suggested in this thread? I have struggled with the same symptoms as you describe until I changed the swappiness setting to 0.