The second thing you should probably do is use hinting mechanisms like posix_fadvise() to help the kernel do the right thing.