Have you ever heard of B+Trees? Maybe you can use them to prepare an index for your file system, as I'm guessing you're writing one.