Normally I would recommend OpenAL because it has a really nice API and it's cross-platform. But i just took a closer look at SDL-mixer and i must say that I'm impressed. It seems to support WAV, MOD, MIDI, OGG and MP3 out of the box.

They're both good options, but If you're allready using SDL for graphics and input, I'd definitely pick the SDL-mixer.