What i'd do is very quick way (strafing):
1) Read X-vector from camera matrix
2) Normalize, and multiply the vector by amount you want to move sideways
3) Translate camera by this vector to strafe

If you need to move it forward or backwards, read Z-vector instead. This will naturally work for movement like space ship also, totally free angles.

Any questions?