can you break up your room in parts? E.g. make the floor a part and each wall a part. That way each part gets its own bounding box making things a lot simpler.

You bounding box around the complete world is a starter to go looking for collisions with bounding boxes inside it. So you go deeper and deeper inside the structure of your world model.