I was not clearing the zbuffer properly... Hence, the scene was rendered using the zbuffer of the first frame over and over, which is why the scene appeared perfect from some angles, and somewhat ok from others, but never completely chaotic as we could have expected if zbuffer was not working at all.

Rookie's mistake. ops:

Thanks for your time.