You would only slow rendering down by keeping your own buffer. But probably not much. It depends on what you likes to work with best, probably