You shouldn't need to delete old versions. I believe when you update it overwrites the old version with the new.

If you'd like to check you can see what's in your RsiBB folder by going into your Start menu and selecting Windows Explorer. Your RsiBB folder should be listed under your C: drive. Just click on it and the contents of the folder will appear in the window to the right.