Josh, see whether this is any help. There's a utlilty that you can use if you're having problems removing Java: How do I uninstall Java on my Windows machine? - 1.5.0, 6.0

Someone else had the same problem as you & it seemed to help them out. The thread's pretty old, but hopefully the advice is still good
Java Runtime Environment (JRE) - Unable to Uninstall JRE 5.0 update 4 - Already have this version installed

Ya I was looking at that before. All it really says is go to Add or remove programs and uninstall it. When I do that it says fatal error during installation. I think my only way of solving this will be to find someone that had the same problem as me.

Did you try using the MS Windows Installer Cleanup Utility?