You can use your Windows Media Player for .ogg files-
Download - NimoCodecPack v5.0 build 7 - This will install many, many codecs for you to use with a large variety of media players. ( Be sure to say 'yes' to installing a short-cut in your Start Programs. )
http://nimo.everwicked.com/
You will find an excellent ripping tool in CDex v1.50 beta 4 or CDex v1.40.
http://cdex.n3.net/
FreeAmp v2.1.1 is available for Linux and Windows.
The only player that tries to come close to Winamp in sound.
http://www.freeamp.org
( And don't forget Monkey's Audio .ape format - Very good. Latest is Monkey's Audio v3.96 )
http://www.monkeysaudio.com 