Unlike Videotapes and DVDs it is illegal under US law to rent recorded music. I can't remeber the exact law to cite, but it was passed in the 70's best I can remember.

Try your library - the won't have all the titles you want, but they may have some and it's free.