Did you choose the fit to disk option? Also see http://www.gnutellaforums.com/tips-tricks/64458-making-dvd-video-using-nero-7-premium.html
There's options for custom settings, but unless you have some experience & knowledge of what setting will result in what size it's best to leave it up to Nero.