Closing the Options window is equivalent to cancelling your changes. To make your changes permanent, you should press either the "OK" or the "Apply" button.

If this does not work, please report back with more information regarding your operating system and system configuration.