Add /usr/java/bin or where ever Sun put the java executable to your path by adding the following lines to your ~/.profile file:

JAVA_HOME=<path to your java installation, e.g "/usr/java/">
export JAVA_HOME
PATH=$PATH:<path to the directory where Sun's java executable is located e.g. "/usr/java/bin">
export PATH