When attacking near the waters edge I noticed the attack goes one sector into the water. Is it ok to end an attack in the water?

This is to allow your land units to attack a water unit at the square. You unit won't stay on the water (unless theirs a bridge on it). You unit will end up on the last land space if touched before "attacking" the water square.