Excatly, most of the water "used" is for cooling which is why most of the traditional nuclear plants are parked next to a major water source (river or ocean). They simply suck in the cooler water and discharge warmer water. The water used in the boilers and turbines is normally a closed loop system and only requires topping up due to leaks and other losses.

