If you have an All In One water cooler, sometimes called a Closed-Loop Liquid Cooler, the idea is that you shouldn't have to do any maintenance on it. Many of them are sealed, and can't be refilled. ... You should never use normal tap water in your water cooler!Nov 5, 2016