Flush the System You should also remove any filters you have on your water system before cleaning it. This is a good time to replace them as well.