Water filters are sold JUST for this situation.

There is no point to filtering uncontaminated water -- you're not doing anything to improve it. So now that they have found a little contamination, it is now a valid time to filter it.

Filter it and drink it!