It's most common after you bring your caravan out of winter storage as bacteria will breed in the water system and pipes. Bacteria and algae will build up inside any water container that isn't plumbed in, which can lead to a stale taste and unpleasant odours.
eBay