Mineral water, sure. Tap water, or just plain filtered water is anywhere from neutral to yuck.
Minerals make water 'alkaline', and give it 'flavor'. The cheapest, most readily available truly alkaline water in a bottle (in the U.S.) is Zephyrhills (it is as alkaline as Fiji, but cheaper). It doesn't just wash away electrolytes, it hydrates and replaces them.