Coffee is 98% water, so the water you use changes the taste. Very hard water makes coffee flat and chalky; very soft water makes it sour and thin.
If your tap water is hard, try a simple jug filter or bottled water with a low mineral content. You will taste the difference straight away.