I'm so glad I can answer this question
My family is used to store bought cow's milk. We have been into dairy goats for less than a year. I can honestly tell you there is no recognizable difference in fresh goat's milk than there is in store bought whole cow's milk (there are a bunch of unrecocognizable health benefits though). Mind you, our goat is a pain in the neck to milk, and there are other problems such as diet and cleanliness, but the taste is basically the same.