I have a Nubian doe, currently in milk. A Nigerian doe currently in milk, and two mini-Nubian does due in December.
My Nigerian is bossy. I use a hand-milker with her because she does have small teats that I can't get my fingers around. Also, when she decides she is not hungry anymore, she is a pain on the milk stand. As long as she is eating, she is still. When she stops eating, she is dancing.
My Nubian doesn't even get stocks on the milk stand. She doesn't like them and she doesn't need them, as she will finish her grain and just stand there, nuzzling my hair, until I have finished milking her. She is an absolute EASY girl.
One of my mini-Nubians will stand for ANYTHING as long as she is being talked to, while the other one is a bit jittery and skittish. It would figure that the one that stands easy has the smaller teats (a bit more difficult to milk) while the more skittish one has the larger, easy teats, huh?
That just goes to show you, though, that size CAN matter, but temperament matters MUCH more. When you go to look at goats to buy, see how easy they are to handle. Also, you might want to start out with an older goat that is trained and bred rather than a doeling that you don't know how she will be on the milk stand.
In my herd, my littlest doe is the easiest to manhandle, as she is TINY, but that doesn't necessarily make her the easiest to milk. My largest girl, who if she had a mind to could EASILY cause havoc, is the easiest to handle, the easiest on the stand, and the easiest to milk.
Oh, and the taste of the milk is a personal thing.

My daughter doesn't like Nigerian milk, at all, BUT...in the store-bought kinds she prefers skim milk. Nigerian is FAR too thick and rich for her. (She likes it fine enough if it has gone through a cream separator first) I think the Nigerian milk is sweeter, but DH thinks the Nubian milk is sweeter. It's a good idea, even if it tends to be a bit more expensive, to get a doe that is IN milk, try her milk yourself to make sure you like it, and buy does that have milk that tastes good *to you*.
And that is not necessarily a breed thing...it is often an individual goat thing.
Oh, my Nubian girl is a lovely chestnut brown, my Nigerian is black with a white muzzle, one of my mini girls is buckskin, complete with lined back and mascara eyes, the other one is black and white splotched, like a Holstein cow. Then, my buck is tan with a couple of white spots, and my wether is tri-colored. It is certainly a colorful herd!