Goat or horse?

Good choice. Personally I like horses, just sold 2 of them. I used them for trail riding. Now I use 4-wheelers. Owning a horse is expensive with the saddles, tack, maintenance, feeding. I do miss them, but all in all. I made a good choice. So did you. The goat will return to you many times the keep of a horse.

__________________
http://joesneetstuff.blogspot.com/p/must-see-offers.html

A real horse addict will never be satisfied with life without having one around, even if it's just to hang out with. But they can be an expensive hobby. Only occasionally does anyone have time or work to make them pay for their own keep, and that's most often either working cows or working land with heavy horses/mules.
I have "wasted" an awfully huge amount of time and work to keep several fed. But I'm one of those addicts who don't regret it.
I've also spent plenty of time with goats, got pretty strong hands from milking them when I was between about 13 and 20 years old. But after having horses for some time I find I like them a whole lot better. The horse has a generally cooperative nature, all I gotta do is figure out how to communicate (an art in itself, took me years to get it right) and they respond. Basically goats are more practical and horses a lot more fun if you love em and get acquainted.

The way I looked at this question was not which was more practical, but, do I get something that's practical, or something to indulge a dream. It would be kind of like the OP asking, should I get a Mini Cooper or a Ford Mustang?

Wait, mini cooper or mustang?? Is that not both indulgent purchases?? How about a Camaro or a Pickup truck?

But, back on subject, if you really want a horse, there are ways to make them pay, but it may take more effort and probably more experience than a novice would have.

I'm a horse person myself, but have always wanted a goat! Unfortunately, the truth is that once you get a horse and bring it home, all of the work will get in the way. Right now you have to make an appointment to go ride. Once your trying to ride at home it is too easy for other things to become more important and you will find yourself putting off that ride again and again. I say for now, continue to take lessons and consider that time your gift to yourself. That way you can still make sure that you actually get your horse fix! Also, horses can take over your life! They are definitely addicting!

You made a wise choice!

I've had pony/horse/horses and mules, in that order for 55 of my 60 years. I can't explain why I still have 3 horses and 2 mules now other than some of them have been here for 25+ years and I will let them die here. In all those years I've never paid "$100s/month to keep them. Mine have always eaten well, even better now that some of them are geriatrics and need the extra food. They see the vet as needed and the farrier visits regularly. I have a stock trailer but have never needed a fancy horse trailer. We never got into showing horses (just goats) so never had that expense.
That being said, they are expensive for what you get back. Even so, I think I'd always have an equine in the pasture even if I didn't ride.
I think you did right picking the goat/goats, but I wouldn't necessarily rule out a horse if you really want one, although I highly recommend a mules over horse!
Life is too short to keep wishing for something you really want!