Although my girls can go out into the woods I would not pen them away from eyesite with beagles, and whatever else lives in the woods
Cattle panels are right behind the doe picture you put up.
Start with a hoop house, someone just put up photos of theirs, search on here or at dairygoatinfo.com we should be back up tommorrow after our upgrade. They are simply made of wireing two or three cattle panels together, attaching a tarp to the outside and then hooping it up into the air. Make sure you secure the sides well with T posts that you just pound into the ground, and make it as tall as you are so you don't have to stoop to go inside. Wireing the hoop to the T posts well will keep the sides flat so the goats can not jump up and get ontop of your house. Then just get a few more cattle panels as you can afford them and use them as fencing, making the area larger as you can afford to. Don't pound your T posts in very far this way they are easy to take up, pound them in all the way once you have a corner established that won't be moved.
It was at least 5 years of goating before I could afford anything other than the perimeter barbed wire we did on our acreage. Everyday I would take my goats out into the woods for walks and they could eat, then back into their safe home.
I did put a back onto my hoop house so I could attach a hay feeder in there and so there was no blowing rain. Simple bedding of spent hay or shavings or straw will make it snug for the winter. Have your opening to their house not facing north...here we also get all our blowing rain from the west, so for here and east or south facing door opening would be best. Remember if you get wet on your knees kneeling in the barn add more bedding. If you can take your coat off during the winter than it's to warm. If condensation forms on anything, there is not enough air flow. IF you can smell amonia put down something like Sweet PDZ or clean out the bedding and start over.
Read read and read about purchasing goats, but the cross of anything with LaMancha is a very sturdy breed to start with and she is very very nice. Vicki