There's good mold, bad mold, and indifferent mold, and the key is knowing the difference.
For cheese, white cheese mold can be just washed off hard cheese -- it was probably introduced to the cheese culture originally and has been there all along, but "bloomed" when the cheese was exposed to air. Black mold is a bit more sketchy, because depending on which mold it is, it can be a carcinogen. I personally cut a large margin out around black mold but I have heard experts I respect advocate for chucking the entire affected cheese, if you're talking a pound sized store bought cheese.
I've fermented veggies for years -- and had an ex who would gag if he even saw the crock of sauerkraut on the counter. Sometimes, there was a layer of "indifferent" mold on the surface that I usually scooped off and chucked out to the chickens when checking on the progress of the kraut a few times a week. The mold wasn't really hurting anything in small amounts, but in large quantities it could affect the PH of the kraut and therefore allow bad bacteria to grow, so I remove it. He swore it smelled putrid and he thought he could smell it even when it was all sealed up. (The man also swore he hated elk meat, but happily consumed the "roast beef" at a neighborhood pot luck with complete oblivion ... LOL.)
Learning to make dairy products has been an education for me, however, because it breaks so many of the "food safety" rules that have always been ingrained in m. Leaving milk out on the counter at room temperature to become buttermilk somehow just feels wrong. And then when something goes the slightest bit wrong (as in, unexpected results), it takes a bit of psyching myself up to taste the results to find out if they're okay or not.
"Unexpected results" lately has been sour cream with the consistency and taste of cream cheese. I think the culture picked up a new bug ...This is not actually a problem once I figured out I'd accidentally made cream cheese, because I like cream cheese. Finding cream cheese in a jar when I was expecting sour cream, however, definitely gave me pause.
ETA: A neighbor of ours insists our farm fresh eggs taste "nasty." She's one of those people who are a bit ... nervous ... about food. Everyone else likes them, to the point that we're talking about putting up a fridge on our porch eventually for honor system egg sales. (The chickens have been on pasture since summer, so the egg yolks are neon orange rather than store-bought yellow.) Sometimes, you can only shake your head at people's perceptions and assumptions ...