If a home I’m buying has mold, should I just walk away?

Not necessarily. Get bids for repair and removal.

If the numbers still work after you’ve added them up, it could still be a sound investment.