I also have a garden assistant doing most of the digging, dividing and heavy lifting now. And every bed is auto-watered, either with the irrigation system or individual, timer-operated drip systems, so I am not getting aerosols from that. I must admit that I do not mask anymore - I water before I dig to minimize dust and spores in the air. I still wear gloves and garden shoes (which never enter the house.) And if I mow, I do mask as there is no way to avoid all the flying debris. Garden clothes go right to the laundry room each day, even though it can make a lot of laundry.
We are a "no shoes" household which really keeps outdoor pollution out - all are left in the garage or at the door, and the landing is frequently mopped & washed. Entry rugs are washed and dried at least every week.