@cepheid815 - Good morning and welcome to Mayo Clinic Connect. You are not alone in this situation. Sometimes it's very difficult to breathe with one on, especially for me, if it's humid. Have you heard about masks that exercisers use to make breathing easier? Have you tried any of these?
https://www.womenshealthmag.com/fitness/g35246161/best-breathable-masks-to-workout-in/
https://www.nbcnews.com/shopping/fitness/best-face-masks-exercise-working-out-n1233704
And you can google more if you are interested. We have a ton of masks and some work better than others for different weather conditions. I love silk masks and have just purchased a couple. I usually don't mind masks for short periods of time but as soon as I get outside I rip them off, or wait until I get in my car.

I have lung cancer and COPD so humidity is a real bummer for me and being outdoors. Do you feel left out of so many things like I do because of it?