I have had problems with shortness of breath for many years, sometimes really bad, other times almost unnoticeable.
No, I can't say it ever freaks me out, but I was a runner and used to getting out of breath when pushing hard. So I guess I always knew that I would eventually catch my breath. It mainly makes me angry when it is bad and I can't do what I want, like chase grandkids or climb a lot of steps.
Sue