New to this group and in total panic!

I will start out by saying I am 58 years old, in great health. I have been seeing my GP every 6 months for hypertension for the last 5 years or so. Shortly after starting meds for HBP, things down south started slowly fading away (ED) and I attributed this to the BP meds and age. My PSA 5 years ago was around 2, and last year it was 3. GP mentioned the bump up from 2-3, but wasn't concerned due to the 5 year gap in testing. This week I went in for my 6 month checkup, and they didn't do a PSA test. I mentioned that 6 months ago you noticed it went up, and wasn't concerned, but I would like to know since my father was diagnosed with PC at age 77.
Did another blood draw and PSA came back at 4.3 and free PSA came back at 16.5. Dr said she was pretty sure I am fine as the majority of higher levels are enlarged prostate, but referred me to a urologist for further testing.
Needless to say I am totally freaked out by this, and have been getting very depressed waiting a week to see the urologist. Like anybody else, I have been scouring the internet and though my numbers are just on the edge of normal, I am seeing signs like the ED pointing in the wrong direction. I needed to vent to someone today as I have nobody other than my wife to talk to, and she is getting tired of me worrying to the point of depression,
Are my numbers concerning? I feel like I have just been told my life is over