With your low PSA doing anything immediately seems too aggressive. Doctors are trying to delay people starting hormone therapy because of its major effects on their life, The NIH did a study about this and recommends holding off, I actually posted a new discussion with a video from the NIH, I put that link down below. It does refer to people who had treatment, but it applies as much to somebody that hasn’t.

If your doctors really concerned, get a PSE test. It will tell whether or not there is cancer in your system and is 94% accurate. If it says there is cancer, then you want to get a biopsy.
https://connect.mayoclinic.org/discussion/are-castration-sensitive-pc-patients-being-over-treated/