Which specialist is best-Rheumatologist, Endocrinology, or Physiology?

I am beginning this Osteoporosis journey. 2 yrs ago the Rheumatologist had some labwork done and a couple x-rays and said that Evenity would be the only choice for me in order to build bone mass. However I noticed it has a "black box" warning. I left her office stating I did not want to take any meds. In the last couple yrs my PCP ran a Vit-D which was low. I have been on prescription Vit D and my numbers are a fraction better except for my spine which has an old compression fraction from a fall at L1 and advanced degenerative disc disease.
Frankly, I am overwhelmed. I eat ok and do get out to walk, but I am thinking of seeing an Endocrinologist this time and a Physiologist who would prescribe an exercise regimen for me.
I don't want to take meds but I guess hormones (if needed) might be okay? Looking for anyone's feedback. THANK YOU
Also I read and research a lot which only confuses me more BUT I READ THAT THE AVERAGE WOMAN WITH NORMAL BONE DENSITY LOSES ABOUT 13% OF HER BONE DENSITY IN 10 YEARS OR ABOUT 1.3% A YEAR.... SO AREN'T WE FIGHTING AN UPHILL BATTLE??
LADYDI22