The hormone therapy may not be so bad, some people have trouble others don’t. Understanding your future risk will help you with a decision. The pathology report after surgery and the oncologist will give you much more info.
I’m on 5 mg tamoxifen with very little issues. In fact, I am benefiting from how it is acting as an estrogen agonist in non-breast areas. It has reversed my vaginal atrophy and improved my skin. But I did have problems with 20 mg. And, I chose to not take an AI because of the issues it can cause.

With these therapies you can try one and stop if needed. The oncologists often will suggest switching to another drug of the same type, change manufacturers, or switch to another therapy.