If a "vacation" isn't possible, there are ways to live with the ADT side-effects:
Bone fragility: take calcium supplements and do light resistance training (weights, therabands, etc) to slow or reverse bone-mass loss.
Sexual relations: my doctors have told me that it's OK to use ED meds or a vacuum pump (I haven't tried yet, due to other mobility issues from my spinal compression).
Hot flushes: dress in layers, so that you can peel off the outer layers when you feel one coming on.
Gynecomastia: wear loose shirts, or heck, if you feel confident, just wear tight shirts and own it. We can learn from the younger generation about not getting caught up in stereotypes about what a man is supposed to look like. If you identify as a man and you have enlarged breasts, then you're a man with enlarged breasts, period. (Ditto for loss of body hair; I used to be a hairy guy, and now, while I still need to shave, I have the body hair of a 12-year-old. So be it.)
Weight gain: I haven't quite figured this one out yet. I am managing to hold it steady with exercises and moderate portions (not restriction) in eating, but after months of barely being able to eat post-surgery due to an prolonged ileus and other complications, I'm not willing to go on appetite-suppressants or harsh diets now that I have the precious gift of a good appetite again.
Be careful with 'calcium' supplements. I took them for a long time and got calcified aortic valve probably thusly. Your points are good .. a 'vacation' is possible; concerned about what duration of a restart.. I guess until PSA is again knocked down... rinse & repeat?