I don't think it's accurate to conclude only if you are on long term ADT do you risk having CV events. That may or may not be true of blood glucose issues. The image here is from the reporting on the HERO trial which was the Phase 3 randomized clinical trial comparing relugolix (aka Orgovix) to lupron. It shows % of each arm that experienced a MACE event (Major Adverse Cardiac Events) as a function of time under treatment - 0-48 weeks.

What you see is that MACE events occur at a more or less constant rate (the graphs approximate straight lines). That rate does not increase with time. The graph increases with time because it is counting cumulative events. To me that says at any arbitrary point in time under treatment with either medication, there is a constant probability of a MACE occurring. It stands to reason, though I don't think it is proven in this trial, that those experiencing MACE events early would be those patients with the most advanced CV issues going into treatment. Link to the HERO trial:
https://www.nejm.org/doi/full/10.1056/NEJMoa2004325
Figure 2, Cumulative incidence of MACE: