Long term saw palmetto use with severe withdrawal effects when stopped

Been using saw palmetto for 3.5 or so years, no side effects while on it which in retrospect is great because only after all this time did I read all the potential effects of it which I missed in my prior reserch, so after seeing this I decided to stop it cold turkey as I dident want it anymore even though it actually improved my libido and quality better while on it.

So after stopping I was fine for two week no difference, then all of a sudden, just after the two week mark I crash, shaking, bad ED like not up at all, and I think I was experiencing very high cortisol and adrenaline really severe extreme low mood (lowest I ever felt in my life) as a withdrawal effects to the changes. I went back on 1 tab a day (half dose) to help ease the symptoms and after a week or so was back to “normal”. Then I dropped to one tab every other day and after another 2 weeks or so again (2 weeks seems to be a pattern) I crash and drop again Shaking, same ED again, high adrenaline and cortisol feeling again.

Basically im considering is this just a temporary side effect coming off it and will things return to normal. I hope so. Currently on my second / 3rd week of 1 tab every other day and gonna change this after another 2 weeks or so to give my body a break from the insane side effect of coming off it it.

another part of my thinks should I just stay on 1 a day and enjoy normal feeling again with no issue and hope it stays that way indefinitely or do I persist and wait and hope things return to normal and the ED might only be caused by the withdrawal effects not side effects of the suppliment itself