Some people get that but it is not real common, especially after stopping the drug. Is it possible your anxiety is really just related to the fact that you have prostate cancer? That alone makes a lot of people, anxious and depressed. I’ve heard of many people being on different drugs for their anxiety or depression due to having prostate cancer. Check with your PCP, maybe they can help prescribe something to reduce that anxiety.

I must admit I had anxiety when I was first told I had prostate cancer, I wondered how long I would live, did I have five years left. 15 years later I don’t even think about that, time heals!