Weaning off Pristiq

Hi everyone! I have been taking prestiq 50mg for 4 months. I want to wean off it because it really has not done anything for me. My Dr put me on 100mg and that still didn’t help so I went back down to 50mg. Do I still have to taper off the same as someone that’s been taking it for years? I also take bupropion 150mg once a day (I’m ok with continuing Bupropion).