Move south to blunt seasonal issues?

Hello all,
I have bipolar disorder (among other things) that seems to have a pronounced seasonal aspect. More depression in the winter. Several times now my various doctors/other providers have asked me if I ever thought about moving south (I have always lived in states bordering Canada).
I think they’re partly joking but they also seem kind of serious.
I guess my first question is, has anyone found that their bipolar illness got better or worse with a change in latitude?
My second question is, has anyone else had their docs suggest this? I’m feeling pretty annoyed. I already do so many things to try and manage this illness, and now you’re saying I need to move my entire life and family just “south”? It makes me feel like a failure. It also seems like a pretty big gamble - what if it doesn’t work? Maybe I won’t have a seasonal component but I’ll still have just as many episodes.
Thanks for letting me vent. It’s hard enough doing all the meds, therapy, lifestyle stuff, and then being told to move on top of it.