I was initially feeling so much worse after tapering and then stopping prednisone that I was exercising less, and I believe that I became so weak at that point that I was actually injuring myself. That's when I went back to physical therapy. I didn't really improve until I realized that in my case I had to put up with a certain amount of pain during and after exercise to be able to rebuild my strength.
Good luck, I hope you can find a solution that works for you.