I am on a slower taper plan, and am currently tapering 1 mg every 30 days. When I got down to 8 mg last month it took me much longer to adjust to the new dose, especially since I try to do a little too much the second I feel better. However I felt better by the end of the month. I am stiff and sore 6 days into my taper to 7mg, but usually feel okay enough by the end of the day, especially after I've walked and moved around enough. Knowing that I have 30 days to adjust, and knowing that it's worked so far gives me confidence and helps me get through a few uncomfortable days or weeks. I'm certainly not thrilled about taking so long to get off prednisone, but I don't think trying to rush it would work in my case.
So my take on what you are going through, as others have said, is that you probably should try a slower taper.
I've been using acupuncture to help with side effects. I believe it's made a difference.