It sounds to me like your taper was too fast. It took me more than a year to totally taper off prednisone. Perhaps try to seek a referral to a rheumatologist. I believe they know more about PMR than regular doctors do.
Best wishes for relief.