The ongoing untreated inflammation of PMR can cause its own problems with tissue and organ damage. Balance the inflammation damage you're likely causing your body by not getting treatment against the side effects of treatment drugs. I struggled with the same dilemma for two months before realising it wasn't going away by itself, and deciding I couldn't go on with the pain and loss of ability to do basic everyday things any more. I later found out about the harms of ongoing inflammation. Not being treated has its own health problems.