Wow, it's really hard to wait. Since your symptoms seem to be progressing, maybe ask to be seen sooner.
As for exercising, I usually take 2-3 short (10 min) walks when I don't feel my best instead of one longer walk. It seems to be less of a problem.
Also, do you have a pulse oximeter to monitor what is going on when you exercise? It might help to know what your blood oxygen levels are - and see if there is a downward trend that might indicate a worsening infection.
Sue