Because you are a few years out it gets harder and harder to get in to an oncologist. That being said, a surgeon friend said most breast cancer referrals come by way of OB/GYN so if it were me, I would start there.
This also gives you the option of asking for a different oncologist, should you need one.
Do you live near a cancer center or teaching university where there might be multiple onco doctors to choose from?