Cannot agree more emphatically with what jeffmarc has advised. Nowhere in your posts do you mention any kind of surgical consultation - you only question if it can be done afterwards.
You need to have all that info Jeff mentioned and THEN you have to sit down with a highly experienced surgeon and get the pros and cons.
I would also recommend a radiation consult from a DIFFERENT RO. The 3 week span seems odd- unless it is high intensity brachytherapy (seeds) followed by 5 sessions of SBRT; that could take a total of three weeks when weekends are factored in.
In any case, do NOT rush into anything….educate yourself, ask questions, come to this forum as well, and only then can your decision be made. Do not let any one DR. Tell you what to do, since most of the time they will steer you in the direction of their own specialty.