Estrogenic foods

Due to endometriosis, I am trying to avoid foods that are high in estrogen, as in flaxseed.
Since my dr. told me to go on a low fiber diet, because she thinks the foods that I am reacting to (which happen to be high in estrogen) is due to them being high in fiber. She doesn't think natural estrogen can feed endometriosis. So are high estrogenic foods going to be high in fiber too?