No, you shouldn't because right is right and wrong is wrong, but many people just do partial Kegels for sexual endurance (not orgasming as fast). But for ED in general, I would say both need to be equal as there are two primary pelvic floor muscles, four in total and they are connected to all your core muscles. On men they are the most underworked muscles, typically.

I'm not a doctor, consult a pelvic floor therapist for definitive answers, but I hammered my floor repeatedly and properly and came out unscathed. I had nerve sparing surgery, and I was on tadalafil 5mg for a month ahead of time and even took L-Citriline supplements on the advice of the penile therapist (another urologist) because "it might help but absolutely won't hurt".