If you pay someone for advice and they caution you against hiring a capable and attractive person of the opposite sex so that you may protect yourself and resist temptation, fire them.
If you take their advice or have hesitated to hire qualified people you thought were attractive because it would be too big of a risk, resign from any leadership role immediately. You have failed at basic professionalism, self-control, and discipline.
You likely lack empathy, situational awareness, and have a wavering moral character. I will go on a limb and guess you are probably also a jackass to work with, but maybe no one has told you yet.
Reassess your behaviors, values, and beliefs if you want to avoid career derailment. Fail to correct your ways, and you may find cover amongst other lousy leaders, but you will not prevail. Effective leaders do not provide refuge to poor leaders for long. It’s time to manage better and lead well.