The potential for a mutual attraction is always present when there is an aspect that shows physical attraction. However, the ascendent positions could modify this, basically how do you present yourself and react to the other, also at what point in their development is the other person? For example, you could be attracted to a religious person, but his energy is channeled in spiritual ways, or maybe he is involved and committed to another person, or for example just having lost a dear one and is emotionally closed while grieving, or someone who is emotionally immature and is just looking for a physical contact which turns you off.
Your instincts are your best arm here. You can't just rely on natal and transit aspects.
Once you are in a relationship, the aspects can be helpful to shed light on how your energies mesh potentially, but you already have a base to evaluate.
A friend of mine years ago met a man whose chart matched in such a negative way with hers that I was actually quite alarmed. Well, they've been married over 20 years and very happily so! This served me as a warning to not just look at numbers.
You ask what orb. Which planets, what type of aspect... a conjunction or a semi-sextile. How are they related to the whole picture?
You really have to develop your insights and also trust your instinct.