I think he's not aggressive, I feel you (in this chart) are more the aggressor here and here's why:
-Mercury is in Taurus in your 2nd house, so I wonder if this indicates a higher priority on sex than with him. It's about to move into Gemini, so perhaps you will talk about it soon enough. Moon applying to Mercury and all.
-Mars in Scorpio in its own 8th house, and you being an Aries. Moon sextile Mars (which actually means sex is still possible)
-Moon in the 7th house
-He's Cancer and Virgo, feminine and mutable signs which with a hetero horary you'd want to see Leo, Aries, Capricorn, Aquarius, etc. in the 7th house. Sturdy signs.
As have been mentioned in other horary charts, Venus is weak and combust from the Sun, combining that with the planetary elements maybe he feels more of an emotional / intellectual attraction to you, but nothing physical? I mean I would think someone knows that prior to going on 1 date but its just at theory. ETA: You said he was in a funk. It shows! He's gone into his shell to think (Virgo + Cancer and Moon in 7th house). If the 5th house is represented by Moon, then do we use Venus for her co-sig?