In doing relationship comparisons, the first step is to understand how each person approaches relationships. This can be seen by looking for Libra, Venus, and the 7th house (all are about relationships) in each chart. In your chart, you have Libra modifying Pluto (transformation, also control), which can indicate a "control or be controlled" attitude toward relationships. You have Pisces modifying Venus (Venus in sign of exaltation - very easy energy), indicating that relationship energy goes well with you. You also have Jupiter (expansion, also opportunity) trine (energy goes very easily with) Venus, indicating that you have opportunities for relationships. You have Neptune (spirituality, also idealization) focused in the 7th house, indicating you may idealize relationships...and then become disappointed when reality doesn't meet the "ideal" you expected.
Your friend has 3 energies in Libra, indicating he has relationships energy. He also has Libra modifying Uranus (friends, also rebellion) indicating he may like to be more "friends" in a relationship...close but not TOO close. He also may rebel against "traditional" relationships. Re-emphasizing this is Uranus sextile (energy goes easily with) Venus in his chart. He has Mars (being, also action, anger), indicating he may be active in relationships (and possibly become angry) with the person he is relating to.
The next thing to look at is the relationship chart (your chart is in the middle and his is on the outside). The first thing to look for in relationship charts is any connections between the Sun and Moon by themselves. There is a connection between you, although it is a challenging one.
The next thing to look for are the aspects made between Sun, Moon, Mercury, Venus, and Mars (also called "personal" planets). The most notable is that there are NO connections to your Venus, indicating you don't personally "relate" to him. Many of the connections are challenging, indicating a need to work out issues between you.
There ARE connections from him to your Venus if we look beyond the personal planets. Your Venus connects his Uranus, Neptune, and Pluto. This indicates you may get into a relationship impulsively (Uranus), may idealize the relationship (Neptune) and he may want to control you in the relationship (Pluto). This can be a VERY powerful combination, but you want to make sure you are working TOGETHER on handling this energy...otherwise it is simply his energy being imposed on you.
Your North node (future goals) conjuncts (energy is combined with) his South node (the past) and his North node conjuncts your South node. As you mention, this makes you both STRONGLY aware of each other's past. The challenge is that, as YOU move towards your future goals, your focus pulls him back into the past. And, as HE moves towards his future goals, his focus pulls you back into the past. This is a challenging interconnection of nodes to work out between you.
But, like ALL things in relationships, it CAN be worked out IF you BOTH decide to work on it. Relationships aren't "ideal" in themselves but can become MORE "ideal" if both people in the relationship are working toward building and growing the relationship.