You mentioned the great point here - "I meant to say that I didn't think we'd click and hence I backed out immediately."
Just make sure, you click . This was very important for me. In my words, I used to say to my family - 'kti yesto usto jandina me, teyo ghanti chahi bajnue parcha.'  ani viha garchu.
Don't worry, the day you click, you will know it. It it happen in its own natural way.