Good news: You're not the first to have the panic. It is true that nowadays, females can and do pursue the ones they are interested in getting to know better and perhaps mate with.
But for much of the times past, one survival skill of the male was - did he have the courage to pursue his heart's and/or body's desires?
I had said no more, figuring that this was one call you had to make yourself. If you could walk away unannounced, then perhaps you really did not love her.
But if you feel you must take the chance, there might well be something to it. As to how, think creatively.
And of what events will happen next, they may not follow the straight line that you can even envision. Most romances have surprises. They will provide a good story for your grandchildren (or good training for whomever wins out to be your life mate), or at the very least, you can always know that you gave your love a chance.
