How should I handle this situation?

I think that she is really into you but feels guilty about it. Maybe you should confront her with it, who knows it could make for an interesting encounter (wink wink)