Can I cancel an invitation to contacts that I sent?

Of course. Go to the profile of the User to whom the invitation was sent and select “Cancel sent invitation”.