Can I set an expiry time on an invitation?

Yes. If you don't want to be selected for a match at short notice you can have your invitations expire up to 2 days before the time. This is a choice you can make when you set the invite up.