If there is no exiled card (perhaps because the exiled permanent was a token or was a commander that was moved to the command zone in a Commander game), Ixalan's Binding won't stop players from casting spells.