If Bane Alley Broker leaves the battlefield, the cards exiled with it will be exiled indefinitely. If it later returns to the battlefield, it will be a new object with no connection to the cards exiled with it in its previous existence. You won’t be able to use the “new” Bane Alley Broker to return cards exiled with the “old” one.