If the defending player doesn't have more cards in hand than you immediately after Robber of the Rich attacks, its ability doesn't trigger at all. If that player doesn't have more cards in hand as the ability resolves, the ability does nothing. It doesn't matter if that player has fewer or the same number of cards in hand in between these two times, or if they have fewer or the same number of cards in hand later.