You must remove all +1/+1 counters from Sage of Hours to activate its ability, even if the number of counters isn't a multiple of five. For example, if you remove twelve counters to activate the ability, you'll take two extra turns. If you remove three counters, you won't take any extra turns.