If you draft multiple Cogwork Grinders, the value for X will be the same for each of them. It doesn't matter that some of the removed cards may have been removed before you drafted the second Cogwork Grinder, for example.