Astrologian's Planisphere doesn't need to have been attached to a creature you control when the first or second card is drawn for the granted ability to trigger. As long as a creature you control has the granted ability when you draw your third card in a turn, that ability will trigger.