Although the time factor is fearful to everyone, fear personified is afraid of the Supreme Lord, who is therefore known as abhaya, fearless. Taking shelter of the Supreme Lord brings actual fearlessness, and therefore the demigods decided to take shelter of the Lord.