they went

Genesis 12:10
Now there was a famine in the land. So Abram went down to Egypt to live there for a while because the famine was severe.

Genesis 20:1
Now Abraham journeyed from there to the region of the Negev and settled between Kadesh and Shur. While he was staying in Gerar,

Genesis 46:3, 6
"I am God, " He said, "the God of your father. Do not be afraid to go down to Egypt, for I will make you into a great nation there. . . .