The Sundown fable says: "Remove all daytime cards from your path and shuffle them back into the Forest Deck. If at least two cards are removed this way, +1 to any stat."
When you remove the cards, any gaps created are not filled by shifting cards down. The cards remain where they are, and you simply fill the gaps with new cards as you explore.