A gorge is a narrow valley with rocky walls. Over thousands of years, erosion causes waterfalls to move upstream, leaving a steep-sided gorge behind. The water in river rapids is very fast moving.