Following the rivers was a good strategy in the idea that they wouldn't need to cross the river too many times. Crossing the rivers was hazardous, and many lives were lost if the waters weren't shallow.
Additionally, it was a source of drinking water, and a gathering place for animals they could hunt for food.
