The Rappahannock River, which starts somewhere in the Appalachian Mountains of western Virginia flows through Fredericksburg, all the way into the Chesapeake Bay.