The line of nerve tissue which runs down the dorsal side (the top side; the back side in humans) of all vertebrate animals, from the brain to the tail, usually through a string of skeletal material called vertebrae.