Result!
The replacement voltage regulator has fixed it. Nice solid 14.1V at the battery, idling. Yay!