Personally... I would leave the shirt alone for the reasons you already gave, but I would see what it would look like to darken the bow on the collar (it is a detail that seems a little lost).