While defending a woman and her honor back in the day the knight would tie her colors on his arm as a show of his loyalty to her. It was a way to express emotions for her visibly.  ( source ) Shakespeare also gets some credit for the expression (not a big surprise is it?) in the play  Othello . ( source ) Today the phrase is used in a figurative way to communicate that emotions are visible and not hidden.