The violet flower is known as a reclusive and understated flower, that is modest in nature because it grows close to the ground, is quite dainty and its flowers are sometimes hidden in its leaves and by nearby shrubs. The figurative use is derived from the literal - it means a shy or modest person.