While there are two different potential origins for this phrase one seems more plausible than the other. It seems that holding someone's nose to the grindstone was originally a form of punishment. And it wasn't literal, it was a figure of speech to indicate someone had been strapped to a workbench so that they had to work continuously. ( source ) Today we use it in a figurative way to say someone is working hard and without breaks.