The top drawer is where Victorian gentry kept their most valuable items - jewelry, best clothes etc. So it became a phrase to indicate if someone was upper class or not. ( source ) It's still used today to refer to someone of high class/society.