There are a couple of theories out there about the origin of this phrase but the most plausible seems to be the mood of a goat when 'picked' on - they get angry! ( source ) When someone/something has got your goat it means they have annoyed you.
"We realized that the important thing was not the film itself but that which the film provoked." Fernando Solanas