"The Man" is a slang phrase that may refer to the government or to some other authority in a position of power. In addition to this derogatory connotation, it may also serve as a term of respect and praise.