I've heard about the green hat thing before, but then the explanation was that green hats used to be a uniform for male prostitutes, and that you were basically calling someone a whore. Might have been wrong, though.