The words are ambiguous and overlap with a lot of sexist and even racist (calling all Black men "boy") behaviors, so it is unclear sometimes if a particular usage is sexist