Who Determined Black People Resemble Monkeys?

Nevertheless, it got me thinking: where did the black person/monkey/ape stereotype come from? I've seen and heard plenty of white people get called "mayo monkeys". George W. Bush was portrayed as a monkey by the media, including in the animated series Family Guy. So why does the stereotype stick to black people?