Is the modern American imagery of a clown a racist parody of Irish or Scottish people?

Given, American clowns are derived from the French clowns (which are derived from jesters). What I'm asking is whether the image of what we normally think of as a clown based on a turn of the 19th century parody of poor Irish or Scottish immigrants. Is it pretty much the same thing as a white version of blackface? The stereotypes of Irish immigrants were very similar: ignorant, too poor to afford new clothes (tartan and plaid patched instead), pale skin, red nose and cheeks from being constantly drunk, and very pugnacious. Except for the propensity for violence, it seems to fit. Am I reading too much into it?