If I am writing fantasy do I have to be historically accurate if I am borrowing from real life events?

I know what you mean though! It may be fantasy but you also have to make sure your reader won't go "huh?" at your creation just bec they totally can't get into your idea. Apply a few realistic touches, that'll at least make them see how you want them to see it.