"Life isn't fair" true/false?

So us parents love to use the phrase "life isn't fair". We teach our children that fairness and equality is important, right? Then when our kids complain about something being unfair we say life isn't fair. What would have happened if black people just settled in the early 1900s because "life isn't fair"? Do we only use this phrase to our benefit when we can't make something fair?