As Alice Leiper explains, the best way to build diversity into your fantasy setting is, well, to world-build it.
By considering diversity from the outset, you can create a world in which diversity is natural and normal without it feeling “unrealistic”, by developing geographies and cultures organically rather than defaulting to pseudo-medieval European.