Hundreds of thousands of predominantly black and Asian service personnel who died fighting for the British Empire have not been formally commemorated in the same way as their Caucasian comrades because of decisions underpinned by “pervasive racism”, an investigation has concluded.