The diversity-validity dilemma is defined as the observation that the most valid performance predictors also generate subgroup differences, thereby disadvantaging minority groups. This study investigates the effect of response fidelity on subgroup differences and validity using multimediatests whil respecting the construct-method distinction. The influence of two response modalities on validity, subgroup differences and test perceptions/motivations is being examined.