Avaliação da equidade dos cadernos de matemática do ENEM 2017

Abstract

Enem is currently the most popular large-scale exam in the country because it is the main gateway to public universities in Brazil. In large-scale evaluations, parallel notebooks are used in order to avoid fraud in the evaluation process. In Enem there are four types of notebooks (PINK, BLUE, GRAY and YELLOW), these notebooks must promote equity of difficulties so that candidates who receive notebooks of different colors are not harmed or benefited in the evaluation. The specialists in educational evaluation use the data provided by Enem to evaluate teaching systems, flaws or advances in the evaluation process and flaws in the construction of the notebooks. There are several ways to evaluate a teaching system or evaluation method and none is completely correct, several points of view can be constructed but few take into account the educational conditions offered to the student. In a country with continental dimensions, different educational conditions, different climates, different cultures and with different socioeconomic conditions, it is very difficult to construct assessments with equity of difficulty in all the parallel books used by the exam, this is due to the fact that it is practically impossible to consider all the factors that cause bias in the candidates' proficiency. This work used the Enem Microdata 2017 file with an emphasis on Mathematics notebooks to verify the equity of the evaluation process. An argument was made based on descriptive statistics, ANOVA, Fischer DMS, differential item functioning (DIF), proportion of correct answers and pedagogical analysis of items. It was found that a greater number of correct answers in the notebook does not determine greater proficiency, that some items have their difficulty altered due to their position in the notebook, that the notebooks that present equity are YELLOW and GRAY, on the other hand those that present greater differences are PINK and YELLOW, therefore the difficulty equity does not exist among all the notebooks, contrary to what Inep affirms.