Psikhologicheskie Issledovaniya • ISSN 2075-7999
peer-reviewed • open access journal
      

 

2020 Vol. 13 Issue 69

Tyumeneva Y.A., Uglanova I.L., Solopov R.V., Obukhov A.S. The development of a deductive reasoning test: the construct structure and factors affecting the test item difficulty.

Full text in Russian: Тюменева Ю.А., Угланова И.Л., Солопов Р.В., Обухов А.С. Разработка и валидизация теста дедуктивного мышления

National Research University Higher School of Economics, Moscow, Russia

About author
Suggested citation

In tIn this study we discuss theoretical construct of deductive reasoning and propose test aimed at its evaluation. The theory of mental models and belief bias effect in logical reasoning were taken as conceptual framework.
In the first study the two-factor structure of the deductive reasoning construct was revealed. The two factors underlying the construct were the sequential reasoning and the analysis of alternatives. In the second study we cross-validated the two-factor structure and investigated the effect of mental models and belief bias on performance. 
We concluded that two scales of the deductive reasoning test can be used for measuring two independent skills of deductive reasoning – the sequential reasoning and the analysis of alternatives. Each scale showed good psychometric characteristics and clear structure. Validity of the test was supported by the concordance between the item difficulty from one hand and the number of mental models involved and item believability from another. Directions for further investigation are discussed. 

Keywords: deductive reasoning structure, conditionals and syllogisms, validity

 Full text in Russian

References

American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association. 2014.

Bonatti L. Propositional Reasoning by Model?. Psychological Review. 1994, 101(4), 725–733. https://doi.org/10.1037/0033-295X.101.4.725

Brown T. A. Confirmatory Factor Analysis for Applied Research. NY: Guilford, 2006.

Brisson J., de Chantal P., Forgues H., Markovits H. Belief bias is stronger when reasoning is more difficult. Thinking and Reasoning. 2014, 20(3), 385–403. https://doi.org/10.1080/13546783.2013.875942

Brown T. A. Confirmatory Factor Analysis for Applied Research. NY: Guilford, 2006.

Dawson G.L. The law school admission test battery: A different selection concept for the 1980s and beyond. Journal of Legal Education, 1984, 34(3), 388–406.

DiStefano C., Motl R.W. Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling. 2006, 13(3), 440–464. https://doi.org/10.1207/s15328007sem1303_6

Evans J.S.B.T. Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition. Annual Review of Psychology. 2008, 59(1), 255–278.https://doi.org/10.1146/annurev.psych.59.103006.093629

Evans J.S.B.T., Barston J.L., Pollard P. On the conflict between logic and belief in syllogistic reasoning. Memory, Cognition. 1983, 11(3), 295–306. https://doi.org/10.3758/BF03196976

García-Madruga J.A., Gutiérrez F., Carriedo N., Moreno S., Johnson-Laird P.N. Mental models in deductive reasoning. The Spanish Journal of Psychology. 2002 , 5(2), 125–140.https://doi.org/10.1017/S1138741600005904

García-Madruga J.A., Moreno S., Carriedo N., Gutiérrez F., Johnson-Laird P.N. Are conjunctive inferences easier than disjunctive inferences? A comparison of rules and models. Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology. 2001, 54(2), 613–632. https://doi.org/10.1080/713755974

Gómez-Veiga I., Vila Chaves J.O., Doque G., García-Madruga J.A. A new look to a classic issue: Reasoning and academic achievement at secondary school. Frontiers in Psychology. 2018, 9, 400. https://doi.org/10.3389/fpsyg.2018.00400

Hilton D.J, Charalambides L., Hoareau-Blanchet S. Reasoning about rights and duties: mental models, world knowledge and pragmatic interpretation. Thinking and Reasoning. 2016, 22(2), 150–183. https://doi.org/10.1080/13546783.2015.1076520

Johnsen B.H., Bartone P., Sandvik A., Gjeldnes R., Morken A. et al. Psychological Hardiness Predicts Success in a Norwegian Armed Forces Border Patrol Selection Course. International Journal of Selection and Assessment. 2013, 21(4), 368–375. https://doi.org/10.1111/ijsa.12046

Johnson-Laird P.N. Mental models and deduction. Trends in Cognitive Sciences. 2001, 5(10), 434–442. https://doi.org/10.1016/S1364-6613(00)01751-4

Johnson-Laird P.N., Byrne R.M.J. Deduction. Lawrence Erlbaum Associates, Inc, 1991.

Khemlani S., Johnson-Laird P.N. Theories of the syllogism: A meta-analysis. Psychological Bulletin. 2012, 138(3), 427–457. https://doi.org/10.1037/a0026841

Luriya A.R. Kul'turnye razlichiya i intellektual'naya deyatel'nost'. Etapy projdennogo puti: Nauchnaya biografiya. Moskva: Izd-vo MGU, 1982, 47–69. (in Russian)

Markovits H., Nantel G. The belief-bias effect in the production and evaluation of logical conclusions. Memory Cognition, 1989, 17(1), 11–17. https://doi.org/10.3758/BF03199552

McDonald R. Test Theory: a Unified Treatment. Mahwah, NJ: Lawrence Erlbaum Associates, 1999.

Merino P.Á., Hernández C.R., Alemany F.S. Measurement variables for deductive reasoning. Revista Iberoamericana de Diagnostico y Evaluacion Psicologica. 2018, 49(4), 59–75.https://doi.org/10.21865/RIDEP49.4.05

Oakhill J., Johnson-Laird P.N., Garnham A. Believability and syllogistic reasoning. Cognition. 1989, 31(2), 117–140. https://doi.org/10.1016/0010-0277(89)90020-6

Piazhe Zh. Izbrannye psihologicheskie trudy / [per. s fr.]. Moskva: Prosveshchenie. 1969, 76–108. (in Russian)

Solopov R.V. Effekt obucheniya programmirovaniya na logicheskoe myshlenie: magisterskaya dissertaciya. Nacional'nyj issledovatel'skij universitet Vysshaya shkola ekonomiki, Moskva, 2019. (in Russian)

Spellman B.A., Holyoak K.J. Pragmatics in analogical mapping. Cognitive Psychology. 1996, 31(3), 307–346. https://doi.org/10.1006/cogp.1996.0019

Thomas D.A. Predicting law school academic performance from LSAT scores and undergraduate grade point averages: A comprehensive study. Ariz. St. LJ, 2003, 35, 1007.

Trizano-Hermosilla I., Alvarado J.M. Best alternatives to Cronbach's alpha reliability in realistic conditions: Congeneric and asymmetrical measurements. Frontiers in psychology. 2016, 7, 769.

Wason P.C., Johnson-Laird P.N. Psychology of reasoning: Structure and content. Harvard University Press. 1972.

Weijters B., Baumgartner H. Misresponse to reversed and negated items in surveys: A review. Journal of Marketing Research. 2012, 49(5), 737–747. https://doi.org/10.1509/jmr.11.0368

Wilhelm O., Wolfgang C. Entwicklung und Erprobung von Tests zur Erfassung des logischen Denkens [Development and Evaluation of Deductive Reasoning Tests]. Diagnostica. 1998, 44(2), 71–83.

Wilkins M.C. The effect of changed material on ability to do formal syllogistic reasoning. Archives of Psychology, 1929, 102, 83.

Received 13 March 2020. Date of publication: 28 April 2020.

About author

Tyumeneva Yulia Alekseevna, PhD, Senior Research Fellow, International Laboratory for Evaluation of Practices and Innovations in Education, Institute of Education – National Research University Higher School of Economics, 16 Potapovsky Pereulok, Building 10, 101000, Moscow, Russian Federation.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Uglanova Irina L'vovna, PhD student, research assistant, Institute of Education – National Research University Higher School of Economics, 16 Potapovsky Pereulok, Building 10, 101000, Moscow, Russian Federation.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Solopov Roman Viktorovich, master student, Institute of Education – National Research University Higher School of Economics, 16 Potapovsky Pereulok, Building 10, 101000, Moscow, Russian Federation.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Obukhov Aleksey Sergeevich, PhD, Associate Professor, Leading expert of the Research center of modern childhood, Institute of Education – National Research University Higher School of Economics, 16 Potapovsky Pereulok, Building 10, 101000, Moscow, Russian Federation.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра. 

Suggested citation

Tyumeneva Y.A., Uglanova I.L., Solopov R.V., Obukhov A.S. The development of a deductive reasoning test: the construct structure and factors affecting the test item difficulty. Psikhologicheskie Issledovaniya, 2020, Vol. 13, No. 69, p. 7. http://psystudy.ru (in Russian, abstr. in English).

Permanent URL: http://psystudy.ru/index.php/eng/2020v13n69e/1738-tyumeneva69e.html

Back to top >>

Related Articles