Check the latest UofT COVID-19 updates more information
Working paper 551
Rahul Deb and Colin Stewart, "Optimal Adaptive Testing: Informativeness and Incentives", 2015-10-30
Main Text (application/pdf) (404,329 bytes)

Abstract: We introduce a learning framework in which a principal seeks to determine the ability of a strategic agent. The principal assigns a test consisting of a finite sequence of questions or tasks. The test is adaptive: each question that is assigned can depend on the agent's past performance. The probability of success on a question is jointly determined by the agent's privately known ability and an unobserved action that he chooses to maximize the probability of passing the test. We identify a simple monotonicity condition under which the principal always employs the most (statistically) informative question in the optimal adaptive test. Conversely, whenever the condition is violated, we show that there are cases in which the principal strictly prefers to use less informative questions.

Keywords: testing, learning, sequential choice of experiments

JEL Classification: C70, C72

Last updated on July 12, 2012