Influence of reinforcement and its omission on trial‐by‐trial changes of response bias in perceptual decision making

Abstract

Discrimination performance in perceptual choice tasks is known to reflect both sensory discriminability and nonsensory response bias. In the framework of signal detection theory, these aspects of discrimination performance are quantified through separate measures, sensitivity ( d′ ) for sensory discriminability and decision criterion ( c ) for response bias. However, it is unknown how response bias (i.e., criterion) changes at the single‐trial level as a consequence of reinforcement history. We subjected rats to a two‐stimulus two‐response conditional discrimination task with auditory stimuli and induced response bias through unequal reinforcement probabilities for the two responses. We compared three signal‐detection‐theory‐based criterion learning models with respect to their ability to fit experimentally observed fluctuations of response bias on a trial‐by‐trial level. These models shift the criterion by a fixed step (1) after each reinforced response or (2) after each nonreinforced response or (3) after both. We find that all three models fail to capture essential aspects of the data. Prompted by the observation that steady‐state criterion values conformed well to a behavioral model of signal detection based on the generalized matching law, we constructed a trial‐based version of this model and find that it provides a superior account of response bias fluctuations under changing reinforcement contingencies.

Other Versions

No versions found

Links

PhilArchive

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

  • Only published works are available at libraries.

Similar books and articles

Evaluation of a 'bias-free' measure of awareness.Simon Evans & Paul Azzopardi - 2007 - Spatial Vision. Special Issue 20 (1-2):61-77.
The old and new criterion problems.Matthias Michel - 2023 - In Michal Polák, Tomáš Marvan & Juraj Hvorecký, Conscious and Unconscious Mentality: Examining Their Nature, Similarities and Differences. New York, NY: Routledge. pp. 130-154.

Analytics

Added to PP
2025-05-30

Downloads
22 (#1,786,890)

6 months
15 (#769,189)

Historical graph of downloads
How can I increase my downloads?