Transitional and steady-state choice behavior under an adjusting-delay schedule

L Valencia-Torres, S da Costa Araújo, C M Olarte Sanchez, S Body, C M Bradshaw, E Szabadi

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.
Original languageEnglish
Pages (from-to)57-74
Number of pages18
JournalJournal of the experimental analysis of behavior
Volume95
Issue number1
DOIs
Publication statusPublished - Jan 2011

Fingerprint

Choice Behavior
Appointments and Schedules
Fourier Analysis
Sucrose
Delay Discounting
Power (Psychology)

Keywords

  • animals
  • association learning
  • choice behavior
  • conditioning, operant
  • discrimination learning
  • female
  • Fourier analysis
  • humans
  • linear models
  • memory, short-term
  • models, psychological
  • models, theoretical
  • motivation
  • psychomotor performance
  • rats
  • rats, wistar
  • reinforcement schedule
  • time perception

Cite this

Valencia-Torres, L., Araújo, S. D. C., Sanchez, C. M. O., Body, S., Bradshaw, C. M., & Szabadi, E. (2011). Transitional and steady-state choice behavior under an adjusting-delay schedule. Journal of the experimental analysis of behavior, 95(1), 57-74. https://doi.org/10.1901/jeab.2011.95-57

Transitional and steady-state choice behavior under an adjusting-delay schedule. / Valencia-Torres, L; Araújo, S da Costa; Sanchez, C M Olarte; Body, S; Bradshaw, C M; Szabadi, E.

In: Journal of the experimental analysis of behavior, Vol. 95, No. 1, 01.2011, p. 57-74.

Research output: Contribution to journalArticle

Valencia-Torres, L, Araújo, SDC, Sanchez, CMO, Body, S, Bradshaw, CM & Szabadi, E 2011, 'Transitional and steady-state choice behavior under an adjusting-delay schedule', Journal of the experimental analysis of behavior, vol. 95, no. 1, pp. 57-74. https://doi.org/10.1901/jeab.2011.95-57
Valencia-Torres, L ; Araújo, S da Costa ; Sanchez, C M Olarte ; Body, S ; Bradshaw, C M ; Szabadi, E. / Transitional and steady-state choice behavior under an adjusting-delay schedule. In: Journal of the experimental analysis of behavior. 2011 ; Vol. 95, No. 1. pp. 57-74.
@article{ac23541687c34bd994399a3be8ccb00b,
title = "Transitional and steady-state choice behavior under an adjusting-delay schedule",
abstract = "Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20{\%} depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.",
keywords = "animals, association learning, choice behavior, conditioning, operant, discrimination learning, female, Fourier analysis, humans, linear models, memory, short-term, models, psychological, models, theoretical, motivation, psychomotor performance, rats, rats, wistar, reinforcement schedule, time perception",
author = "L Valencia-Torres and Ara{\'u}jo, {S da Costa} and Sanchez, {C M Olarte} and S Body and Bradshaw, {C M} and E Szabadi",
year = "2011",
month = "1",
doi = "10.1901/jeab.2011.95-57",
language = "English",
volume = "95",
pages = "57--74",
journal = "Journal of the experimental analysis of behavior",
issn = "1938-3711",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Transitional and steady-state choice behavior under an adjusting-delay schedule

AU - Valencia-Torres, L

AU - Araújo, S da Costa

AU - Sanchez, C M Olarte

AU - Body, S

AU - Bradshaw, C M

AU - Szabadi, E

PY - 2011/1

Y1 - 2011/1

N2 - Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.

AB - Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 µl of a 0.6 M sucrose solution than when they were 25 and 100 µl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 µl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.

KW - animals

KW - association learning

KW - choice behavior

KW - conditioning, operant

KW - discrimination learning

KW - female

KW - Fourier analysis

KW - humans

KW - linear models

KW - memory, short-term

KW - models, psychological

KW - models, theoretical

KW - motivation

KW - psychomotor performance

KW - rats

KW - rats, wistar

KW - reinforcement schedule

KW - time perception

U2 - 10.1901/jeab.2011.95-57

DO - 10.1901/jeab.2011.95-57

M3 - Article

C2 - 21541116

VL - 95

SP - 57

EP - 74

JO - Journal of the experimental analysis of behavior

JF - Journal of the experimental analysis of behavior

SN - 1938-3711

IS - 1

ER -