![Page 1: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/1.jpg)
1
Learning II:Skinnerian
Brian J. Piper, Ph.D.
![Page 2: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/2.jpg)
Operant Conditioning Skinner’s Experiments Extending Skinner’s
Understanding Skinner’s Legacy Contrasting Classical & Operant
Conditioning
Burrhus Frederic Skinner1904-1990
![Page 3: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/3.jpg)
Operant & Classical Conditioning
1. Classical conditioning forms associations between stimuli (CS and US). Operant conditioning, on the other hand, forms an association between behaviors and the resulting events.
![Page 4: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/4.jpg)
Operant & Classical Conditioning
2. Classical conditioning involves respondent behavior that occurs as an automatic response to a certain stimulus. Operant conditioning involves operant behavior, a behavior that operates on the environment, producing rewarding or punishing stimuli.
![Page 5: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/5.jpg)
Thorndike’s Experiments
Edward Thorndike discovered the law of effect. This law states that rewarded
behavior is likely to occur again.
Yale U
niversity Library
1874-1949
![Page 6: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/6.jpg)
Operant Chamber
Using Thorndike's law of effect as a starting point, Skinner
developed the Operant chamber, or the Skinner box, to study
operant conditioning.
Walter D
awn/ Photo R
esearchers, Inc.
From
The
Ess
entia
ls o
f Con
ditio
ning
and
Lea
rnin
g, 3
rd
Edi
tion
by M
icha
el P
. Dom
jan,
200
5. U
sed
with
per
mis
sion
by
Tho
mso
n L
earn
ing,
Wad
swor
th D
ivis
ion
![Page 7: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/7.jpg)
Operant Chamber
The operant chamber, or Skinner box, comes with a bar or key that an
animal manipulates to obtain a
reinforcer like food or water. The bar or key is connected to devices that record
the animal’s response.
![Page 8: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/8.jpg)
Shaping Lever Pressing Behavior
• simply turning toward the lever will be reinforced• only stepping toward the lever will be reinforced• only moving to within a specified distance from the lever will
be reinforced• only touching the lever with any part of the body, such as the
nose, will be reinforced• only touching the lever with a specified paw will be reinforced• only depressing the lever partially with the specified paw will
be reinforced• only depressing the lever completely with the specified paw
will be reinforced
![Page 9: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/9.jpg)
ShapingShaping is the operant conditioning procedure in which reinforcers guide behavior towards the desired target behavior through successive approximations.
10 min:http://www.youtube.com/watch?v=NhmZBMuZ6vE
![Page 10: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/10.jpg)
Types of Reinforcers
Reinforcement: Any event that strengthens the behavior it follows.
![Page 11: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/11.jpg)
1. Primary Reinforcer: An innately reinforcing stimulus like food or drink.
2. Secondary Reinforcer: A learned reinforcer that gets its reinforcing power through association with the primary reinforcer.
Primary & Secondary Reinforcers
![Page 12: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/12.jpg)
1. Immediate Reinforcer: A reinforcer that occurs instantly after a behavior. A rat gets a food pellet for a bar press.
2. Delayed Reinforcer: A reinforcer that is delayed in time for a certain behavior. A paycheck that comes at the end of a week.
Immediate & Delayed Reinforcers
We may be inclined to engage in small immediate reinforcers (watching TV) rather than large delayed reinforcers (getting an A in a course) which require consistent study.
![Page 13: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/13.jpg)
Reinforcement Schedules
1. Continuous Reinforcement: Reinforces the desired response each time it occurs.
2. Partial Reinforcement: Reinforces a response only part of the time. Though this results in slower acquisition in the beginning, it shows greater resistance to extinction later on.
![Page 14: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/14.jpg)
Ratio Schedules
1. Fixed-ratio schedule: Reinforces a response only after a specified number of responses. e.g., piecework pay.
2. Variable-ratio schedule: Reinforces a response after an unpredictable number of responses. This is hard to extinguish because of the unpredictability (e.g., behaviors like gambling, fishing).
![Page 15: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/15.jpg)
Interval Schedules
1. Fixed-interval schedule: Reinforces a response only after a specified time has elapsed. (e.g., preparing for an exam only when the exam draws close.)
2. Variable-interval schedule: Reinforces a response at unpredictable time intervals, which produces slow, steady responses. (e.g., pop quiz.)
![Page 16: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/16.jpg)
![Page 17: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/17.jpg)
Applications of Operant Conditioning
Skinner introduced the concept of teaching machines that shape learning in small steps and provide immediate reinforcements for correct responses. They also provide individualized
instruction.
In School
LWA
-JDL
/ Corbis
Skinner (1958). Science, 128, 969-977.
![Page 18: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/18.jpg)
Applications of Operant Conditioning
• Animal training• Applied Behavior Analysis:
– Worth video Sampler: 2004 Abnormal Psychology
![Page 19: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/19.jpg)
Punishment
Any event that decreases the behavior it follows.
![Page 20: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/20.jpg)
Punishment
1. Results in unwanted fears.2. Conveys no information to the organism.3. Causes unwanted behaviors to reappear
in its absence4. Justifies pain to others.5. Causes aggression towards the agent.
Although there may be some justification for occasional punishment, it usually leads to negative effects.
![Page 21: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/21.jpg)
Biological Predisposition
Biological constraints predispose
organisms to learn associations that are naturally adaptive.
Breland and Breland (1961) showed that
animals drift towards their biologically
predisposed instinctive behaviors. Marian Breland Bailey
Ph
oto
: Bob
Baile
y
![Page 22: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/22.jpg)
Latent Learning
Tolman & Honzik (1930) University of California Publications in Psychology, 4, 257-275.
![Page 23: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/23.jpg)
Latent Learning
Tolman & Honzik (1930) University of California Publications in Psychology, 4, 257-275.
![Page 24: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/24.jpg)
Skinner’s Legacy
Skinner argued that behaviors were shaped by external influences instead of
inner thoughts and feelings.
![Page 25: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/25.jpg)
Most “Eminent” Psychologist of 20th Century
• Eminence was defined based on:– journal citation frequency– textbook citation frequency – survey of professional society (APS)– Membership in National Academy of Sciences
Haggbloom et al. (2002). Review of General Psychology, 6, 139-159.
![Page 26: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/26.jpg)
Most “Eminent” Psychologists of 20th Century
![Page 27: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/27.jpg)
History of BehaviorismKey Quote (1930)
“Give me a dozen healthy infants, well-formed, and my own specified world to bring them up in and I'll guarantee to take any one at random and train him to become any type of specialist I might select – doctor, lawyer, artist, merchant-chief and, yes, even beggar-man and thief, regardless of his talents, penchants, tendencies, abilities, vocations, and race of his ancestors. I am going beyond my facts and I admit it, but so have the advocates of the contrary and they have been doing it for many thousands of years.”
27
![Page 28: Introductory Psychology: Learning Part II (Operant)](https://reader036.vdocument.in/reader036/viewer/2022081413/545b48fdaf7959755d8b5f81/html5/thumbnails/28.jpg)
Originator Ivan Pavlov Fred Skinner