Operant Conditioning

Shaping shaping = successive approximations

toward a goal

a process whereby reinforcements are given for behavior directed toward a goal

reinforcement is given for approximations toward a desired goal

Types of Shaping

1) topographical shaping

the individual or organism did not engage in the behavior previously, but then is reinforced for successive approximations toward a goal

Types of Shaping 2) quantitative shaping: here reinforcement is

dependent on either increasing or decreasing the quantity of some behavior

an adjusting schedule of reinforcement

a new response is not learned

the individual already is engaging in the behavior and you either want to increase or decrease it via shaping

Making Shaping Effective

1) Define the goal 2) Determine a starting point 3) Pick a reinforcer 4) Determine the steps

Dissociative Identity Disorder What is DID? - replace MPD

two or more distinct identities

at least two of these personalities take control of behavior

unable to recall important information

not due to medical or substance

Dissociative Identity Disorder some alters are aware of others, some are not

the host is the primary identity (the person)

the alters can be the exact opposite of the host

e.g., host = passive, alters = aggressive handwriting and drawing is different

Dissociative Identity

recognized since 1800s

Benjamin Rush described DID

Included in DSM-III for first time, set stage for clinical research

Explanations for DID?

True disorder Another disorder Possession Iatrogenically induced disorder

Shaping and DID Condition 1 (C1)

Increased attention (e.g., media, research) to DID.

Condition 2 (C2)Therapist strongly believes in the existence of DID.Therapist is fascinated by the dissociative experience.

Condition 3 (C3)Patient is psychologically fragile.Patient believes the therapist is competent. Patient is highly suggestible and or personality disordered.

DID symptoms = C1 * C2 * C3

Schedules of reinforcement

1. Continuous (CRF) good to start with when shaping behavior

2. Non continuous (intermittent, partial) is one in which only some responses are

reinforced four basic types

Intermittent Reinforcement 1. Fixed Ratio (FR): reinforcement delivered

after fixed number of correct responses.

e.g., FR 3 = 3 responses to get reinforcer

period of steady, rapid rate of responding until reinforcement, then a brief pause before starting again

low resistance to extinction

Post reinforcement pause (PRP)

PRP longer with lean reinforcement (i.e., FR 100 v FR 3)

Ratio strain = too much responding required, behavior stops.

Fixed Ratio

Intermittent Reinforcement 2. Fixed Interval: Reinforcement for

next correct response after a fixed amount of time since last reinforcement.

initially, a slow rate of responding, gradually increasing to rapid responding

pause after reinforcement

low resistance to extinction

Fixed Interval

Intermittent Reinforcement

3. Variable Ratio: reinforcement after varying number of correct responses

moderate levels of responding with little or no pause.

high resistance to extinction

Variable Ratio

Variable Ratio

Abusive Relationships

interaction

“good behavior” lots of positive reinforcement

victim victimizer

interaction

Lots of good behavior

Little positivereinforcement

victim

victimizer

Later…

Initially…

stretching the ratio

Intermittent Reinforcement 4. Variable Interval:

reinforcement after varying time since the last reinforcement.

moderate levels of responding with little or no pause

high resistance to extinction

Variable Interval

Mixed Schedules Fixed Duration (FD)

The behavior must be performed continuously for a fixed predictable amount of time.

Variable Duration (VD) The behavior must be performed

continuously for a varying, unpredictable amount of time.

DRL Differential Reinforcement of Low Rate Behaviour

Reinforcement is delivered after individual behaves undesirably to a lower rate than their normal rate for that behaviour

DRL Example

DRH Differential Reinforcement of High Rate of

Behaviour

Reinforcement for responding above a specified level.

DRH Examples

DRP Differential Reinforcement of Paced Responding

Reinforced for an amount below and above a certain range.

DRP Example

Intermittent Reinforcement

Can you come up with examples of each type of intermittent reinforcement (FR, VR, FI, VI) DRP, DRL, and DRH?

Get together in groups and come up with some examples.

DRO

Differential Reinforcement of Zero Behavior

Delivery of a reinforcer for not engaging in a specific behavior for a period of time.

DRO Application Define behavior to be changed.

Count frequency of behaviors in specified time frame. The average is the interval for reinforcement.

If there are no behaviors during the period, reinforce.

If there are behaviors during the period, start the timer again.

DRO Example

Temper Tantrums

DRI Differential Reinforcement of Incompatible

Behaviour

An undesirable behaviour is weakened, while a desirable behaviour is reinforced

DRI Example

Extinction 1) B C 2) B nothing

Result: decrease in B

Extinction B (tantrum) C (being picked up/ attention)

Problem: Positive reinforcement for the child: to

continue having tantrums.

Negative reinforcement for the parent: pick up child: avoid tantrum

Called a Reinforcement Trap

Types of Extinction 1. Social:

B C (social reinforcement) e.g: telling jokes no

reinforcement = no telling jokes

2. Non Social: B C (non social reinforcement)

e.g: looking at broken watch no time info. = stop looking at broken watch.

Side Effects of Extinction

1. increase in variability 2. emotional behavior – frustration 3. aggression 4. resurgence 5. depression

A practical example of an extinction burst.

6. Behaviour that is being extinguished will get worse (extinction burst) before it gets better

Resistance to Extinction

1. Schedule of reinforcement Continuous versus intermittent

2. History of reinforcement More reinforcement over time, the

harder to extinguish behavior 3. Magnitude of reinforcer

Larger hard to extinguish

Resistance to Extinction

4. Degree of Deprivation More deprived, greater resistance to

extinction 5. Previous experience

With experience, extinction is quicker