Stick ’em up!
She was mesmerizing. She must have been there for hours, kind of glassy-eyed and vacant looking. We were having dinner at a hotel, and this restaurant was next to their gaming room. We were in and out over nearly three hours, and she didn’t move. No drinks, no food, just a repetitive, mechanical action as she fed credits and pulled the slot machine arm.
Occasionally, the machine cackled and jangled. I never saw her flinch, run around the room waving her arms or do pretty much of anything, except pull the one-armed bandit’s arm again, and again. Mesmerizing. And something all managers, teachers and parents should know.
The power of reinforcement MMPW6DM7BXM8
How could a machine get this woman to do this? Because the people who made it were, like you, students of human behavior, and they knew a thing or two about reinforcement. Particularly, they get Reinforcement Schedules.
Last time we talked about three general categories of reinforcement schedules, and matched them up with three phases of behavior, mentioning that to maintain a behavior, we need to implement partial reinforcement.
When we do this, we need to make a decision about when we reinforce, and when we don’t. There are two simple ways. We can reinforce based on how many occurrences we see of the behavior, or over a time period. This gives us two general categories of partial reinforcement.
Ratios and intervals
Thus, I might decide to reinforce every second, or third, or tenth time I see the behavior I’ve chosen. This is a Ratio decision. That is, one reinforcement after every three occurrences, or two, or ten etc.
Or, I might decide to reinforce for the first occurrence after a specific period of time has elapsed, let’s say 5 minutes. This is an Interval decision. Nothing is done during the 5 minutes but, once time is up, the next occurrence is immediately reinforced.
Make sure you’ve got those two. Each is then divided into two more, called Fixed and Variable. Fixed means that the schedule doesn’t change, whereas variable means that it does.
We end up therefore with 2 x 2, or four options, which we’ll explain briefly in turn.
- Fixed Interval Reinforcement Schedule
- Fixed Ratio Reinforcement Schedule
- Variable Interval Reinforcement Schedule
- Variable Ratio Reinforcement Schedule
I decide on a time interval, and it never changes. My paycheck comes once a week, same time each week.
If parents threaten to spank their children only after the third time they’re naughty, it’s fixed ratio. Problem is, any smart kid knows that they can get away with it twice first!
I check my employees’ work periodically, but on average twice a day. They don’t know when I’m coming, but they know I’m coming, so they work hard all the time, in case.
The reinforcement comes after varying occurrences of behavior. So after the third, then second, then seventh coin, the one-armed bandit gives me a little pay out, two credits, then one, then six, and so on.
Understand how these guys have reinforcement schedules sorted and this woman was completely hooked? The reinforcement for her putting another coin in the slot is carefully balanced. Not too much that she wins all the time, not too little that she get’s frustrated and leaves. Just enough to be tantalising, and make you stay, because you might win on the next one… right?
So here’s the take home bit
Ratios are more effective than intervals, even though the rates of reinforcement may be equivalent.
Variable schedules outdo fixed schedules, and make behavior more durable.
In sum, variable ratio schedules are the most powerful, with stronger behaviors that are less prone to extinction. They work for managers, teachers and parents, and one-armed bandit manufacturers, who could teach us all a thing or two about managing behavior!
Impressive words to drop into the morning coffee chat
Fixed Interval Reinforcement Schedule, Fixed Ratio Reinforcement Schedule, Variable Interval Reinforcement Schedule, Variable Ratio Reinforcement Schedule
How could you use it?
Want more? Subscribe for FREE (top right) to get Bite sized brains in your inbox. Do someone a favor and pass it on.