B. F. Skinner and Radical Behaviorism
Biography: Fred Skinner, as his friends called him, was born in Susquehanna, Pennsylvania. His father was a lawyer. His mother was a homemaker who kept close watch on her two sons. (Skinner’s brother died of an accident at the age of 16.) Early on, Skinner exhibited a knack for solving problems using mechanical devices, a skill that would play a crucial role in his later research. He was a good student and attended Hamilton College where he majored in English. His goal then was to be a writer. After he graduated, he attempted to write short fiction, but was unsuccessful. In his autobiography (1970, p. 7), he wrote, “I had failed as a writer, because I had nothing important to say, but I could not accept that explanation.” After reading Russell’s (1927) Philosophy along with Watson’s and Pavlov’s works, he became a behaviorist, although the Radical Behaviorism he created later would be much different than anything he had learned at school.
He went to Harvard to study psychology and received his PhD in 1931; he remained there five more years as a fellow. A discussion with the philosopher Alfred North Whitehead at a fellow’s dinner proved seminal to Skinner’s later theorizing. Whitehead challenged Skinner to demonstrate that studying language scientifically was possible. Skinner’s response, however, was long delayed. It came in the form of a book (Skinner, 1957), Verbal Behavior, a work he considered to have been his most important contribution to psychology. Following his years as a fellow, Skinner first worked at the University of Minnesota for nine years followed by three years as chair at the University of Indiana. In 1948, he returned to Harvard where he remained an active faculty member until his retirement in 1974. However, he continued to work and publish there as professor emeritus until his very last days of life. His final public appearance was at the American Psychological Association’s 1990 meeting just days before his death. There, he reaffirmed his commitment to Radical Behaviorism in the face of the “cognitive revolution” which had swept through psychology during his lifetime. In his speech, delivered before a standing room only crowd, he proclaimed, “Cognitive science is the creation science of psychology, as it struggles to maintain the position of a mind or self” (Skinner, 1990, p. 1209). What legacy to psychology, exactly, did Skinner leave with his Radical Behaviorism?
Contributions: During World War II, Skinner engineered an apparatus for pigeons housed inside bombs. The pigeons could guide the bomb to the target by pecking at a display. The device worked but was never operationally deployed. After the war, Skinner made an Air Crib in which he and his wife, Yvonne, raised their second daughter. He made the Air Crib for their second child, Deborah, partly to keep her warm in the Minnesota weather without having to bundle her with layers of clothing. Skinner attempted to market the device but it never caught on, especially following an article in the Ladies Home Journal magazine (Skinner, 1945) that described it as an experiment in child rearing. Urban legends circulated that Deborah had either gone crazy or committed suicide. Those legends were untrue; she was a well-adjusted child and a successful adult (Joyce & Faye, 2010).
Skinner invented two pieces of laboratory apparatus that were instrumental in the development of Radical Behaviorism. One was the operant conditioning chamber or Skinner Box. The other was the cumulative recorder. He constructed Skinner boxes suitable for rats and pigeons. In rat chambers the response was usually a lever press while in pigeon chambers the response was a peck on a target disk . A small bit of food or water served as the reinforcer. The chamber itself was the discriminative stimulus but other discriminative stimuli (e.g., lights or tones) could be added. The dependent variable in a Skinner Box was the rate of response (number of responses over time) which was measured by the cumulative recorder. The Skinner Box made the discovery of schedules of reinforcement and shaping possible (see below).
Radical Behaviorism is, by design and intent, completely different from Watson’s Behaviorism and other neobehaviorist formulations. Radical Behaviorism, however, preserved Watson’s definition of psychology, the prediction and control of behavior, but it rejected other neobehaviorist theories because of their use of intervening variables; those were rejected because they were mentalistic and because they assumed dualism (which is mentalistic as well). At the same time, Radical Behaviorism was not S-R psychology either. Instead, it explained learned behavior through selection by consequences. Thus, operant conditioning occurs when a response is followed by a reinforcer causing that response to be emitted more often. Organisms also learn the environmental occasions when reinforcement is likely. Skinner diagrammed the relationship as follows:
SD → R → SR
where the SD is the discriminative stimulus, R is the emitted response, and SR is the reinforcer.
In the laboratory, specifying the three terms above is relatively easy. Outside of the laboratory, the search for discriminative stimuli and reinforcers is more difficult, but still quite possible. The standard traffic light makes a good example of the two types of discriminative stimuli. The green light serves as an SD because it signals that continuing to drive through the intersection is OK (or, more technically, a long history exists between the green light, pressing the accelerator, and the reinforcement of continuing to move). The red light, however, is an SΔ or a discriminative stimulus that signals that proceeding through the intersection is not OK. Running that red light might lead to any number of negative consequences up to and including death.
A branch of Radical Behaviorism, applied behavior analysis, specializes in searching for and understanding how operants or discriminative stimuli are at work in natural situations. Some applied behavior analysts work in clinical areas of psychology and use their knowledge to alter patients’ environments in ways that lead to positive outcomes to health or adjustment. Behavior modification is one of the techniques used by applied behavior analysts. It consists of imposing new and consistent environmental contingencies in real world situations such as classrooms. Nearly every elementary and secondary teacher in the United States is at least aware of behavior modification and many use it to manage their classrooms effectively and efficiently.
Understanding Skinner: DeBell and Harless (1992) examined common misunderstandings about Skinner using a short quiz they administered to psychology students and faculty. They identified five common misperceptions or myths (p. 68):
(a) the role of physiology and genetics in behavior,
(b) the extent to which all behavior can be conditioned,
(c) the uniqueness of the individual,
(d) the use of punishment in controlling behavior, and
(e) the existence of internal states.
Their quiz had 14 questions, half of which were filler questions about Skinner that did not relate to the myths above; the other half addressed the five myths.
Their results showed that Skinner believed that genetics did play an important role in behavior (Myth a),
that punishment and negative reinforcement were different processes (Myth b),
that individuals were unique and using group statistics was not helpful (Myth c),
that positive reinforcement was a better way to influence behavior than was punishment (Myth d), a
nd that he believed consciousness existed (Myth e). Interestingly, even psychology faculty missed more than half of the myth questions. Advanced undergraduates missed nearly all of them!
Skinner understood that physiology and genetics played an important role in behavior and that innate behaviors existed. Innate behaviors were the result of natural selection. However, the conditions that originally led to their selection could change, albeit slowly, as the environment changed. When it changed, so did its selection pressures. Organisms either adapted or went extinct. Also, behaviors that were adaptive at one point in phylogenetic history might become maladaptive at a later point; the flight or flight response in humans is one example. In the distant past it served an obvious adaptive purpose; it led to escape from danger. But, in the modern, industrialized world it had become maladaptive as it contributed to increased levels of hypertension and risk of heart attacks.
Skinner never claimed that all behavior was modifiable by operant conditioning; contingencies at the phylogenetic level or the cultural level might prevent it. However, operant conditioning was the major mechanism operating during a person’s life. Over the course of a person’s lifetime the environment would select behaviors that were followed by reinforcement and extinguish those that were not.
Skinner believed in human uniqueness and maintained that, except in the case of identical twins, all persons had been uniquely shaped by genetics, their environments, and the cultures they lived in. His research strategy reflected that belief. He conducted research on only a few organisms at a time and eschewed the use of large groups and the concomitant reliance upon statistical analysis. Instead, he argued for visual inspection of large amounts of data collected from only a few individuals.One of his innovations was the N = 1 research design where a single individual animal or human is subjected to successive experimental manipulations (see Kennedy, 2004, for more information on single case designs). One of the most common N = 1 designs is the ABA design. In it, the organism is observed in its environment without altering any behavioral contingencies. The purpose of that is to determine a baseline or control. This is the A part of the ABA design. Next, the experimenter alters a contingency (this is the B part) and looks for a change in the rate of responding. This step is the intervention. If a change occurs then the next step is to remove the contingency and observe whether the rate of responding returns to the baseline rate. These steps may be repeated (e.g., ABABABAB . . .) and if the rate of responding consistently changes then the researcher may infer that the intervention was causally responsible for the change in behavior. The ABA design is often used in applied behavior analysis to discover interventions that will change people’s behaviors. For Skinner, then, each individual and each situation was unique. He believed introducing large group designs and analyzing them statistically only confused understanding.
Skinner also differentiated strongly between reinforcement and punishment. Although both are similar structurally, but in opposite directions, they are quite dissimilar in their long-term effects. Reinforcement follows a response and strengthens it, and punishment follows a response and suppresses it. But, the structural similarity ends there. Skinner (1953) offered three reasons why punishments should not be administered: they only work temporarily, they create conditioned stimuli that lead to negative emotional reactions, and they reinforce escape from the conditioned situation in the future. He wrote (pp. 192–193):
"Civilized man has made some progress in turning from punishment to alternative forms of control . . . But we are still a long way from exploiting the alternatives, and we are not likely to make any real advance so long as our information about punishment and the alternatives to punishment remains at the level of casual observation. As a consistent picture of the extremely complex consequences of punishment emerges from analytical research, we may gain the confidence and skill needed to design alternative procedures in the clinic, in education, in industry, in politics, and in other practical fields."
Skinner’s view on internal states is probably the most startling example of his way of thinking about Behaviorism. He rejected any idea that a separate mental world exists. At the same time, however, he made possible an analysis of the environment inside the skin. Each person is affected only by the environment, but that environment consists of two parts: a public one potentially accessible to all and a private one accessible only to one’s self. So, as of right now, nearly 8 billion human private environments exist, one inside each person alive today. Skinner described the private world as:
"part of the universe enclosed within the organism’s own skin . . . With respect to each individual, in other words, a small part of the universe is private (original italics). We need not suppose that events which take place within an organism’s skin have special properties for that reason” (Skinner, 1953, p. 257).
Moore (2001, p. 237) added, “(a) private events are behavioral in character, and (b) they can contribute to discriminative control over behavior.” More simply put, Radical Behaviorism eliminates “mind” and in its place substitutes “private behavior.” But, Skinner’s standing among psychologists is due more to the results of his research than to the theory behind it.
Long-term Successes of Radical Behaviorism: Skinner deserves his position as the most eminent psychologist of the 20th century (Haggbloom et al., 2002) because of his long-lasting contributions to the discipline. Of his many contributions, a few stand out above the others. Already mentioned are the operant conditioning chamber and the cumulative recorder. Those two enabled the discovery of schedules of reinforcement, the partial reinforcement extinction effect, and shaping. Another long-term contribution was his desire to apply psychology toward the betterment of the world. Or, to put it in radical behaviorist terms, to reshape the environment in such a way as to improve nearly every aspect of human behavior. In this last respect, Skinner was very much a utopian who believed that psychology, properly conceived and applied, could improve the world.
Skinner first described four basic schedules of reinforcement in addition to the original one, continuous reinforcement, where a lab animal received a reinforcer every time it made the operant response. He termed the new ones intermittent schedules to distinguish them from continuous reinforcement. The intermittent schedules delivered reinforcers on the basis of time (interval schedules) or number of responses (ratio schedules). In addition, each type could be delivered reliably (fixed) or randomly (variable) leading to four different schedules: fixed interval (FI), variable interval (VI), fixed ratio (FR), and variable ratio (VR). Each schedule was associated with a consistently different pattern of responding that came from the schedule itself.
Skinner (1953, p. 99) noted of behavior under intermittent schedules, “Usually, such behavior is remarkably stable and shows great resistance to extinction.” One of Skinner’s most startling discoveries was the partial reinforcement extinction effect or PREE. It is counterintuitive and makes a wonderful rejoinder to those who argue that psychological research simply validates common sense. The PREE is seen in organisms under intermittent reinforcement. Compared to organisms under continuous reinforcement those under intermittent reinforcement take much longer to extinguish, they also achieve higher response rates. When students are asked “Will an organism work harder and longer when you give it a food reward every time it makes the correct response or when it gets a food reward every tenth time?” They, more often than not will select the first alternative. Hochman and Erev (2013) examined the apparent inconsistency of the PREE in laboratory vs. field situations:
"As was suggested by Nevin and Grace (2000), our results demonstrate that the effect of the reinforcement schedule is highly sensitive to the evaluation criteria. In many cases, partial reinforcement has a small positive effect on selecting the promoted alternative during extinction, and a larger negative effect on this behavior during training. This sensitivity can explain the apparent inconsistency between laboratory and field studies of partial reinforcements: Most laboratory studies have focused on the positive effect of partial reinforcements during extinction, whereas most field studies have focused on the fact that the overall effect of partial reinforcement tends to be negative."
Put more simply, learning under a partial schedule may take more time and effort but when (and if) the learning criterion is reached extinction will take longer under a partial schedule than it would under a continuous one.
The four basic schedules displayed very different cumulative recordings. The steeper the recording is, the faster the response rate. FR and VR schedules can achieve high rates of responding while the VI schedule never does. Also, note the characteristic differences in the shapes of the curves. The FI schedule is scalloped because organisms slow down immediately after receiving a reinforcer and speed up just prior to its delivery. The FR schedule shows post reinforcement pauses after each reinforcer is delivered.
Outside of the laboratory, schedule effects are easily observed as well. Slot machines pay off following a variable ratio schedule and players continue to insert money and pull the handles for long periods. Remuneration for most jobs follows a fixed interval schedule (e.g., getting a paycheck once a week). Workers in those jobs work the hardest just prior to receiving their checks, but their work rates drop off dramatically afterward. Wise managers, thus, pay their employees late on Friday afternoon. Some jobs, though, pay according to a fixed ratio schedule (piecework). Those workers achieve higher levels of production and earn more than workers paid on a fixed interval basis. Reinforcement schedules can exert powerful contingencies on behavior.
]
Shaping was another of Skinner’s discoveries. He described operant conditioning as a process similar to a sculptor shaping a lump of clay. Operant responses, he argued, are not “discrete units of behavior” (Skinner, 1953, p. 91), rather they are the end products of a process he called shaping. Here is how he described the shaping of a pigeon to peck at a particular location on the wall of its enclosure (p. 92):
"To get the pigeon to peck the spot as quickly as possible we proceed as follows: We first give the bird food when it turns slightly in the direction of the spot from any part of the cage. This increases the frequency of such behavior. We then withhold reinforcement until a slight movement is made toward the spot. This again alters the general distribution of behavior without producing a new unit. We continue by reinforcing positions successively closer to the spot, then by reinforcing only when the head is moved slightly forward, and finally only when the beak actually makes contact with the spot. We may reach this final response in a remarkably short time. A hungry bird, well adapted to the situation and to the food tray, can usually be brought to respond in this way in two to three minutes.
The alternative to shaping—in this case waiting for the pigeon to peck a spot on the wall and then delivering a reinforcer—would take much longer. It would not occur at all if the pigeon never pecked the wall. In practice, shaping has proven to be a powerful way of molding new operants quickly. Goddard (2018) described how Skinner, Keller Breland, and Norman Guttman first discovered shaping using feral pigeons on a rooftop of a Minneapolis flour mill in 1943 while conducting wartime research. They taught the pigeons to bowl using a repurposed food dispenser and small pins. Goddard wrote (p. 421):
"It is important that Skinner’s discovery of shaping not only resembled a genuine eureka experience but may also have been influential in emboldening Skinner’s later applications of operant conditioning to human behaviors…"
Goddard went on to argue that Skinner’s discovery of shaping was fundamental to his later application of Radical Behaviorism to selectionist accounts of personality change, implicit theories of intelligence, skill learning, and language.
Skinner’s utopian visions appear most prominently in his books Walden Two (1948) and Beyond Freedom and Dignity (1971). In the latter work, especially, he argued that society can be improved, but only if people are willing to give up belief in free will and personal autonomy as causal factors. In their place, Skinner proposed that people could arrange environmental contingencies in such a way as to promote a better world. He understood the difficulties he would have in promoting his solution. Freedom and dignity were the last preserves of “autonomous man” and they blocked the path to a scientific understanding of how the environment could be changed in order to promote good behavior:
"Freedom and dignity illustrate the difficulty. They are the possessions of the autonomous man of traditional theory, and they are essential to practices in which a person is held responsible for his conduct and given credit for his achievements. A scientific analysis shifts both the responsibility and the achievement to the environment. It also raises questions concerning “values.” Who will use a technology and to what ends? Until these issues are resolved, a technology of behavior will continue to be rejected, and with it possibly the only way to solve our problems (Skinner, 1971, p. 25)."
In place of traditional views on causation (e.g., free will and personal autonomy) Skinner (1981) urged that science accept a new conception for the source of behavior. That conception was his triad of selection by consequences found at the levels of natural selection, operant conditioning, and culture.He concluded (p. 504), “So long as we cling to the view that a person is an initiating doer, actor, or causer of behavior, we shall probably continue to neglect the conditions which must be changed if we are to solve our problems.”
Skinner’s hopes have yet to be realized. Moreover, while radical behaviorists continue to research and apply their results to practical situations, psychology itself has moved in another direction, away from Radical Behaviorism. The radical behaviorists, themselves, have explored that phenomenon.
Radical Behaviorism Today
Radical Behaviorism and the rest of psychology are uneasy partners at best. On the one hand, all psychologists recognize Skinner as one of a small handful of eminent 20th century researchers and theorists. But on the other hand, the research and practice of Radical Behaviorism and nearly all of the rest of psychology hardly ever overlap or affect each other.
This situation was dramatically illustrated by Morris, Smith, & Lazo (2005) when they described how an earlier article (Morris, Lazo, & Smith, 2004) they had written about Skinner and how much of his research incorporated biology had been rejected by five nonbehavior analytic journals. Ultimately, they published it in The Behavior Analyst, and then had to respond to inquiries about why they had published it there, in a place where the “readership was already aware of Skinner’s views and that the paper should have appeared in a journal whose readers had more to gain” (Morris, Smith, & Lazo), 2005, p. 169). Their reply was simple: their article had been rejected by five other generalist journals. They observed that behavior analysis had become isolated from the rest of psychology for a variety of reasons. In addition, Skinner’s views on what he termed the science of behavior are often unknown or distorted by mainstream psychology faculty and students.
Of all of the neobehaviorist approaches, only his remains vital today. But that vitality is only seen in a relatively small and remote corner of psychology’s garden. As Segal and Lachman (1972, pp. 53–54) noted:
"After World War II . . . major formal and theoretical advances outside psychology in finite mathematics, computer technology, information theory, and philosophy of science . . . gave rise to procedures and ideas applicable to formulations in competition with the behaviorist approaches. Problems within S-R behaviorism which were generally conceived to be empirically resolvable proved to be intractable. The strong neobehaviorist positions have weakened so considerably in the face of this competition that neobehaviorism can hardly be identified. Thus, the justification for the domination of psychology by neobehaviorism has eroded, as has the domination itself."
Students may wonder if modern Behaviorism is passé or even dead. Roediger (2004) argued otherwise. He provided scenarios designed to illustrate Behaviorism’s role in today’s psychology. In the first one he speculated that cognitive psychology represented a kind of intellectual revolution that attracted graduate students away from behaviorist’s animal labs and towards new cognitive research problems. In his second scenario he wondered if the problems behaviorists were attacking had become too focused and had missed the bigger picture. The third scenario offered that there was nothing wrong with modern Behaviorism with its adherents numbering some 12,000 psychologists working on animal and human research problems. For his fourth scenario he leaned on Tulving’s observation that there are now two separate psychologies, one that studies behavior and the other that studies mind. Both views only overlap slightly and, like humpty dumpty, may never become whole again. In his final scenario, he offered that maybe the behaviorists had won the war and managed to convert all psychologists to Behaviorism. In the end, he leaves the decision of Behaviorism’s health and prognosis for others to decide.
Summary
Neobehaviorism gradually replaced Watson’s Behaviorism. Two of its principal theorists, Tolman and Hull, created systems no longer part of modern psychology. B. F. Skinner’s system, Radical Behaviorism, is still a part of modern psychology, albeit a small part.
Skinner’s Radical Behaviorism was closer to biology than anything else. Using Darwinian logic, he believed that the environment selected consequences for organisms. The twist was that he defined the environment differently. For him, the environment contained two parts: a public part and a private part. Moreover, the same rules applied in both. Skinner was an environmental determinist who believed that much of psychology outside of his Radical Behaviorism was wrong or misguided.