Perceptual control theory

Last updated

Perceptual control theory (PCT) is a model of behavior based on the properties of negative feedback control loops. A control loop maintains a sensed variable at or near a reference value by means of the effects of its outputs upon that variable, as mediated by physical properties of the environment. In engineering control theory, reference values are set by a user outside the system. An example is a thermostat. In a living organism, reference values for controlled perceptual variables are endogenously maintained. Biological homeostasis and reflexes are simple, low-level examples. The discovery of mathematical principles of control introduced a way to model a negative feedback loop closed through the environment (circular causation), which spawned perceptual control theory. It differs fundamentally from some models in behavioral and cognitive psychology that model stimuli as causes of behavior (linear causation). PCT research is published in experimental psychology, neuroscience, ethology, anthropology, linguistics, sociology, robotics, developmental psychology, organizational psychology and management, and a number of other fields. PCT has been applied to design and administration of educational systems, and has led to a psychotherapy called the method of levels.

Contents

Principles and differences from other theories

The perceptual control theory is deeply rooted in biological cybernetics, systems biology and control theory and the related concept of feedback loops. Unlike some models in behavioral and cognitive psychology it sets out from the concept of circular causality. It shares, therefore, its theoretical foundation with the concept of plant control, but it is distinct from it by emphasizing the control of the internal representation of the physical world. [1]

The plant control theory focuses on neuro-computational processes of movement generation, once a decision for generating the movement has been taken. PCT spotlights the embeddedness of agents in their environment. Therefore, from the perspective of perceptual control, the central problem of motor control consists in finding a sensory input to the system that matches a desired perception. [1]

History

PCT has roots in physiological insights of Claude Bernard and in 20th century in the research by Walter B. Cannon and in the fields of control systems engineering and cybernetics. Classical negative feedback control was worked out by engineers in the 1930s and 1940s, [2] [3] and further developed by Wiener, [4] Ashby, [5] and others in the early development of the field of cybernetics. Beginning in the 1950s, William T. Powers applied the concepts and methods of engineered control systems to biological control systems, and developed the experimental methodology of PCT. [6] [7]

A key insight of PCT is that the controlled variable is not the output of the system (the behavioral actions), but its input, that is, a sensed and transformed function of some state of the environment that the control system's output can affect. Because these sensed and transformed inputs may appear as consciously perceived aspects of the environment, Powers labelled the controlled variable "perception". The theory came to be known as "Perceptual Control Theory" or PCT rather than "Control Theory Applied to Psychology" because control theorists often assert or assume that it is the system's output that is controlled. [8] In PCT it is the internal representation of the state of some variable in the environment—a "perception" in everyday language—that is controlled. [9] The basic principles of PCT were first published by Powers, Clark, and MacFarland as a "general feedback theory of behavior" in 1960, [10] with credits to cybernetic authors Wiener and Ashby. It has been systematically developed since then in the research community that has gathered around it. [11] Initially, it was overshadowed by the cognitive revolution (later supplanted by cognitive science), but has now become better known. [12] [13] [14] [15]

Powers and other researchers in the field point to problems of purpose, causation, and teleology at the foundations of psychology which control theory resolves. [16] From Aristotle through William James and John Dewey it has been recognized that behavior is purposeful and not merely reactive, but how to account for this has been problematic because the only evidence for intentions was subjective. As Powers pointed out, behaviorists following Wundt, Thorndike, Watson, and others rejected introspective reports as data for an objective science of psychology. Only observable behavior could be admitted as data. [17] Such behaviorists modeled environmental events (stimuli) as causing behavioral actions (responses). This causal assumption persists in some models in cognitive psychology that interpose cognitive maps and other postulated information processing between stimulus and response but otherwise retain the assumption of linear causation from environment to behavior, which Richard Marken called an "open-loop causal model of behavioral organization" in contrast to PCT's closed-loop model. [12]

Another, more specific reason that Powers observed for psychologists' rejecting notions of purpose or intention was that they could not see how a goal (a state that did not yet exist) could cause the behavior that led to it. PCT resolves these philosophical arguments about teleology because it provides a model of the functioning of organisms in which purpose has objective status without recourse to introspection, and in which causation is circular around feedback loops. [18]

Example

A simple negative feedback control system is a cruise control system for a car. A cruise control system has a sensor which "perceives" speed as the rate of spin of the drive shaft directly connected to the wheels. It also has a driver-adjustable 'goal' specifying a particular speed. The sensed speed is continuously compared against the specified speed by a device (called a "comparator") which subtracts the currently sensed input value from the stored goal value. The difference (the error signal) determines the throttle setting (the accelerator depression), so that the engine output is continuously varied to prevent the speed of the car from increasing or decreasing from that desired speed as environmental conditions change.

If the speed of the car starts to drop below the goal-speed, for example when climbing a hill, the small increase in the error signal, amplified, causes engine output to increase, which keeps the error very nearly at zero. If the speed begins to exceed the goal, e.g. when going down a hill, the engine is throttled back so as to act as a brake, so again the speed is kept from departing more than a barely detectable amount from the goal speed (brakes being needed only if the hill is too steep). The result is that the cruise control system maintains a speed close to the goal as the car goes up and down hills, and as other disturbances such as wind affect the car's speed. This is all done without any planning of specific actions, and without any blind reactions to stimuli. Indeed, the cruise control system does not sense disturbances such as wind pressure at all, it only senses the controlled variable, speed. Nor does it control the power generated by the engine, it uses the 'behavior' of engine power as its means to control the sensed speed.

The same principles of negative feedback control (including the ability to nullify effects of unpredictable external or internal disturbances) apply to living control systems. [4] Implications of these principle are e.g. intensively studied by biological and medical cybernetics and systems biology.

The thesis of PCT is that animals and people do not control their behavior; rather, they vary their behavior as their means for controlling their perceptions, with or without external disturbances. This is harmoniously consistent with the historical and still widespread assumption that behavior is the final result of stimulus inputs and cognitive plans. [12] [19]

The methodology of modeling, and PCT as model

Perceptual Control Theory 01.png
Perceptual control theory compared with theories of behaviourism and cognitive psychology

The principal datum in PCT methodology is the controlled variable. The fundamental step of PCT research, the test for controlled variables, begins with the slow and gentle application of disturbing influences to the state of a variable in the environment which the researcher surmises is already under control by the observed organism. It is essential not to overwhelm the organism's ability to control, since that is what is being investigated. If the organism changes its actions just so as to prevent the disturbing influence from having the expected effect on that variable, that is strong evidence that the experimental action disturbed a controlled variable. It is crucially important to distinguish the perceptions and point of view of the observer from those of the observed organism. It may take a number of variations of the test to isolate just which aspect of the environmental situation is under control, as perceived by the observed organism. [20] [21]

PCT employs a black box methodology. The controlled variable as measured by the observer corresponds quantitatively to a reference value for a perception that the organism is controlling. The controlled variable is thus an objective index of the purpose or intention of those particular behavioral actions by the organismthe goal which those actions consistently work to attain despite disturbances. With few exceptions, in the current state of neuroscience this internally maintained reference value is seldom directly observed as such (e.g. as a rate of firing in a neuron), since few researchers trace the relevant electrical and chemical variables by their specific pathways while a living organism is engaging in what we externally observe as behavior. [22] However, when a working negative feedback system simulated on a digital computer performs essentially identically to observed organisms, then the well understood negative feedback structure of the simulation or model (the white box) is understood to demonstrate the unseen negative feedback structure within the organism (the black box). [6]

Data for individuals are not aggregated for statistical analysis; [23] instead, a generative model is built which replicates the data observed for individuals with very high fidelity (0.95 or better)[ clarification needed ]. To build such a model of a given behavioral situation requires careful measurements of three observed variables:

qiThe input quantity, that aspect of the stimulus which the subject perceives and has been demonstrated to be controlling.
qoThe output quantity, that aspect of the subject's behavior which affects the state of qi.
dThe disturbance, a value summing the effects that any other influences in the environment have on the state of qi. In a controlled experiment one aims to have just one disturbing influence that is under the control of the investigator, but in naturalistic observation the situation is frequently more complex.

A fourth value, the internally maintained reference r (a variable ′setpoint′), is deduced from the value at which the organism is observed to maintain qi, as determined by the test for controlled variables (described at the beginning of this section).

With two variables specified, the controlled input qi and the reference r, a properly designed control system, simulated on a digital computer, produces outputs qo that almost precisely oppose unpredictable disturbances d to the controlled input. Further, the variance from perfect control accords well with that observed for living organisms. [24] Perfect control would result in zero effect of the disturbance, but living organisms are not perfect controllers, and the aim of PCT is to model living organisms. When a computer simulation performs with >95% conformity to experimentally measured values, opposing the effect of unpredictable changes in d by generating (nearly) equal and opposite values of qo, it is understood to model the behavior and the internal control-loop structure of the organism. [18] [10] [25]

By extension, the elaboration of the theory constitutes a general model of cognitive process and behavior. With every specific model or simulation of behavior that is constructed and tested against observed data, the general model that is presented in the theory is exposed to potential challenge that could call for revision or could lead to refutation.

Mathematics

To illustrate the mathematical calculations employed in a PCT simulation, consider a pursuit tracking task in which the participant keeps a mouse cursor aligned with a moving target on a computer monitor.

The model assumes that a perceptual signal within the participant represents the magnitude of the input quantity qi. (This has been demonstrated to be a rate of firing in a neuron, at least at the lowest levels.) [25] [26] In the tracking task, the input quantity is the vertical distance between the target position T and the cursor position C, and the random variation of the target position acts as the disturbance d of that input quantity. This suggests that the perceptual signal p quantitatively represents the cursor position C minus the target position T, as expressed in the equation p=CT.

Between the perception of target and cursor and the construction of the signal representing the distance between them there is a delay of τ milliseconds, so that the working perceptual signal at time t represents the target-to-cursor distance at a prior time, tτ. Consequently, the equation used in the model is

1. p(t) = C(tτ) T(tτ)

The negative feedback control system receives a reference signal r which specifies the magnitude of the given perceptual signal which is currently intended or desired. (For the origin of r within the organism, see under "A hierarchy of control", below.) Both r and p are input to a simple neural structure with r excitatory and p inhibitory. This structure is called a "comparator". [25] The effect is to subtract p from r, yielding an error signal e that indicates the magnitude and sign of the difference between the desired magnitude r and the currently input magnitude p of the given perception. The equation representing this in the model is:

2. e = rp

The error signal e must be transformed to the output quantity qo (representing the participant's muscular efforts affecting the mouse position). Experiments have shown that in the best model for the output function, the mouse velocity Vcursor is proportional to the error signal e by a gain factor G (that is, Vcursor = G*e). Thus, when the perceptual signal p is smaller than the reference signal r, the error signal e has a positive sign, and from it the model computes an upward velocity of the cursor that is proportional to the error.

The next position of the cursor Cnew is the current position Cold plus the velocity Vcursor times the duration dt of one iteration of the program. By simple algebra, we substitute G*e (as given above) for Vcursor, yielding a third equation:

3. Cnew = Cold + G*e*dt

These three simple equations or program steps constitute the simplest form of the model for the tracking task. When these three simultaneous equations are evaluated over and over with similarly distributed random disturbances d of the target position that the human participant experienced, the output positions and velocities of the cursor duplicate the participant's actions in the tracking task above within 4.0% of their peak-to-peak range, in great detail.

This simple model can be refined with a damping factor d which reduces the discrepancy between the model and the human participant to 3.6% when the disturbance d is set to maximum difficulty.

3'. Cnew = Cold + [(G*e)(d*Cold)]*dt

Detailed discussion of this model in (Powers 2008) [24] includes both source and executable code, with which the reader can verify how well this simple program simulates real behavior. No consideration is needed of possible nonlinearities such as the Weber-Fechner law, potential noise in the system, continuously varying angles at the joints, and many other factors that could afflict performance if this were a simple linear model. No inverse kinematics or predictive calculations are required. The model simply reduces the discrepancy between input p and reference r continuously as it arises in real time, and that is all that is requiredas predicted by the theory. [18] [25]

Distinctions from engineering control theory

In the artificial systems that are specified by engineering control theory, the reference signal is considered to be an external input to the 'plant'. [8] In engineering control theory, the reference signal or set point is public; in PCT, it is not, but rather must be deduced from the results of the test for controlled variables, as described above in the methodology section. This is because in living systems a reference signal is not an externally accessible input, but instead originates within the system. In the hierarchical model, error output of higher-level control loops, as described in the next section below, evokes the reference signal r from synapse-local memory, and the strength of r is proportional to the (weighted) strength of the error signal or signals from one or more higher-level systems. [27]

In engineering control systems, in the case where there are several such reference inputs, a 'Controller' is designed to manipulate those inputs so as to obtain the effect on the output of the system that is desired by the system's designer, and the task of a control theory (so conceived) is to calculate those manipulations so as to avoid instability and oscillation. The designer of a PCT model or simulation specifies no particular desired effect on the output of the system, except that it must be whatever is required to bring the input from the environment (the perceptual signal) into conformity with the reference. In Perceptual Control Theory, the input function for the reference signal is a weighted sum of internally generated signals (in the canonical case, higher-level error signals), and loop stability is determined locally for each loop in the manner sketched in the preceding section on the mathematics of PCT (and elaborated more fully in the referenced literature). The weighted sum is understood to result from reorganization.

Engineering control theory is computationally demanding, but as the preceding section shows, PCT is not. For example, contrast the implementation of a model of an inverted pendulum in engineering control theory [28] with the PCT implementation as a hierarchy of five simple control systems. [29]

A hierarchy of control

Hierarchical Organisation of feedback loops at different levels Hierarchical Organisation 01.png
Hierarchical Organisation of feedback loops at different levels

Perceptions, in PCT, are constructed and controlled in a hierarchy of levels. For example, visual perception of an object is constructed from differences in light intensity or differences in sensations such as color at its edges. Controlling the shape or location of the object requires altering the perceptions of sensations or intensities (which are controlled by lower-level systems). This organizing principle is applied at all levels, up to the most abstract philosophical and theoretical constructs.

The Russian physiologist Nicolas Bernstein [30] independently came to the same conclusion that behavior has to be multiordinal—organized hierarchically, in layers. A simple problem led to this conclusion at about the same time both in PCT and in Bernstein's work. The spinal reflexes act to stabilize limbs against disturbances. Why do they not prevent centers higher in the brain from using those limbs to carry out behavior? Since the brain obviously does use the spinal systems in producing behavior, there must be a principle that allows the higher systems to operate by incorporating the reflexes, not just by overcoming them or turning them off. The answer is that the reference value (setpoint) for a spinal reflex is not static; rather, it is varied by higher-level systems as their means of moving the limbs (servomechanism). This principle applies to higher feedback loops, as each loop presents the same problem to subsystems above it.

Whereas an engineered control system has a reference value or setpoint adjusted by some external agency, the reference value for a biological control system cannot be set in this way. The setpoint must come from some internal process. If there is a way for behavior to affect it, any perception may be brought to the state momentarily specified by higher levels and then be maintained in that state against unpredictable disturbances. In a hierarchy of control systems, higher levels adjust the goals of lower levels as their means of approaching their own goals set by still-higher systems. This has important consequences for any proposed external control of an autonomous living control system (organism). At the highest level, reference values (goals) are set by heredity or adaptive processes.

Reorganization in evolution, development, and learning

If an organism controls inappropriate perceptions, or if it controls some perceptions to inappropriate values, then it is less likely to bring progeny to maturity, and may die. Consequently, by natural selection successive generations of organisms evolve so that they control those perceptions that, when controlled with appropriate setpoints, tend to maintain critical internal variables at optimal levels, or at least within non-lethal limits. Powers called these critical internal variables "intrinsic variables" (Ashby's "essential variables").

The mechanism that influences the development of structures of perceptions to be controlled is termed "reorganization", a process within the individual organism that is subject to natural selection just as is the evolved structure of individuals within a species. [31]

This "reorganization system" is proposed to be part of the inherited structure of the organism. It changes the underlying parameters and connectivity of the control hierarchy in a random-walk manner. There is a basic continuous rate of change in intrinsic variables which proceeds at a speed set by the total error (and stops at zero error), punctuated by random changes in direction in a hyperspace with as many dimensions as there are critical variables. This is a more or less direct adaptation of Ashby's "homeostat", first adopted into PCT in the 1960 paper [10] and then changed to use E. coli's method of navigating up gradients of nutrients, as described by Koshland (1980). [32]

Reorganization may occur at any level when loss of control at that level causes intrinsic (essential) variables to deviate from genetically determined set points. This is the basic mechanism that is involved in trial-and-error learning, which leads to the acquisition of more systematic kinds of learning processes. [33]

Psychotherapy: the method of levels (MOL)

The reorganization concept has led to a method of psychotherapy called the method of levels (MOL). Using MOL, the therapist aims to help the patient shift his or her awareness to higher levels of perception in order to resolve conflicts and allow reorganization to take place. [34]

Neuroscience

Learning

Currently, no one theory has been agreed upon to explain the synaptic, neuronal or systemic basis of learning. Prominent since 1973, however, is the idea that long-term potentiation (LTP) of populations of synapses induces learning through both pre- and postsynaptic mechanisms. [35] [36] LTP is a form of Hebbian learning, which proposed that high-frequency, tonic activation of a circuit of neurones increases the efficacy with which they are activated and the size of their response to a given stimulus as compared to the standard neurone (Hebb, 1949). [37] These mechanisms are the principles behind Hebb's famously simple explanation: "Those that fire together, wire together". [37]

LTP has received much support since it was first observed by Terje Lømo in 1966 and is still the subject of many modern studies and clinical research. However, there are possible alternative mechanisms underlying LTP, as presented by Enoki, Hu, Hamilton and Fine in 2009, [38] published in the journal Neuron . They concede that LTP is the basis of learning. However, they firstly propose that LTP occurs in individual synapses, and this plasticity is graded (as opposed to in a binary mode) and bidirectional. [38] Secondly, the group suggest that the synaptic changes are expressed solely presynaptically, via changes in the probability of transmitter release. [38] Finally, the team predict that the occurrence of LTP could be age-dependent, as the plasticity of a neonatal brain would be higher than that of a mature one. Therefore, the theories differ, as one proposes an on/off occurrence of LTP by pre- and postsynaptic mechanisms and the other proposes only presynaptic changes, graded ability, and age-dependence.

These theories do agree on one element of LTP, namely, that it must occur through physical changes to the synaptic membrane/s, i.e. synaptic plasticity. Perceptual control theory encompasses both of these views. It proposes the mechanism of 'reorganisation' as the basis of learning. Reorganisation occurs within the inherent control system of a human or animal by restructuring the inter- and intraconnections of its hierarchical organisation, akin to the neuroscientific phenomenon of neural plasticity. This reorganisation initially allows the trial-and-error form of learning, which is seen in babies, and then progresses to more structured learning through association, apparent in infants, and finally to systematic learning, covering the adult ability to learn from both internally and externally generated stimuli and events. In this way, PCT provides a valid model for learning that combines the biological mechanisms of LTP with an explanation of the progression and change of mechanisms associated with developmental ability. [39] [40] [41] [42] [43]

Powers in 2008 produced a simulation of arm co-ordination. [24] He suggested that in order to move your arm, fourteen control systems that control fourteen joint angles are involved, and they reorganise simultaneously and independently. It was found that for optimum performance, the output functions must be organised in a way so as each control system's output only affects the one environmental variable it is perceiving. In this simulation, the reorganising process is working as it should, and just as Powers suggests that it works in humans, reducing outputs that cause error and increasing those that reduce error. Initially, the disturbances have large effects on the angles of the joints, but over time the joint angles match the reference signals more closely due to the system being reorganised. Powers suggests that in order to achieve coordination of joint angles to produce desired movements, instead of calculating how multiple joint angles must change to produce this movement the brain uses negative feedback systems to generate the joint angles that are required. A single reference signal that is varied in a higher-order system can generate a movement that requires several joint angles to change at the same time. [24]

Hierarchical organisation

Botvinick in 2008 [44] proposed that one of the founding insights of the cognitive revolution was the recognition of hierarchical structure in human behavior. Despite decades of research, however, the computational mechanisms underlying hierarchically organized behavior are still not fully understood. Bedre, Hoffman, Cooney & D'Esposito in 2009 [45] proposed that the fundamental goal in cognitive neuroscience is to characterize the functional organization of the frontal cortex that supports the control of action.

Recent neuroimaging data has supported the hypothesis that the frontal lobes are organized hierarchically, such that control is supported in progressively caudal regions as control moves to more concrete specification of action. However, it is still not clear whether lower-order control processors are differentially affected by impairments in higher-order control when between-level interactions are required to complete a task, or whether there are feedback influences of lower-level on higher-level control. [45]

Botvinik in 2008 [44] found that all existing models of hierarchically structured behavior share at least one general assumption – that the hierarchical, part–whole organization of human action is mirrored in the internal or neural representations underlying it. Specifically, the assumption is that there exist representations not only of low-level motor behaviors, but also separable representations of higher-level behavioral units. The latest crop of models provides new insights, but also poses new or refined questions for empirical research, including how abstract action representations emerge through learning, how they interact with different modes of action control, and how they sort out within the prefrontal cortex (PFC).

Perceptual control theory (PCT) can provide an explanatory model of neural organisation that deals with the current issues. PCT describes the hierarchical character of behavior as being determined by control of hierarchically organized perception. Control systems in the body and in the internal environment of billions of interconnected neurons within the brain are responsible for keeping perceptual signals within survivable limits in the unpredictably variable environment from which those perceptions are derived. PCT does not propose that there is an internal model within which the brain simulates behavior before issuing commands to execute that behavior. Instead, one of its characteristic features is the principled lack of cerebral organisation of behavior. Rather, behavior is the organism's variable means to reduce the discrepancy between perceptions and reference values which are based on various external and internal inputs. [46] Behavior must constantly adapt and change for an organism to maintain its perceptual goals. In this way, PCT can provide an explanation of abstract learning through spontaneous reorganisation of the hierarchy. PCT proposes that conflict occurs between disparate reference values for a given perception rather than between different responses, [13] and that learning is implemented as trial-and-error changes of the properties of control systems, [27] rather than any specific response being reinforced. In this way, behavior remains adaptive to the environment as it unfolds, rather than relying on learned action patterns that may not fit.

Hierarchies of perceptual control have been simulated in computer models and have been shown to provide a close match to behavioral data. For example, Marken [47] conducted an experiment comparing the behavior of a perceptual control hierarchy computer model with that of six healthy volunteers in three experiments. The participants were required to keep the distance between a left line and a centre line equal to that of the centre line and a right line. They were also instructed to keep both distances equal to 2 cm. They had 2 paddles in their hands, one controlling the left line and one controlling the middle line. To do this, they had to resist random disturbances applied to the positions of the lines. As the participants achieved control, they managed to nullify the expected effect of the disturbances by moving their paddles. The correlation between the behavior of subjects and the model in all the experiments approached 0.99. It is proposed that the organization of models of hierarchical control systems such as this informs us about the organization of the human subjects whose behavior it so closely reproduces.

Robotics

PCT has significant implications for Robotics and Artificial Intelligence. W.T. Powers introduced the application of PCT to robotics in 1978, early in the availability of home computers. [48] [49] [50] [51] The comparatively simple architecture, [52] a hierarchy of perceptual controllers, has no need for complex models of the external world, inverse kinematics, or computation from input-output mappings. Traditional approaches to robotics generally depend upon the computation of actions in a constrained environment. Robots designed this way are inflexible and clumsy, unable to cope with the dynamic nature of the real world. PCT robots inherently resist and counter the chaotic, unpredictable disturbances to their controlled inputs which occur in an unconstrained environment. The PCT robotics architecture has recently been applied to a number of real-world robotic systems including robotic rovers, [53] balancing robot [54] and robot arms. [55] Some commercially available robots which demonstrate good control in a naturalistic environment use a control-theoretic architecture which requires much more intensive computation. For example, Boston Dynamics has said [56] that its robots use historically leveraged model predictive control.

Current situation and prospects

The preceding explanation of PCT principles provides justification of how this theory can provide a valid explanation of neural organisation and how it can explain some of the current issues of conceptual models.

Perceptual control theory currently proposes a hierarchy of 11 levels of perceptions controlled by systems in the human mind and neural architecture. These are: intensity, sensation, configuration, transition, event, relationship, category, sequence, program, principle, and system concept. Diverse perceptual signals at a lower level (e.g. visual perceptions of intensities) are combined in an input function to construct a single perception at the higher level (e.g. visual perception of a color sensation). The perceptions that are constructed and controlled at the lower levels are passed along as the perceptual inputs at the higher levels. The higher levels in turn control by adjusting the reference levels (goals) of the lower levels, in effect telling the lower levels what to perceive. [25] [33]

While many computer demonstrations of principles have been developed, the proposed higher levels are difficult to model because too little is known about how the brain works at these levels. Isolated higher-level control processes can be investigated, but models of an extensive hierarchy of control are still only conceptual, or at best rudimentary.

Perceptual control theory has not been widely accepted in mainstream psychology, but has been effectively used in a considerable range of domains [57] [58] in human factors, [59] clinical psychology, and psychotherapy (the "Method of Levels"), it is the basis for a considerable body of research in sociology, [60] and it has formed the conceptual foundation for the reference model used by a succession of NATO research study groups. [61]

Recent approaches use principles of perceptual control theory to provide new algorithmic foundations for artificial intelligence and machine learning. [62]

Selected bibliography

Sociology

Related Research Articles

<span class="mw-page-title-main">Control engineering</span> Engineering discipline that deals with control systems

Control engineering, also known as control systems engineering and, in some European countries, automation engineering, is an engineering discipline that deals with control systems, applying control theory to design equipment and systems with desired behaviors in control environments. The discipline of controls overlaps and is usually taught along with electrical engineering, chemical engineering and mechanical engineering at many institutions around the world.

Control theory is a field of control engineering and applied mathematics that deals with the control of dynamical systems in engineered processes and machines. The objective is to develop a model or algorithm governing the application of system inputs to drive the system to a desired state, while minimizing any delay, overshoot, or steady-state error and ensuring a level of control stability; often with the aim to achieve a degree of optimality.

<span class="mw-page-title-main">Feedback</span> Process where information about current status is used to influence future status

Feedback occurs when outputs of a system are routed back as inputs as part of a chain of cause-and-effect that forms a circuit or loop. The system can then be said to feed back into itself. The notion of cause-and-effect has to be handled carefully when applied to feedback systems:

Simple causal reasoning about a feedback system is difficult because the first system influences the second and second system influences the first, leading to a circular argument. This makes reasoning based upon cause and effect tricky, and it is necessary to analyze the system as a whole. As provided by Webster, feedback in business is the transmission of evaluative or corrective information about an action, event, or process to the original or controlling source.

Subsumption architecture is a reactive robotic architecture heavily associated with behavior-based robotics which was very popular in the 1980s and 90s. The term was introduced by Rodney Brooks and colleagues in 1986. Subsumption has been widely influential in autonomous robotics and elsewhere in real-time AI.

<span class="mw-page-title-main">Negative feedback</span> Reuse of output to stabilize a system

Negative feedback occurs when some function of the output of a system, process, or mechanism is fed back in a manner that tends to reduce the fluctuations in the output, whether caused by changes in the input or by other disturbances. A classic example of negative feedback is a heating system thermostat — when the temperature gets high enough, the heater is turned OFF. When the temperature gets too cold, the heat is turned back ON. In each case the "feedback" generated by the thermostat "negates" the trend.

<span class="mw-page-title-main">Control system</span> System that manages the behavior of other systems

A control system manages, commands, directs, or regulates the behavior of other devices or systems using control loops. It can range from a single home heating controller using a thermostat controlling a domestic boiler to large industrial control systems which are used for controlling processes or machines. The control systems are designed via control engineering process.

<span class="mw-page-title-main">Feed forward (control)</span> Control paradigm in which errors are measured before they can affect a system

A feed forward is an element or pathway within a control system that passes a controlling signal from a source in its external environment to a load elsewhere in its external environment. This is often a command signal from an external operator.

The method of levels (MOL) is a cognitive approach to psychotherapy based on perceptual control theory (PCT). Using MOL, the therapist aims to help the patient shift his or her awareness to higher levels of perception in order to resolve conflicts and allow reorganization to take place.

Motor control is the regulation of movements in organisms that possess a nervous system. Motor control includes conscious voluntary movements, subconscious muscle memory and involuntary reflexes, as well as instinctual taxis.

William T. Powers was a medical physicist and an independent scholar of experimental and theoretical psychology who developed the perceptual control theory (PCT) model of behavior as the control of perception. He was the son of the well-known cement scientist and economist Treval Clifford Powers.

Neurorobotics is the combined study of neuroscience, robotics, and artificial intelligence. It is the science and technology of embodied autonomous neural systems. Neural systems include brain-inspired algorithms, computational models of biological neural networks and actual biological systems. Such neural systems can be embodied in machines with mechanic or any other forms of physical actuation. This includes robots, prosthetic or wearable systems but also, at smaller scale, micro-machines and, at the larger scales, furniture and infrastructures.

A hierarchical control system (HCS) is a form of control system in which a set of devices and governing software is arranged in a hierarchical tree. When the links in the tree are implemented by a computer network, then that hierarchical control system is also a form of networked control system.

Psi-theory, developed by Dietrich Dörner at the University of Bamberg, is a systemic psychological theory covering human action regulation, intention selection and emotion. It models the human mind as an information processing agent, controlled by a set of basic physiological, social and cognitive drives. Perceptual and cognitive processing are directed and modulated by these drives, which allow the autonomous establishment and pursuit of goals in an open environment.

Systems psychology is a branch of both theoretical psychology and applied psychology that studies human behaviour and experience as complex systems. It is inspired by systems theory and systems thinking, and based on the theoretical work of Roger Barker, Gregory Bateson, Humberto Maturana and others. Groups and individuals are considered as systems in homeostasis. Alternative terms here are "systemic psychology", "systems behavior", and "systems-based psychology".

<span class="mw-page-title-main">Cybernetics</span> Transdisciplinary field concerned with regulatory and purposive systems

Cybernetics is the transdisciplinary study of circular processes such as feedback systems where outputs are also inputs. It is concerned with general principles that are relevant across multiple contexts, including in ecological, technological, biological, cognitive and social systems and also in practical activities such as designing, learning, and managing.

<span class="mw-page-title-main">4D-RCS Reference Model Architecture</span> Reference model for military unmanned vehicles to identify and organize their software components

The 4D/RCS Reference Model Architecture is a reference model for military unmanned vehicles on how their software components should be identified and organized.

<span class="mw-page-title-main">Real-time Control System</span> Reference model architecture

Real-time Control System (RCS) is a reference model architecture, suitable for many software-intensive, real-time computing control problem domains. It defines the types of functions needed in a real-time intelligent control system, and how these functions relate to each other.

The emulation theory of representation postulates that there are multiple internal modeling circuitries in the brain referred to as emulators. These emulators mimic the input-output patterns of many cognitive operations including action, perception, and imagery. Often running in parallel, these emulators provide resultant feedback in the form of mock sensory signals of a motor command with less delay than sensors. These forward models receive efference copies of input motor commands being sent to the body and the resulting output sensory signals. Emulators are continually updating so as to give the most accurate anticipatory signal following motor inputs.

Classical control theory is a branch of control theory that deals with the behavior of dynamical systems with inputs, and how their behavior is modified by feedback, using the Laplace transform as a basic tool to model such systems.

In neuroscience, predictive coding is a theory of brain function which postulates that the brain is constantly generating and updating a "mental model" of the environment. According to the theory, such a mental model is used to predict input signals from the senses that are then compared with the actual input signals from those senses. Predictive coding is member of a wider set of theories that follow the Bayesian brain hypothesis.

References

  1. 1 2 Floegel, Mareike; Kasper, Johannes; Perrier, Pascal; Kell, Christian A. (30 March 2023). "How the conception of control influences our understanding of actions". Nature Reviews Neuroscience. 24 (5): 313–329. doi:10.1038/s41583-023-00691-z. PMID   36997716. S2CID   257857085.
  2. Harold Black and the Negative-Feedback Amplifier, Ronald Kline, IEEE Control Systems Magazine, Aug 1993, Volume 13, Issue 4, Pages 82-85
  3. Bennett, Stuart (June 1996). "A brief history of automatic control" (PDF). IEEE Control Systems Magazine. 16 (3): 17–25. doi:10.1109/37.506394. Archived from the original (PDF) on 9 August 2016. Retrieved 18 July 2016.
  4. 1 2 Cybernetics: Or Control and Communication in the Animal and the Machine. Paris: Hermann & Cie. 1948. 2nd revised ed. 1961, MIT Press, Cambridge, MA. ISBN   978-0-262-73009-9.
  5. Ashby, William Ross (1952). Design for a Brain. London: Chapman & Hall.
  6. 1 2 3 Runkel, Philip J. (1990). Casting nets and testing specimens: Two grand methods of psychology. New York: Praeger. p. 103. ISBN   978-0-275-93533-7.
  7. Cziko, Gary (2000), The things we do: Using the lessons of Bernard and Darwin to understand the what, how, and why of our behavior, Cambridge, MA: MIT Press, p.  9, ISBN   978-0-262-03277-3
  8. 1 2 Astrom, Karl J.; Murray, Richard M. (2008). Feedback Systems: An Introduction for Scientists and Engineers (PDF). Princeton University Press. ISBN   978-0-691-13576-2.
  9. For additional information about the history of PCT, see:
  10. 1 2 3 Powers, William T.; Clark, R.K.; McFarland, R.L. (1960). "A general feedback theory of human behavior (Part I)". Perceptual and Motor Skills. 11 (1): 71–88. doi:10.2466/pms.1960.11.1.71. S2CID   145256548. and Powers, William T.; Clark, R.K.; McFarland, R.L. (1960). "A general feedback theory of human behavior (Part II)". Perceptual and Motor Skills. 11 (3): 309–323. doi:10.2466/pms.1960.11.3.309. S2CID   220712715. [Reprinted in Bertalanffy, Ludwig von; Rapoport, Anatol (1960), General Systems: Yearbook of the Society for General Systems Research, vol. 5, Ann Arbor, Michigan: Society for General Systems Research, pages 63-73, 75-83. Partial reprint in Smith, A. G. (1966). Communication and Culture . New York: Holt, Rinehart, and Winston.]
  11. Archives of the Control Systems Group (CSG), also in the IAPCT Discourse forum.
  12. 1 2 3 Marken, Richard S. (June 2009). "You say you had a revolution: Methodological foundations of closed-loop psychology". Review of General Psychology. 13 (2): 137–145. doi:10.1037/a0015106. S2CID   145458091.
  13. 1 2 Mansell, Warren (2011). "Control of perception should be operationalized as a fundamental property of the nervous system". Topics in Cognitive Science. 3 (2): 257–261. doi:10.1111/j.1756-8765.2011.01140.x. PMID   25164294.
  14. Mansell, Warren; Carey, Timothy A. (28 November 2015). "A perceptual control revolution?". The Psychologist. The British Psychological Society. Retrieved 17 July 2016.
  15. Mansell, Warren, ed. (2020). The Interdisciplinary Handbook of Perceptual Control Theory: Living Control Systems IV. Cambridge: Academic Press. ISBN   978-0128189481.
  16. Powers, William T. (1978). "Quantitative analysis of purposive systems: Some spadework at the foundations of scientific psychology". Psychological Review. 85 (5): 417–435. doi:10.1037/0033-295X.85.5.417.
  17. "The behaviorist asks: Why don't we make what we can observe the real field of psychology? Let us limit ourselves to things that can be observed, and formulate laws concerning only those things. Now what can we observe? We can observe behavior—what the organism does or says." Watson, J.B. (1924). Behaviorism. New York: People's Institute Publishing Company.
  18. 1 2 3 Runkel, Philip J. (2003). People as living things. Hayward, CA: Living Control Systems Publishing. ISBN   978-0-9740155-0-7.
  19. Miller, George; Galanter, Eugene; Pribram, Karl (1960). Plans and the structure of behavior. New York: Holt, Rinehart and Winston. ISBN   978-0-03-010075-8.
  20. Runkel, Philip J. (2003). People as living things. Hayward, CA: Living Control Systems Publishing. pp. 77–79. ISBN   978-0-9740155-0-7.
  21. Marken, Richard S. (2001). "Controlled variables: psychology as the center fielder views it". American Journal of Psychology. 114 (2): 259–281. CiteSeerX   10.1.1.554.9588 . doi:10.2307/1423517. JSTOR   1423517. PMID   11430151.
  22. See e.g. Henry Yin's works listed on Google Scholar.
  23. See Runkel 1990 [6] on the limitations of statistical methods and the value of individual performance data.
  24. 1 2 3 4 Powers, William T. (2008). Living Control Systems III: The fact of control. New Canaan, CT: Benchmark Publications. ISBN   978-0-9647121-8-8. [Mathematical appendix by Dr. Richard Kennaway. Includes computer programs for the reader to demonstrate and experimentally test the theory.]
  25. 1 2 3 4 5 Powers, William T. (1973). Behavior: The Control of Perception. Wildwood House. ISBN   978-0-7045-0092-1.
  26. Yin, Henry H. (18 November 2014). "How Basal Ganglia Outputs Generate Behavior". Advances in Neuroscience. 2014 (768313): 1–28. doi: 10.1155/2014/768313 .
  27. 1 2 Marken, Richard S.; William T., Powers (1989), "Levels of intention in behavior", in Hershberger, Wayne (ed.), Volitional Action, Advances in psychology, vol. 62, Amsterdam: Elsevier B.V., pp. 409–430, ISBN   978-0-444-88318-6
  28. Documented e.g. at Miranda, José Luis Corona. 2009. Miranda, José Luis Corona. 2009. "Application of Kalman Filtering and PID Control for Direct Inverted Pendulum Control". M.A. Thesis, Chico State University, Chico, CA Archived 2016-03-04 at the Wayback Machine .
  29. Documented at Powers, William T. & Richard Kennaway. (Edited by Dag Forssell.) 2004. "Inverted Pendulum". Hayward, CA: Living Control Systems., with downloadable source and executable code. A more detailed exposition of the differences between PCT and engineering control theory, with computer demonstrations and source code, is available at http://www.livingcontrolsystems.com/demos/multiple_control/multiple_control.zip. This is one of many computer demonstrations that are available, with source code, at www.livingcontrolsystems.com/demos/tutor_pct.html.
  30. Bernstein, Nicolas. 1967. Coordination and regulation of movements. New York: Pergamon Press.
  31. For an introduction, see the Byte articles on robotics and the article on the origins of purpose in this collection Archived 2007-06-04 at the Wayback Machine .
  32. Koshland, Daniel. (1980). Bacterial chemotaxis as a model behavioral system. New York: Raven Press.
  33. 1 2 Cziko, Gary (1995). Without Miracles. MIT Press. ISBN   978-0-262-03232-2..
  34. Mansell, Warren; Carey, Timothy A; Tai, Sara (2012). A transdiagnostic approach to CBT using method of levels therapy: distinctive features. The CBT distinctive features series. Milton Park, Abingdon, Oxon; New York: Routledge. doi:10.4324/9780203081334. ISBN   9780415507639. OCLC   774499959.
  35. Bliss, T. V. P.; Lømo, T. (1 July 1973). "Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path". The Journal of Physiology. 232 (2). Wiley: 331–356. doi: 10.1113/jphysiol.1973.sp010273 . ISSN   0022-3751. PMC   1350458 . PMID   4727084.
  36. Bliss, T. V.; Gardner-Medwin, A. R.; Lømo, T. (1973). "Synaptic plasticity in the hippocampal formation". Macromolecules and Behaviour. 193.
  37. 1 2 Hebb, Donald (1949). The organization of behavior: A neuropsychological theory. New York: Wiley & Sons.
  38. 1 2 3 Enoki, Ryosuke; Hu, Yi-ling; Hamilton, David; Fine, Alan (2009). "Expression of Long-Term Plasticity at Individual Synapses in Hippocampus Is Graded, Bidirectional, and Mainly Presynaptic: Optical Quantal Analysis". Neuron. 62 (2). Elsevier BV: 242–253. doi: 10.1016/j.neuron.2009.02.026 . ISSN   0896-6273. PMID   19409269.
  39. Plooij, Frans X. (1984). The behavioral development of free-living chimpanzee babies and infants. Norwood, N.J.: Ablex.
  40. van de Rijt-Plooij, Hetty; Plooij, Frans (1987). "Growing independence, conflict and learning in mother-infant relations in free-ranging chimpanzees". Behaviour. 101 (1–3): 1–86. doi:10.1163/156853987x00378.
  41. Plooij, Frans X. (2003), Heimann, M. (ed.), The trilogy of mind, vol. Regression periods in human infancy, Mahwah, New Jersey: Erlbaum, pp. 185–205
  42. Plooij, Frans X.; van de Rijt-Plooij, Hetty (1990). "Developmental transitions as successive reorganizations of a control hierarchy". American Behavioral Scientist. 34: 67–80. doi:10.1177/0002764290034001007. S2CID   144183592.
  43. van de Rijt-Plooij, Hetty; Plooij, Frans (October 22, 2013). The Wonder Weeks: How to Stimulate Your Baby's Mental Development and Help Him Turn His 10 Predictable, Great, Fussy Phases into Magical Leaps Forward. Arnhem, Netherlands: Kiddy World Publishing. p. 480. ISBN   978-9491882005.
  44. 1 2 Botvinick, Matthew M. (2008). "Hierarchical models of behavior and prefrontal function". Trends in Cognitive Sciences. 12 (5). Elsevier BV: 201–208. doi:10.1016/j.tics.2008.02.009. ISSN   1364-6613. PMC   2957875 . PMID   18420448.
  45. 1 2 Bedre, Hoffman, Cooney & D'Esposito 2009[ full citation needed ]
  46. Cools, A. R. (1985). "Brain and Behavior: Hierarchy of Feedback Systems and Control of Input". In Bateson, P. P. G.; Klopfer, Peter H. (eds.). Perspectives in Ethology. Boston, MA: Springer US. pp. 109–168. doi:10.1007/978-1-4757-0232-3_5. ISBN   978-1-4757-0234-7.
  47. Marken, Richard S. (Aug 1986). "Perceptual organization of behavior: A hierarchical control model of coordinated action". Journal of Experimental Psychology: Human Perception and Performance. 12 (3): 267–276. doi:10.1037/0096-1523.12.3.267. PMID   2943855.
  48. Powers, William T. (1978). "The Nature of Robots: Part I: Defining Behavior" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 132–144. Archived from the original (PDF) on June 4, 2007.
  49. Powers, William T. (1978). "The Nature of Robots: Part II: Simulated Control Systems" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 134–152. Archived from the original (PDF) on June 4, 2007.
  50. Powers, William T. (1978). " "The Nature of Robots: Part III: A closer look at human behavior". Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 94–116. Archived from the original (PDF) on June 4, 2007.
  51. Powers, William T. (1978). "The Nature of Robots: Part IV: Looking for controlled variables" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 96–112. Archived from the original (PDF) on June 4, 2007.
  52. Young, Rupert (Jun 2017). "A General Architecture for Robotics Systems: A Perception-Based Approach to Artificial Life". Artificial Life. 23 (2): 236–286. doi:10.1162/ARTL_a_00229. PMID   28513206.
  53. Young, Rupert (Feb 27, 2015). HPCT Autonomous Rover (short version) (YouTube). Perceptual Robots.
  54. Young, Rupert (Mar 9, 2016). Robot on a train (YouTube). Perceptual Robots.
  55. Young, Rupert (Jul 1, 2016). Dynamic Visual Robot Arm Control (YouTube). Perceptual Robots.
  56. "Starting on the Right Foot with Reinforcement Learning". bostondynamics.com. Boston Dynamics. March 19, 2024. Retrieved November 1, 2024. The legged robots we've built at Boston Dynamics have historically leveraged Model Predictive Control (MPC), a control strategy that predicts and optimizes the future states of the robot in order to decide what action to take in the moment.
  57. "A perceptual control revolution?". The Psychologist.
  58. The June 1999 Issue of The International Journal of Human-Computer Studies contained papers ranging from tracking through cockpit layout to self-image and crowd dynamics.
  59. PCT lies at the foundation of Component-Based Usability Testing.
  60. For example: McClelland, Kent A. and Thomas J. Fararo, eds. 2006, Purpose, Meaning and Action: Control Systems Theories in Sociology, New York: Palgrave Macmillan. (McClelland is co-author of Chapter 1, "Control Systems Thinking in Sociological Theory," and author of Chapter 2, "Understanding Collective Control Processes."). McClelland, Kent, 2004, "Collective Control of Perception: Constructing Order from Conflict", International Journal of Human-Computer Studies 60:65-99. McPhail, Clark. 1991, The myth of the madding crowd New York: Aldine de Gruyter.
  61. volume-28november-2015 Reports of these groups are available from the NATO Research and Technology Administration publications page: "NATO Research & Technology Organisation Scientific Publications". Archived from the original on 2010-06-23. Retrieved 2010-05-15.> under the titles RTO-TR-030, RTO-TR-IST-021, and RTO-TR-IST-059.
  62. Monaco, Joseph D.; Hwang, Grace M. (27 December 2022). "Neurodynamical Computing at the Information Boundaries of Intelligent Systems". Cognitive Computation. 16 (5): 1–13. doi: 10.1007/s12559-022-10081-9 . PMC   11306504 . PMID   39129840. S2CID   255222711.

Articles

Audio

Videos

Websites