Primitive recursive function
In computability theory, a primitive recursive function is, roughly speaking, a function that can be computed by a computer program whose loops are all "for" loops (that is, an upper bound of the number of iterations of every loop is fixed before entering the loop). Primitive recursive functions form a strict subset of those general recursive functions that are also total functions.
The importance of primitive recursive functions lies in the fact that most computable functions that are studied in number theory (and more generally in mathematics) are primitive recursive. For example, addition and division, the factorial and exponential function, and the function which returns the nth prime are all primitive recursive.[1] In fact, for showing that a computable function is primitive recursive, it suffices to show that its time complexity is bounded above by a primitive recursive function of the input size.[2] It is hence not particularly easy to devise a computable function that is not primitive recursive; some examples are shown in section § Limitations below.
The set of primitive recursive functions is known as PR in computational complexity theory.
Definition
[edit]A primitive recursive function takes a fixed number of arguments, each a natural number (nonnegative integer: {0, 1, 2, ...}), and returns a natural number. If it takes n arguments it is called n-ary.
The basic primitive recursive functions are given by these axioms:
- Constant functions : For each natural number and every , the k-ary constant function, defined by , is primitive recursive.
- Successor function: The 1-ary successor function S, which returns the successor of its argument (see Peano postulates), that is, , is primitive recursive.
- Projection functions : For all natural numbers such that , the k-ary function defined by is primitive recursive.
More complex primitive recursive functions can be obtained by applying the operations given by these axioms:
- Composition operator (also called the substitution operator): Given an m-ary function and m k-ary functions : For , the ordinary function composition is obtained.
- Primitive recursion operator : Given the k-ary function and the (k + 2)-ary function :
Interpretation:
The function acts as a for-loop from up to the value of its first argument. The rest of the arguments for , denoted here with , are a set of initial conditions for the for-loop which may be used by it during calculations but which are immutable by it. The functions and on the right-hand side of the equations that define represent the body of the loop, which performs calculations. The function is used only once to perform initial calculations. Calculations for subsequent steps of the loop are performed by . The first parameter of is fed the "current" value of the for-loop's index. The second parameter of is fed the result of the for-loop's previous calculations, from previous steps. The rest of the parameters for are those immutable initial conditions for the for-loop mentioned earlier. They may be used by to perform calculations but they will not themselves be altered by .
The primitive recursive functions are the basic functions and those obtained from the basic functions by applying these operations a finite number of times.
Examples
[edit]- is a 1-ary function which returns for every input: .
- is a 1-ary function which returns for every input: .
- is a 0-ary function, i.e. a constant: .
- is the identity function on the natural numbers: .
- and is the left and right projection on natural number pairs, respectively: and .
- is a 1-ary function that adds 2 to its input, .
- is a 1-ary function which returns 1 for every input: . That is, and are the same function: . In a similar way, every can be expressed as a composition of appropriately many and . Moreover, equals , since . For these reasons, some authors[3] define only for and .
Addition
[edit]A definition of the 2-ary function , to compute the sum of its arguments, can be obtained using the primitive recursion operator . To this end, the well-known equations
are "rephrased in primitive recursive function terminology": In the definition of , the first equation suggests to choose to obtain ; the second equation suggests to choose to obtain . Therefore, the addition function can be defined as . As a computation example,
Doubling
[edit]Given , the 1-ary function doubles its argument, .
Multiplication
[edit]In a similar way as addition, multiplication can be defined by . This reproduces the well-known multiplication equations:
and
Predecessor
[edit]The predecessor function acts as the "opposite" of the successor function and is recursively defined by the rules and . A primitive recursive definition is . As a computation example,
Truncated subtraction
[edit]The limited subtraction function (also called "monus", and denoted "") is definable from the predecessor function. It satisfies the equations
Since the recursion runs over the second argument, we begin with a primitive recursive definition of the reversed subtraction, . Its recursion then runs over the first argument, so its primitive recursive definition can be obtained, similar to addition, as . To get rid of the reversed argument order, then define . As a computation example,
Converting predicates to numeric functions
[edit]In some settings it is natural to consider primitive recursive functions that take as inputs tuples that mix numbers with truth values (that is for true and for false), or that produce truth values as outputs.[4] This can be accomplished by identifying the truth values with numbers in any fixed manner. For example, it is common to identify the truth value with the number and the truth value with the number . Once this identification has been made, the characteristic function of a set , which always returns or , can be viewed as a predicate that tells whether a number is in the set . Such an identification of predicates with numeric functions will be assumed for the remainder of this article.
Predicate "Is zero"
[edit]As an example for a primitive recursive predicate, the 1-ary function shall be defined such that if , and , otherwise. This can be achieved by defining . Then, and e.g. .
Predicate "Less or equal"
[edit]Using the property , the 2-ary function can be defined by . Then if , and , otherwise. As a computation example,
Predicate "Greater or equal"
[edit]Once a definition of is obtained, the converse predicate can be defined as . Then, is true (more precisely: has value 1) if, and only if, .
If-then-else
[edit]The 3-ary if-then-else operator known from programming languages can be defined by . Then, for arbitrary ,
and
- .
That is, returns the then-part, , if the if-part, , is true, and the else-part, , otherwise.
Junctors
[edit]Based on the function, it is easy to define logical junctors. For example, defining , one obtains , that is, is true if, and only if, both and are true (logical conjunction of and ).
Similarly, and lead to appropriate definitions of disjunction and negation: and .
Equality predicate
[edit]Using the above functions , and , the definition implements the equality predicate. In fact, is true if, and only if, equals .
Similarly, the definition implements the predicate "less-than", and implements "greater-than".
Other operations on natural numbers
[edit]Exponentiation and primality testing are primitive recursive. Given primitive recursive functions , , , and , a function that returns the value of when and the value of otherwise is primitive recursive.
Operations on integers and rational numbers
[edit]By using Gödel numberings, the primitive recursive functions can be extended to operate on other objects such as integers and rational numbers. If integers are encoded by Gödel numbers in a standard way, the arithmetic operations including addition, subtraction, and multiplication are all primitive recursive. Similarly, if the rationals are represented by Gödel numbers then the field operations are all primitive recursive.
Some common primitive recursive functions
[edit]The following examples and definitions are from Kleene (1952) pp. 223–231. Many appear with proofs. Most also appear with similar names, either as proofs or as examples, in Boolos-Burgess-Jeffrey 2002 pp. 63–70; they add the logarithm lo(x, y) or lg(x, y) depending on the exact derivation.
In the following the mark " ' ", e.g. a', is the primitive mark meaning "the successor of", usually thought of as " +1", e.g. a +1 =def a'. The functions 16–20 and #G are of particular interest with respect to converting primitive recursive predicates to, and extracting them from, their "arithmetical" form expressed as Gödel numbers.
- Addition: a+b
- Multiplication: a×b
- Exponentiation: ab
- Factorial a! : 0! = 1, a'! = a!×a'
- pred(a): (Predecessor or decrement): If a > 0 then a−1 else 0
- Proper subtraction a ∸ b: If a ≥ b then a−b else 0
- Minimum(a1, ... an)
- Maximum(a1, ... an)
- Absolute difference: | a−b | =def (a ∸ b) + (b ∸ a)
- ~sg(a): NOT[signum(a)]: If a=0 then 1 else 0
- sg(a): signum(a): If a=0 then 0 else 1
- a | b: (a divides b): If b=k×a for some k then 0 else 1
- Remainder(a, b): the leftover if b does not divide a "evenly". Also called MOD(a, b)
- a = b: sg | a − b | (Kleene's convention was to represent true by 0 and false by 1; presently, especially in computers, the most common convention is the reverse, namely to represent true by 1 and false by 0, which amounts to changing sg into ~sg here and in the next item)
- a < b: sg( a' ∸ b )
- Pr(a): a is a prime number Pr(a) =def a>1 & NOT(Exists c)1<c<a [ c|a ]
- pi: the i+1th prime number
- (a)i: exponent of pi in a: the unique x such that pix|a & NOT(pix'|a)
- lh(a): the "length" or number of non-vanishing exponents in a
- lo(a, b): (logarithm of a to base b): If a, b > 1 then the greatest x such that bx | a else 0
- In the following, the abbreviation x =def x1, ... xn; subscripts may be applied if the meaning requires.
- #A: A function φ definable explicitly from functions Ψ and constants q1, ... qn is primitive recursive in Ψ.
- #B: The finite sum Σy<z ψ(x, y) and product Πy<zψ(x, y) are primitive recursive in ψ.
- #C: A predicate P obtained by substituting functions χ1,..., χm for the respective variables of a predicate Q is primitive recursive in χ1,..., χm, Q.
- #D: The following predicates are primitive recursive in Q and R:
- NOT_Q(x) .
- Q OR R: Q(x) V R(x),
- Q AND R: Q(x) & R(x),
- Q IMPLIES R: Q(x) → R(x)
- Q is equivalent to R: Q(x) ≡ R(x)
- #E: The following predicates are primitive recursive in the predicate R:
- (Ey)y<z R(x, y) where (Ey)y<z denotes "there exists at least one y that is less than z such that"
- (y)y<z R(x, y) where (y)y<z denotes "for all y less than z it is true that"
- μyy<z R(x, y). The operator μyy<z R(x, y) is a bounded form of the so-called minimization- or mu-operator: Defined as "the least value of y less than z such that R(x, y) is true; or z if there is no such value."
- #F: Definition by cases: The function defined thus, where Q1, ..., Qm are mutually exclusive predicates (or "ψ(x) shall have the value given by the first clause that applies), is primitive recursive in φ1, ..., Q1, ... Qm:
- φ(x) =
- φ1(x) if Q1(x) is true,
- . . . . . . . . . . . . . . . . . . .
- φm(x) if Qm(x) is true
- φm+1(x) otherwise
- φ(x) =
- #G: If φ satisfies the equation:
- φ(y,x) = χ(y, COURSE-φ(y; x2, ... xn ), x2, ... xn then φ is primitive recursive in χ. The value COURSE-φ(y; x2 to n ) of the course-of-values function encodes the sequence of values φ(0,x2 to n), ..., φ(y-1,x2 to n) of the original function.
Relationship to recursive functions
[edit]The broader class of partial recursive functions is defined by introducing an unbounded search operator. The use of this operator may result in a partial function, that is, a relation with at most one value for each argument, but does not necessarily have any value for any argument (see domain). An equivalent definition states that a partial recursive function is one that can be computed by a Turing machine. A total recursive function is a partial recursive function that is defined for every input.
Every primitive recursive function is total recursive, but not all total recursive functions are primitive recursive. The Ackermann function A(m,n) is a well-known example of a total recursive function (in fact, provable total), that is not primitive recursive. There is a characterization of the primitive recursive functions as a subset of the total recursive functions using the Ackermann function. This characterization states that a function is primitive recursive if and only if there is a natural number m such that the function can be computed by a Turing machine that always halts within A(m,n) or fewer steps, where n is the sum of the arguments of the primitive recursive function.[5]
An important property of the primitive recursive functions is that they are a recursively enumerable subset of the set of all total recursive functions (which is not itself recursively enumerable). This means that there is a single computable function f(m,n) that enumerates the primitive recursive functions, namely:
- For every primitive recursive function g, there is an m such that g(n) = f(m,n) for all n, and
- For every m, the function h(n) = f(m,n) is primitive recursive.
f can be explicitly constructed by iteratively repeating all possible ways of creating primitive recursive functions. Thus, it is provably total. One can use a diagonalization argument to show that f is not recursive primitive in itself: had it been such, so would be h(n) = f(n,n)+1. But if this equals some primitive recursive function, there is an m such that h(n) = f(m,n) for all n, and then h(m) = f(m,m), leading to contradiction.
However, the set of primitive recursive functions is not the largest recursively enumerable subset of the set of all total recursive functions. For example, the set of provably total functions (in Peano arithmetic) is also recursively enumerable, as one can enumerate all the proofs of the theory. While all primitive recursive functions are provably total, the converse is not true.
Limitations
[edit]Primitive recursive functions tend to correspond very closely with our intuition of what a computable function must be. Certainly the initial functions are intuitively computable (in their very simplicity), and the two operations by which one can create new primitive recursive functions are also very straightforward. However, the set of primitive recursive functions does not include every possible total computable function—this can be seen with a variant of Cantor's diagonal argument. This argument provides a total computable function that is not primitive recursive. A sketch of the proof is as follows:
Now define the "evaluator function" with two arguments, by . Clearly is total and computable, since one can effectively determine the definition of , and being a primitive recursive function is itself total and computable, so is always defined and effectively computable. However a diagonal argument will show that the function of two arguments is not primitive recursive.
Suppose were primitive recursive, then the unary function defined by would also be primitive recursive, as it is defined by composition from the successor function and . But then occurs in the enumeration, so there is some number such that . But now gives a contradiction.This argument can be applied to any class of computable (total) functions that can be enumerated in this way, as explained in the article Machine that always halts. Note however that the partial computable functions (those that need not be defined for all arguments) can be explicitly enumerated, for instance by enumerating Turing machine encodings.
Other examples of total recursive but not primitive recursive functions are known:
- The function that takes m to Ackermann(m,m) is a unary total recursive function that is not primitive recursive.
- The Paris–Harrington theorem involves a total recursive function that is not primitive recursive.
- The Sudan function
- The Goodstein function
Variants
[edit]Constant functions
[edit]Instead of , alternative definitions use just one 0-ary zero function as a primitive function that always returns zero, and built the constant functions from the zero function, the successor function and the composition operator.
Weak primitive recursion
[edit]The 1-place predecessor function is primitive recursive, see section #Predecessor. Fischer, Fischer & Beigel[6] removed the implicit predecessor from the recursion rule, replacing it by the weaker rule
They proved that the predecessor function still could be defined, and hence that "weak" primitive recursion also defines the primitive recursive functions.
Iterative functions
[edit]Weakening this even further by using functions of arity k+1, removing and from the arguments of completely, we get the iteration rule:
The class of iterative functions is defined the same way as the class of primitive recursive functions except with this weaker rule. These are conjectured to be a proper subset of the primitive recursive functions.[6]
Additional primitive recursive forms
[edit]Some additional forms of recursion also define functions that are in fact primitive recursive. Definitions in these forms may be easier to find or more natural for reading or writing. Course-of-values recursion defines primitive recursive functions. Some forms of mutual recursion also define primitive recursive functions.
The functions that can be programmed in the LOOP programming language are exactly the primitive recursive functions. This gives a different characterization of the power of these functions. The main limitation of the LOOP language, compared to a Turing-complete language, is that in the LOOP language the number of times that each loop will run is specified before the loop begins to run.
Computer language definition
[edit]An example of a primitive recursive programming language is one that contains basic arithmetic operators (e.g. + and −, or ADD and SUBTRACT), conditionals and comparison (IF-THEN, EQUALS, LESS-THAN), and bounded loops, such as the basic for loop, where there is a known or calculable upper bound to all loops (FOR i FROM 1 TO n, with neither i nor n modifiable by the loop body). No control structures of greater generality, such as while loops or IF-THEN plus GOTO, are admitted in a primitive recursive language.
The LOOP language, introduced in a 1967 paper by Albert R. Meyer and Dennis M. Ritchie,[7] is such a language. Its computing power coincides with the primitive recursive functions. A variant of the LOOP language is Douglas Hofstadter's BlooP in Gödel, Escher, Bach. Adding unbounded loops (WHILE, GOTO) makes the language general recursive and Turing-complete, as are all real-world computer programming languages.
The definition of primitive recursive functions implies that their computation halts on every input (after a finite number of steps). On the other hand, the halting problem is undecidable for general recursive functions.
Finitism and consistency results
[edit]The primitive recursive functions are closely related to mathematical finitism, and are used in several contexts in mathematical logic where a particularly constructive system is desired. Primitive recursive arithmetic (PRA), a formal axiom system for the natural numbers and the primitive recursive functions on them, is often used for this purpose.
PRA is much weaker than Peano arithmetic, which is not a finitistic system. Nevertheless, many results in number theory and in proof theory can be proved in PRA. For example, Gödel's incompleteness theorem can be formalized into PRA, giving the following theorem:
- If T is a theory of arithmetic satisfying certain hypotheses, with Gödel sentence GT, then PRA proves the implication Con(T)→GT.
Similarly, many of the syntactic results in proof theory can be proved in PRA, which implies that there are primitive recursive functions that carry out the corresponding syntactic transformations of proofs.
In proof theory and set theory, there is an interest in finitistic consistency proofs, that is, consistency proofs that themselves are finitistically acceptable. Such a proof establishes that the consistency of a theory T implies the consistency of a theory S by producing a primitive recursive function that can transform any proof of an inconsistency from S into a proof of an inconsistency from T. One sufficient condition for a consistency proof to be finitistic is the ability to formalize it in PRA. For example, many consistency results in set theory that are obtained by forcing can be recast as syntactic proofs that can be formalized in PRA.
History
[edit]Recursive definitions had been used more or less formally in mathematics before, but the construction of primitive recursion is traced back to Richard Dedekind's theorem 126 of his Was sind und was sollen die Zahlen? (1888). This work was the first to give a proof that a certain recursive construction defines a unique function.[8][9][10]
Primitive recursive arithmetic was first proposed by Thoralf Skolem[11] in 1923.
The current terminology was coined by Rózsa Péter (1934) after Ackermann had proved in 1928 that the function which today is named after him was not primitive recursive, an event which prompted the need to rename what until then were simply called recursive functions.[9][10]
See also
[edit]- Grzegorczyk hierarchy
- Recursion (computer science)
- Primitive recursive functional
- Double recursion
- Primitive recursive set function
- Primitive recursive ordinal function
- Tail call
Notes
[edit]- ^ Brainerd and Landweber, 1974
- ^ Hartmanis, 1989
- ^ E.g.: Henk Barendregt (1990). "Functional Programming and Lambda Calculus". In Jan van Leeuwen (ed.). Formal Models and Semantics. Handbook of Theoretical Computer Science. Vol. B. Elsevier. pp. 321–364. ISBN 0-444-88074-7. Here: 2.2.6 initial functions, Def.2.2.7 primitive recursion, p.331-332.
- ^ Kleene [1952 pp. 226–227]
- ^ This follows from the facts that the functions of this form are the most quickly growing primitive recursive functions, and that a function is primitive recursive if and only if its time complexity is bounded by a primitive recursive function. For the former, see Linz, Peter (2011), An Introduction to Formal Languages and Automata, Jones & Bartlett Publishers, p. 332, ISBN 9781449615529. For the latter, see Moore, Cristopher; Mertens, Stephan (2011), The Nature of Computation, Oxford University Press, p. 287, ISBN 9780191620805
- ^ a b Fischer, Fischer & Beigel 1989.
- ^ Meyer, Albert R.; Ritchie, Dennis M. (1967). The complexity of loop programs. ACM '67: Proceedings of the 1967 22nd national conference. doi:10.1145/800196.806014.
- ^ Peter Smith (2013). An Introduction to Gödel's Theorems (2nd ed.). Cambridge University Press. pp. 98–99. ISBN 978-1-107-02284-3.
- ^ a b George Tourlakis (2003). Lectures in Logic and Set Theory: Volume 1, Mathematical Logic. Cambridge University Press. p. 129. ISBN 978-1-139-43942-8.
- ^ a b Rod Downey, ed. (2014). Turing's Legacy: Developments from Turing's Ideas in Logic. Cambridge University Press. p. 474. ISBN 978-1-107-04348-0.
- ^ Thoralf Skolem (1923) "The foundations of elementary arithmetic" in Jean van Heijenoort, translator and ed. (1967) From Frege to Gödel: A Source Book in Mathematical Logic, 1879-1931. Harvard Univ. Press: 302-33.
References
[edit]- Brainerd, W.S., Landweber, L.H. (1974), Theory of Computation, Wiley, ISBN 0-471-09585-0
- Fischer, Michael J.; Fischer, Robert P.; Beigel, Richard (November 1989). "Primitive Recursion without Implicit Predecessor". ACM SIGACT News. 20 (4): 87–91. doi:10.1145/74074.74089. S2CID 33850327.
- Juris Hartmanis (1989), “Overview of computational Complexity Theory” in J. Hartmanis (ed.), Computational Complexity Theory, Providence: American Mathematical Society, pp. 1–17.
- Robert I. Soare, Recursively Enumerable Sets and Degrees, Springer-Verlag, 1987. ISBN 0-387-15299-7
- Stephen Kleene (1952) Introduction to Metamathematics, North-Holland Publishing Company, New York, 11th reprint 1971: (2nd edition notes added on 6th reprint). In Chapter XI. General Recursive Functions §57
- George Boolos, John Burgess, Richard Jeffrey (2002), Computability and Logic: Fourth Edition, Cambridge University Press, Cambridge, UK. Cf pp. 70–71.
- Robert I. Soare 1995 Computability and Recursion http://www.people.cs.uchicago.edu/~soare/History/compute.pdf
- Daniel Severin 2008, Unary primitive recursive functions, J. Symbolic Logic Volume 73, Issue 4, pp. 1122–1138 arXiv projecteuclid doi:10.2178/jsl/1230396909 JSTOR 275903221