Signum function ${\displaystyle y=\operatorname {sgn} x}$

In mathematics, the sign function or signum function (from signum, Latin for "sign") is a function that returns the sign of a real number. In mathematical notation the sign function is often represented as ${\displaystyle \operatorname {sgn}(x)}$.^[1]

Definition

The signum function of a real number ${\displaystyle x}$ is a piecewise function which is defined as follows:^[1]

$${\displaystyle \operatorname {sgn} x:={\begin{cases}-1&{\text{if }}x<0,\\0&{\text{if }}x=0,\\1&{\text{if }}x>0.\end{cases}}}$$

Properties

The sign function is not continuous at ${\displaystyle x=0}$.

Any real number can be expressed as the product of its absolute value and its sign function:

$${\displaystyle x=|x|\operatorname {sgn} x.}$$

It follows that whenever ${\displaystyle x}$ is not equal to 0 we have

$${\displaystyle \operatorname {sgn} x={\frac {x}{|x|}}={\frac {|x|}{x}}\,.}$$

Similarly, for any real number ${\displaystyle x}$,

$${\displaystyle |x|=x\operatorname {sgn} x.}$$

We can also ascertain that:

$${\displaystyle \operatorname {sgn} x^{n}=(\operatorname {sgn} x)^{n}.}$$

The signum function is the derivative of the absolute value function, up to (but not including) the indeterminacy at zero. More formally, in integration theory it is a weak derivative, and in convex function theory the subdifferential of the absolute value at 0 is the interval ${\displaystyle [-1,1]}$, "filling in" the sign function (the subdifferential of the absolute value is not single-valued at 0). Note, the resultant power of ${\displaystyle x}$ is 0, similar to the ordinary derivative of ${\displaystyle x}$. The numbers cancel and all we are left with is the sign of ${\displaystyle x}$.

$${\displaystyle {\frac {{\text{d}}|x|}{{\text{d}}x}}=\operatorname {sgn} x{\text{ for }}x\neq 0\,.}$$

The signum function is differentiable with derivative 0 everywhere except at 0. It is not differentiable at 0 in the ordinary sense, but under the generalised notion of differentiation in distribution theory, the derivative of the signum function is two times the Dirac delta function, which can be demonstrated using the identity ^[2]

$${\displaystyle \operatorname {sgn} x=2H(x)-1\,,}$$

where ${\displaystyle H(x)}$ is the Heaviside step function using the standard ${\displaystyle H(0)={\frac {1}{2}}}$ formalism. Using this identity, it is easy to derive the distributional derivative:^[3]

$${\displaystyle {\frac {{\text{d}}\operatorname {sgn} x}{{\text{d}}x}}=2{\frac {{\text{d}}H(x)}{{\text{d}}x}}=2\delta (x)\,.}$$

The Fourier transform of the signum function is^[4]

$${\displaystyle \int _{-\infty }^{\infty }(\operatorname {sgn} x)e^{-ikx}{\text{d}}x=PV{\frac {2}{ik}},}$$

where ${\displaystyle PV}$ means taking the Cauchy principal value.

The signum can also be written using the Iverson bracket notation:

$${\displaystyle \operatorname {sgn} x=-[x<0]+[x>0]\,.}$$

The signum can also be written using the floor and the absolute value functions:

$${\displaystyle \operatorname {sgn} x={\Biggl \lfloor }{\frac {x}{|x|+1}}{\Biggr \rfloor }-{\Biggl \lfloor }{\frac {-x}{|x|+1}}{\Biggr \rfloor }\,.}$$

The signum function has a very simple definition if ${\displaystyle 0^{0}}$ is accepted to be equal to 1. Then signum can be written for all real numbers as

$${\displaystyle \operatorname {sgn} x=0^{\left(-x+\left\vert x\right\vert \right)}-0^{\left(x+\left\vert x\right\vert \right)}\,.}$$

The signum function coincides with the limits

$${\displaystyle \operatorname {sgn} x=\lim _{n\to \infty }{\frac {1-2^{-nx}}{1+2^{-nx}}}\,.}$$

and

$${\displaystyle \operatorname {sgn} x=\lim _{n\to \infty }{\frac {2}{\pi }}{\rm {arctan}}(nx)\,=\lim _{n\to \infty }{\frac {2}{\pi }}\tan ^{-1}(nx)\,.}$$

as well as,

$${\displaystyle \operatorname {sgn} x=\lim _{n\to \infty }\tanh(nx)\,.}$$

Here, ${\displaystyle \tanh(x)}$ is the Hyperbolic tangent and the superscript of -1, above it, is shorthand notation for the inverse function of the Trigonometric function, tangent.

For ${\displaystyle k>1}$, a smooth approximation of the sign function is

$${\displaystyle \operatorname {sgn} x\approx \tanh kx\,.}$$

Another approximation is

$${\displaystyle \operatorname {sgn} x\approx {\frac {x}{\sqrt {x^{2}+\varepsilon ^{2}}}}\,.}$$

which gets sharper as ${\displaystyle \varepsilon \to 0}$; note that this is the derivative of ${\displaystyle {\sqrt {x^{2}+\varepsilon ^{2}}}}$. This is inspired from the fact that the above is exactly equal for all nonzero ${\displaystyle x}$ if ${\displaystyle \varepsilon =0}$, and has the advantage of simple generalization to higher-dimensional analogues of the sign function (for example, the partial derivatives of ${\displaystyle {\sqrt {x^{2}+y^{2}}}}$).

See Heaviside step function § Analytic approximations.

Complex signum

The signum function can be generalized to complex numbers as:

$${\displaystyle \operatorname {sgn} z={\frac {z}{|z|}}}$$

for any complex number ${\displaystyle z}$ except ${\displaystyle z=0}$. The signum of a given complex number ${\displaystyle z}$ is the point on the unit circle of the complex plane that is nearest to ${\displaystyle z}$. Then, for ${\displaystyle z\neq 0}$,

$${\displaystyle \operatorname {sgn} z=e^{i\arg z}\,,}$$

where ${\displaystyle \arg }$ is the complex argument function.

For reasons of symmetry, and to keep this a proper generalization of the signum function on the reals, also in the complex domain one usually defines, for ${\displaystyle z=0}$:

$${\displaystyle \operatorname {sgn}(0+0i)=0}$$

Another generalization of the sign function for real and complex expressions is ${\displaystyle {\text{csgn}}}$,^[5] which is defined as:

$${\displaystyle \operatorname {csgn} z={\begin{cases}1&{\text{if }}\mathrm {Re} (z)>0,\\-1&{\text{if }}\mathrm {Re} (z)<0,\\\operatorname {sgn} \mathrm {Im} (z)&{\text{if }}\mathrm {Re} (z)=0\end{cases}}}$$

where ${\displaystyle {\text{Re}}(z)}$ is the real part of ${\displaystyle z}$ and ${\displaystyle {\text{Im}}(z)}$ is the imaginary part of ${\displaystyle z}$.

We then have (for ${\displaystyle z\neq 0}$):

$${\displaystyle \operatorname {csgn} z={\frac {z}{\sqrt {z^{2}}}}={\frac {\sqrt {z^{2}}}{z}}.}$$

Generalized signum function

At real values of ${\displaystyle x}$, it is possible to define a generalized function–version of the signum function, ${\displaystyle \varepsilon (x)}$ such that ${\displaystyle \varepsilon (x)^{2}=1}$ everywhere, including at the point ${\displaystyle x=0}$, unlike ${\displaystyle \operatorname {sgn} }$, for which ${\displaystyle (\operatorname {sgn} 0)^{2}=0}$. This generalized signum allows construction of the algebra of generalized functions, but the price of such generalization is the loss of commutativity. In particular, the generalized signum anticommutes with the Dirac delta function^[6]

$${\displaystyle \varepsilon (x)\delta (x)+\delta (x)\varepsilon (x)=0\,;}$$

in addition, ${\displaystyle \varepsilon (x)}$ cannot be evaluated at ${\displaystyle x=0}$; and the special name, ${\displaystyle \varepsilon }$ is necessary to distinguish it from the function ${\displaystyle \operatorname {sgn} }$. (${\displaystyle \varepsilon (0)}$ is not defined, but ${\displaystyle \operatorname {sgn} 0=0}$.)

Generalization to matrices

Thanks to the Polar decomposition theorem, a matrix ${\displaystyle {\boldsymbol {A}}\in \mathbb {K} ^{n\times n}}$ (${\displaystyle n\in \mathbb {N} }$ and ${\displaystyle \mathbb {K} \in \{\mathbb {R} ,\mathbb {C} \}}$) can be decomposed as a product ${\displaystyle {\boldsymbol {Q}}{\boldsymbol {P}}}$ where ${\displaystyle {\boldsymbol {Q}}}$ is a unitary matrix and ${\displaystyle {\boldsymbol {P}}}$ is a self-adjoint, or Hermitian, positive definite matrix, both in ${\displaystyle \mathbb {K} ^{n\times n}}$. If ${\displaystyle {\boldsymbol {A}}}$ is invertible then such a decomposition is unique and ${\displaystyle {\boldsymbol {Q}}}$ plays the role of ${\displaystyle {\boldsymbol {A}}}$'s signum. A dual construction is given by the decomposition ${\displaystyle {\boldsymbol {A}}={\boldsymbol {S}}{\boldsymbol {R}}}$ where ${\displaystyle {\boldsymbol {R}}}$ is unitary, but generally different than ${\displaystyle {\boldsymbol {Q}}}$. This leads to each invertible matrix having a unique left-signum ${\displaystyle {\boldsymbol {Q}}}$ and right-signum ${\displaystyle {\boldsymbol {R}}}$.

In the special case where ${\displaystyle \mathbb {K} =\mathbb {R} ,\ n=2,}$ and the (invertible) matrix ${\displaystyle {\boldsymbol {A}}=\left[{\begin{array}{rr}a&-b\\b&a\end{array}}\right]}$, which identifies with the (nonzero) complex number ${\displaystyle a+\mathrm {i} b=c}$, then the signum matrices satisfy ${\displaystyle {\boldsymbol {Q}}={\boldsymbol {P}}=\left[{\begin{array}{rr}a&-b\\b&a\end{array}}\right]/|c|}$ and identify with the complex signum of ${\displaystyle c}$, ${\displaystyle \operatorname {sgn} c=c/|c|}$. In this sense, polar decomposition generalizes to matrices the signum-modulus decomposition of complex numbers.

See also

• Absolute value
• Heaviside function
• Negative number
• Rectangular function
• Sigmoid function (Hard sigmoid)
• Step function (Piecewise constant function)
• Three-way comparison
• Zero crossing
• Polar decomposition

Notes