Normed vector space

In mathematics, with 2- or 3-dimensional vectors with real-valued entries, the idea of the "length" of a vector is intuitive and can be easily extended to any real vector space Rⁿ. It turns out that the following properties of "vector length" are the crucial ones.

a vector always has a strictly positive length. The only exception is the zero vector which has length zero.
multiplying a vector by a number has the same effect on the length.
the triangle inequality, which amounts roughly to saying that the distance from A to B to C is never shorter than going directly from A to C.

Their generalization for more abstract vector spaces, leads to the notion of norm. A vector space on which a norm is defined is then called a normed vector space.

If V is a vector space over a field K (which must be either the real numbers or the complex numbers), a norm on V is a function from V to R, the real numbers — that is, it associates to each vector v in V a real number, which is usually denoted ||v||. The norm must satisfy the following conditions:

For all a in K and all u and v in V,

1. ||v|| ≥ 0 with equality if and only if v = 0.

2. ||av|| = |a| ||v||.

3. ||u + v|| ≤ ||u|| + ||v||.

Most of property 1 follows from the other axioms, and in fact it can be replaced by the following condition:

1'. ||v|| is non-zero if and only if v is non-zero.

A useful consequence of the norm axioms is the inequality

||u ± v|| ≥ | ||u|| - ||v|| |

for all vectors u and v.

Table of contents

1 Examples of norms

1.1 Euclidean norm
1.2 Taxicab norm or Manhattan norm
1.3 p-norm
1.4 Infinity norm or maximum norm
1.5 Other norms

2 Distances in normed vector spaces
3 Finite-dimensional normed vector spaces
4 Linear maps and dual spaces
5 See also

Examples of norms

Euclidean norm

On Rⁿ, the intuitive notion of length of the vector x = (x₁, x₂, ..., x_n) is captured by the formula

This gives the ordinary distance from the origin to the point x, a consequence of the Pythagorean theorem. The Euclidean norm is by far the most commonly used norm on Rⁿ, but there are other norms on this vector space as will be shown below.

Taxicab norm or Manhattan norm

The name comes from the fact that the norm gives the distance a taxi has to drive in a rectangular street grid to get from the origin to the point x.

Image:Vector_norms.png

Illustrations of unit circles in different norms.

p-norm

Let p≥1 be a real number.

Note that for p=1 we get the taxicab norm and for p=2 we get the Euclidean norm. See also L^p space.

Infinity norm or maximum norm

The concept of unit circle (the set of all vectors of norm 1) is different in different norms: for the 1-norm the unit circle in R² is a rhomboid, for the 2-norm (Euclidean norm) it is the well-known unit circle, while for the infinity norm it is a square. See the accompanying illustration.

Other norms

Other norms on Rⁿ can be constructed by combining the above; for example

is a norm on R⁴.

All the above formulas also yield norms on Cⁿ without modification.

Examples of infinite dimensional normed vector spaces can be found in the Banach space article. In addition, inner product space becomes a normed vector space if we define the norm as

Distances in normed vector spaces

For any normed vector space we can define the distance between two vectors u and v as ||u-v||. (Note that the Euclidean norm gives rise to the Euclidean distance in this fashion.) This turns the normed space into a metric space and allows the definition of notions such as continuity and convergence. The norm is then a continuous map. If this metric space is complete then the normed space is called a Banach space. Every normed vector space V sits as a dense subspace inside a Banach space; this Banach space is essentially uniquely defined by V and is called the completion of V.

Two norms ||.||₁ and ||.||₂ on a vector space V are called equivalent if there exist positive real numbers C and D such that

for all x in V. In this case, the two norms define the same notions of continuity and convergence and do not need to be distinguished for most purposes.

Finite-dimensional normed vector spaces

All norms on a finite-dimensional vector space V are equivalent. Since Euclidean space is complete, we can thus conclude that all finite-dimensional normed vector spaces are Banach spaces.

A normed vector space V is finite-dimensional if and only if the unit ball B = {x : ||x|| ≤ 1} is compact, which is the case if and only if V is locally compact.

Linear maps and dual spaces

The most important maps between two normed vector spaces are the continuous linear maps. Together with these maps, normed vector spaces form a category. An isometry between two normed vector spaces is a linear map f which preserves the norm (meaning ||f(v)|| = ||v|| for all vectors v). Isometries are always continuous and injective. A surjective isometry between the normed vector spaces V and W is called a isometric isomorphism, and V and W are called isometrically isomorphic. Isometrically isomorphic normed vector spaces are identical for all practical purposes.

When speaking of normed vector spaces, we augment the notion of dual space to take the norm into account. The dual V ' of a normed vector space V is the space of all continuous linear maps from V to the base field (the complexes or the reals) — such linear maps are called "functionals". The norm of a functional φ is defined as the supremum of |φ(v)| where v ranges over all unit vectors (i.e. vectors of norm 1) in V. This turns V ' into a normed vector space. An important theorem about continuous linear functionals on normed vector spaces is the Hahn-Banach theorem.