Norm
Contents
Definition
A norm on a vector space [ilmath](V,F)[/ilmath] is a function [math]\|\cdot\|:V\rightarrow\mathbb{R}[/math] such that:
- [math]\forall x\in V\ \|x\|\ge 0[/math]
- [math]\|x\|=0\iff x=0[/math]
- [math]\forall \lambda\in F, x\in V\ \|\lambda x\|=|\lambda|\|x\|[/math] where [math]|\cdot|[/math] denotes absolute value
- [math]\forall x,y\in V\ \|x+y\|\le\|x\|+\|y\|[/math] - a form of the triangle inequality
Often parts 1 and 2 are combined into the statement
- [math]\|x\|\ge 0\text{ and }\|x\|=0\iff x=0[/math] so only 3 requirements will be stated.
I don't like this
Examples
The Euclidean Norm
The Euclidean norm is denoted [math]\|\cdot\|_2[/math]
Here for [math]x\in\mathbb{R}^n[/math] we have:
[math]\|x\|_2=\sqrt{\sum^n_{i=1}x_i^2}[/math]
Proof that it is a norm
TODO: proof
Part 4 - Triangle inequality
Let [math]x,y\in\mathbb{R}^n[/math]
[math]\|x+y\|_2^2=\sum^n_{i=1}(x_i+y_i)^2[/math] [math]=\sum^n_{i=1}x_i^2+2\sum^n_{i=1}x_iy_i+\sum^n_{i=1}y_i^2[/math] [math]\le\sum^n_{i=1}x_i^2+2\sqrt{\sum^n_{i=1}x_i^2}\sqrt{\sum^n_{i=1}y_i^2}+\sum^n_{i=1}y_i^2[/math] using the Cauchy-Schwarz inequality
[math]=\left(\sqrt{\sum^n_{i=1}x_i^2}+\sqrt{\sum^n_{i=1}y_i^2}\right)^2[/math] [math]=\left(\|x\|_2+\|y\|_2\right)^2[/math]
Thus we see: [math]\|x+y\|_2^2\le\left(\|x\|_2+\|y\|_2\right)^2[/math], as norms are always [math]\ge 0[/math] we see:
[math]\|x+y\|_2\le\|x\|_2+\|y\|_2[/math] - as required.