Norms - Semi-Norms
  • given a vector space (𝑉,𝐹), a norm/semi-norm (||·||) is a real-valued [[Continuous/Continuity [at a point - everywhere] (Transformations/Operations/Operations/Mappings/Maps/Functions/Morphisms)|continuous function]] on 𝑉 that takes in a vector from 𝑉 and outputs a non-negative real number (i.e. ||·||: 𝑉 → ℝ+)
  • a vector space with a norm is called a normed vector space
  • used to measure the length of a vector
  • an inner product (⟨·,·⟩) induces a norm (||·||⟨·,·⟩) defined as: ||·||⟨·,·⟩ = √⟨·,·⟩
  • norm (||·||)induces a distance metric (𝑑||·||) defined as: 𝑑||·||(𝑥,𝑦) = ||𝑥-𝑦||

Norm - Semi-Norm - Definitions

Properties

Norm

REQUIRED

REQUIRED

IMPLIED

REQUIRED

Semi-Norm

REQUIRED

REQUIRED

IMPLIED

Types of Vector Norms

Type

Category

Input

Description

Relationships Between Lp Vector Norms

L0 “Norm”

FAILS HOMOGENEITY

vector

  • 𝐿0 = ||𝑣̅||0 = 𝛴1≤𝑖≤𝑛|𝑣̅𝑖|0(where 00 = 0)

Absolute Norm

NORM

vector

  • 𝐿1 = ||𝑣̅||1 = 𝛴1≤𝑖≤𝑛|𝑣̅𝑖|

Euclidean Norm

NORM

vector

  • 𝐿2 = ||𝑣̅||2 = ||𝑣̅|| = [ 𝛴1≤𝑖≤𝑛(𝑣̅𝑖)2 ](1/2)
  • ||𝑣̅||2 ≤ ||𝑣̅||1

Minkowski Norm

NORM

vector

  • 𝐿𝑝 = ||𝑣̅||𝑝 = [ 𝛴1≤𝑖≤𝑛|𝑣̅𝑖|𝑝 ](1/𝑝)
  • ||𝑣̅||𝑝+1 ≤ ||𝑣̅||𝑝

Tchebychev Norm

NORM

vector

  • 𝐿 = ||𝑣̅|| = [ 𝛴1≤𝑖≤𝑛|𝑣̅𝑖| ](1/∞) = 𝑚𝑎𝑥(|𝑣̅𝑖|)
  • ||𝑣̅|| ≤ ||𝑣̅||𝑝

Types of Matrix Norms

Type

Category

Input

Description

Matrix Lpq Norm

NORM

matrices

  • 𝐿𝑝𝑞 = ||𝐴||𝑝𝑞= (𝛴𝑗(𝛴𝑖|𝐴𝑖𝑗|𝑝)(𝑞/𝑝))(1/𝑞)

Matrix L11/Absolute Norm

NORM

matrices

  • 𝐿11 = ||𝐴||11 = (𝛴𝑗(𝛴𝑖|𝐴𝑖𝑗|1)(1/1))(1/1) = 𝛴𝑖𝑗|𝐴𝑖𝑗|

Matrix L22L𝐹Frobenius Norm

NORM

matrices

  • 𝐿22 = ||𝐴||22 = (𝛴𝑗(𝛴𝑖|𝐴𝑖𝑗|2)(2/2))(1/2)= [𝛴𝑖𝑗|𝐴𝑖𝑗|2](1/2) = 𝐿𝐹

Matrix L∞∞/Max/Tchebychev Norm

NORM

matrices

  • 𝐿∞∞ = ||𝐴||∞∞ = (𝛴𝑗(𝛴𝑖|𝐴𝑖𝑗|)(∞/∞))(1/∞) = 𝑚𝑎𝑥(𝐴𝑖𝑗)

Operator Norm

NORM

matrices

  • informally, the operator norm ‖𝐿‖𝑜𝑝 of a linear operator 𝐿: 𝑋→𝑌 is the maximum factor by which it “lengthens” vectors

Spectral Norm

NORM

matrices

  • TODO

Types of Other Norms

Type

Category

Input

Description

Supremum Norm - Sup Norm - Uniform Norm

NORM

depends

  • ||𝑓|| = ||𝑓||∞,𝑆 = 𝑠𝑢𝑝{|𝑓(𝑠)| : 𝑠∊𝑆}

Inner Product Norm

NORM

depends

Constant 0 Map

SEMI-NORM

anything

  • the trivial semi-norm on 𝑉 which refers to the constant 0 map on 𝑉