The dual divergence 𝐷* is defined as:

  • 𝐷*(𝑝,𝑞) = 𝐷(𝑞,𝑝)

When we wish to contrast 𝐷 against 𝐷*, we refer to 𝐷 as primal divergence