Beta Variational Autoencoders (𝛽-VAE)
  • are variational autoencoders but with a modified loss function
    • 𝐿(πœ™, πœƒ, π‘₯) = (π‘Ÿπ‘’π‘π‘œπ‘›π‘ π‘‘π‘Ÿπ‘’π‘π‘‘π‘–π‘œπ‘› π‘™π‘œπ‘ π‘ ) + 𝛽 * (π‘Ÿπ‘’π‘”π‘’π‘™π‘Žπ‘Ÿπ‘–π‘§π‘Žπ‘‘π‘–π‘œπ‘› π‘‘π‘’π‘Ÿπ‘š)
  • 𝛽>1 - constrains latent bottle neck, encouraging efficient latent encoding β†’ disentanglement