Date Thesis Awarded

5-2023

Access Type

Honors Thesis -- Open Access

Degree Name

Bachelors of Science (BS)

Department

Computer Science

Advisor

Huajie Shao

Committee Members

Qun Li

Daniel Runfola

Abstract

Obtaining disentangled representations is a goal sought after to make A.I. models more interpretable. Studies have proven the impossibility of obtaining these kinds of representations with just unsupervised learning, or in other words, without strong inductive biases. One strong inductive bias is a regularization term that encourages the invariance of factors of variations across an image and a carefully selected augmentation. In this thesis, we build upon the existing Variational Autoencoder (VAE)-based disentanglement literature by utilizing the aforementioned inductive bias. We evaluate our method on the dSprites dataset, a well-known benchmark, and demonstrate its ability to achieve comparable or higher disentanglement in significantly fewer training steps against our model’s unsupervised counterparts.

Recommended Citation

Lee, Joseph S., "kFactorVAE: Self-Supervised Regularization for Better A.I. Disentanglement" (2023). Undergraduate Honors Theses. William & Mary. Paper 2040.
https://scholarworks.wm.edu/honorstheses/2040