Slot Attention with Optimal Transport
To discover objects without having an explicit model for them, Slot Attention is a very powerful technique. Yet, it may have trouble with separating objects (into different ‘slots’), when they are highly similar.
To improve separability, we build in a step to improve the discrimination of the learned features, by optimal transport. It helps to notice subtle differences.
Paper at NeurIPS workshop on Neuro Causal and Symbolic AI (nCSI), 2022 (Oral).