TY - CONF
T1 - Introducing Routing Uncertainty in Capsule Networks
AU - De Sousa Ribeiro, Fabio
AU - Leontidis, Georgios
AU - Kollias, Stefanos
N1 - Final version has been uploaded and can be made publicly available. The NeurIPS conference does not require or involve any copyright transfer and all proceedings are made available without restrictions via https://papers.nips.cc/
Pre-proceedings online - https://proceedings.neurips.cc/paper/2020
Advances in Neural Information Processing Systems 33 pre-proceedings (NeurIPS 2020)
Edited by: H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin
PY - 2020/11/5
Y1 - 2020/11/5
N2 - Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulation, the local routing iterations are replaced with variational inference of part-object connections in a probabilistic capsule network, leading to a significant speedup without sacrificing performance. In this way, global context is also considered when routing capsules by introducing global latent variables that have direct influence on the objective function, and are updated discriminatively in accordance with the minimum description length (MDL) principle. We focus on enhancing capsule network properties, and perform a thorough evaluation on pose-aware tasks, observing improvements in performance over previous approaches whilst being more computationally efficient.
AB - Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulation, the local routing iterations are replaced with variational inference of part-object connections in a probabilistic capsule network, leading to a significant speedup without sacrificing performance. In this way, global context is also considered when routing capsules by introducing global latent variables that have direct influence on the objective function, and are updated discriminatively in accordance with the minimum description length (MDL) principle. We focus on enhancing capsule network properties, and perform a thorough evaluation on pose-aware tasks, observing improvements in performance over previous approaches whilst being more computationally efficient.
KW - Deep Learning
KW - Capsule Networks
UR - https://proceedings.neurips.cc/paper/2020/file/47fd3c87f42f55d4b233417d49c34783-Paper.pdf
UR - https://proceedings.neurips.cc/paper/2020/hash/47fd3c87f42f55d4b233417d49c34783-Abstract.html
M3 - Unpublished paper
SP - 1
EP - 13
T2 - 34th Conference on Neural Information Processing Systems (NeurIPS 2020)
Y2 - 6 December 2020 through 12 December 2020
ER -