Publications

List of all publications is on my Google Scholar profile.

Recent publications

Affordance Perception by a Knowledge-Guided Vision-Language Model with Efficient Error Correction. Gertjan Burghouts, Marianne Schaaphok, Michael van Bekkum, Wouter Meijer, Fieke Hillerström, Jelle van Mil. International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024.

Open-World Visual Reasoning by a Neuro-Symbolic Program of Zero-Shot Symbols. Gertjan Burghouts, Fieke Hillerström, Erwin Walraven, Michael van Bekkum, Frank Ruis, Joris Sijs, Jelle van Mil, Judith Dijk. International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024.

Graph Neural Networks for Learning Equivariant Representations of Neural Networks. Miltiadis Kofinas, Boris Knyazev, Yan Zhang, Yunlu Chen, Gertjan Burghouts, Efstratios Gavves, Cees G. M. Snoek, David W. Zhang. International Conference on Learning Representations (ICLR) 2024. Oral (top 1.2%).

Synthesizing Classifiers from Prior Knowledge. Gertjan Burghouts, Klamer Schutte, Maarten Kruithof, Wyke Huizinga, Frank Ruis, Hugo Kuijf. International Conference on Computer Vision Theory and Applications (VISAPP) 2024.

Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation. Dennis Hoftijzer, Gertjan Burghouts, Luuk Spreeuwers. IEEE Robotic Computation 2023. Demo. Code.

Diffusing More Objects for Semi-Supervised Domain Adaptation with Less Labeling. Leander Heuvel, Gertjan Burghouts, David Zhang, Gwenn Englebienne, Sabina van Rooij. NeurIPS workshop on Diffusion Models 2023. Paper.

Data Augmentations in Deep Weight Spaces. Aviv Shamsian, David Zhang, Aviv Navon, Yan Zhang, Miltiadis Kofinas, Idan Achituve, Riccardo Valperga, Gertjan Burghouts, Efstratios Gavves, Cees Snoek, Ethan Fetaya, Gal Chechik, Haggai Maron. NeurIPS workshop NeurReps 2023. Paper.

Efficient Transfer by Robust Label Selection and Learning with Pseudo-Labels. Wyke Huizinga, Maarten Kruithof, Gertjan Burghouts, Klamer Schutte. IEEE ICIP 2023.

Aerial Image Segmentation with Minimal Annotation Effort Using Clustering of Pretrained Embeddings. Sabina B. van Rooij, Maarten C. Kruithof, Wyke Huizingaa, Gertjan J. Burghouts, Klamer Schutte. SPIE 2023.

Neural Networks Are Graphs! Graph Neural Networks for Equivariant Processing of Neural Networks. David W Zhang, Miltiadis Kofinas, Yan Zhang, Yunlu Chen, Gertjan J. Burghouts, Cees G. M. Snoek. ICML TAG workshop 2023. Paper.

Improved Zero-Shot Object Localization using Contextualized Prompts and Objects in Context. Gertjan J. Burghouts, Wouter Meijer, Fieke Hillerström, Jelle van Mil, Michael van Bekkum, Marianne Schaaphok, Frank Ruis. ICRA Pretraining for Robotics 2023. Paper.

Unlocking Slot Attention by Changing Optimal Transport Costs. Yan Zhang, David W Zhang, Simon Lacoste-Julien, Gertjan J. Burghouts, Cees G. M. Snoek. ICML 2023.

Also appeared at: NeurIPS workshop on Neuro Causal and Symbolic AI (nCSI), and, NeurIPS workshop on Attention, 2023 (Oral). Paper.

Self-guided Diffusion Models. Vincent Tao Hu, David W. Zhang, Yuki M. Asano, Gertjan J. Burghouts, Cees G. M. Snoek. CVPR 2023. Paper.

Also appeared at: NeurIPS workshop on Self-Supervised Learning: Theory and Practice, and, NeurIPS workshop on Score-Based Methods, 2022.

Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets. David W Zhang, Gertjan J. Burghouts, Cees G. M. Snoek. Learning on Graphs conference (LoG), 2022. Paper.

Anomaly Detection in an Open World by a Neuro-symbolic Program on Zero-shot Symbols. Gertjan J. Burghouts, Fieke Hillerström, Erwin Walraven, Michael van Bekkum, Frank Ruis, Joris Sijs. IROS workshop on Probabilistic Robotics in the Age of Deep Learning, 2022. Paper (Oral) (Best paper award).

Maximum Class Separation as Inductive Bias in One Matrix. Tejaswi Kasarla, Gertjan J. Burghouts, Max van Spengler, Elise van der Pol, Rita Cucchiara, Pascal Mettes. NeurIPS, 2022. Paper (Oral, <2%).

Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation. Y. Zhang, D.W. Zhang, S. Lacoste-Julien, G.J. Burghouts, C.G.M. Snoek. ICLR, 2022. Paper, code, video.

Coarse-to-Fine Visual Question Answering by Iterative, Conditional Refinement. G.J. Burghouts, W. Pereboom. International Conference on Image Analysis and Processing, 2021. Paper.

Cluster Centers Provide Good First Labels for Object Detection. G.J. Burghouts, M. Kruithof, W. Pereboom, K. Schutte. International Conference on Image Analysis and Processing, 2021. Paper.

Independent Prototype Propagation for Zero-Shot Compositionality. F. Ruis, G.J. Burghouts, D. Bucur. NeurIPS, 2021. Paper.

Equidistant Hyperspherical Prototypes Improve Uncertainty Quantification. G.J. Burghouts, P. Mettes. NeurIPS, 2021, Workshop on Deployable Decision Making in Embodied Systems (DDM). Paper.

Recurrently Predicting Hypergraphs. D.W. Zhang, G.J. Burghouts, C.G.M. Snoek. https://arxiv.org/abs/2106.13919, 2021.

Set Prediction without Imposing Structure as Conditional Density Estimation. D.W. Zhang, G.J. Burghouts, C.G.M. Snoek. International Conference on Learning Representations (ICLR), 2021. Paper.

ZERO - Detect objects without training examples by knowing their parts. G.J. Burghouts, F. Hillerström. AAAI Combining Machine Learning and Knowledge Engineering (MAKE), 2021. Paper.

Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection. M. Tsiaousis, G.J. Burghouts, F. Hillerstrom, P. van der Putten. International Workshop on Deep Learning for Human-Centric Activity Understanding (DL-HAU), 2021. Paper.

Task-specific Novel Object Characterization. G.J. Burghouts. International Workshop on Cognitive Robotics (ICWR), 2021. Paper.

Robotic Self-Assessment of Competence. G.J. Burghouts, A. Huizing, M.A. Neerincx. ACM/IEEE Human-Robot Interaction (HRI), 2020. Paper.

Patents

System and method of video content filtering. G.J. Burghouts, V. Westerwoudt, K. Schutte. US Patent 10,929,688. Sequence Finder (Long-term Activity Recognition in Videos).

Detection of human actions from video data. G.J. Burghouts. US Patent 9,613,276. Spatio-Temporal Saliency for Recognition of Human Actions in Videos.

Image pattern recognition system and method. G.J. Burghouts. US Patent 9,959,485. Soft-assignment Random Forest.

Video access system and method based on action type detection. P. Hanckmann, K. Schutte, L. De Penning, G.J. Burghouts. US Patent 9,554,081. Automatic Generation of Textual Action Descriptions.

Selected publications

Recognizing stress using semantics and modulation of speech and gestures. I Lefter, GJ Burghouts, LJM Rothkrantz. IEEE Transactions on Affective Computing 7 (2), 162-175, 2016.

Instantaneous threat detection based on a semantic representation of activities, zones and trajectories. G.J. Burghouts, K. Schutte, R.J.M. ten Hove, S.P. van den Broek, J. Baan, et al. Signal, Image and Video Processing 8 (1), 191-200, 2014.

Complex threat detection: Learning vs. rules, using a hierarchy of features. G.J. Burghouts, P. van Slingerland, R.J.M. ten Hove, R.J.M. den Hollander, K. Schutte. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2014.

A unified approach to the recognition of complex actions from sequences of zone-crossings. G. Sanromà, L. Patino, G.J. Burghouts, K. Schutte, J. Ferryman. Image and Vision Computing 32 (5), 363-378, 2014.

An audio-visual dataset of human–human interactions in stressful situations. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. Journal on Multimodal User Interfaces 8 (1), 29-41, 2014.

Selection of negative samples and two-stage combination of multiple features for action detection in thousands of videos. G.J. Burghouts, K. Schutte, H. Bouma, R.J.M. den Hollander. Machine Vision and Applications 25 (1), 85-98, 2014.

A comparative study on automatic audio–visual fusion for aggression detection using meta-information. I. Lefter, L.J.M. Rothkrantz, G.J. Burghouts. Pattern Recognition Letters 34 (15), 1953-1963, 2013.

Spatio-temporal layout of human actions for improved bag-of-words action detection. G.J. Burghouts, K. Schutte. Pattern Recognition Letters 34 (15), 1861-1869, 2013.

Improved action recognition by combining multiple 2D views in the bag-of-words model. G.J. Burghouts, P. Eendebak, H. Bouma, R.J.M. ten Hove. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2013.

Activity recognition and localization on a truck parking lot. M. Andersson, L. Patino, G.J. Burghouts, A. Flizikowski, M. Evans, D. Gustafsson, H. Petersson, K. Schutte, J. Ferryman. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2013.

Soft-assignment random-forest with an application to discriminative representation of human actions in videos. G.J. Burghouts. International Journal of Pattern Recognition and Artificial Intelligence, 2013.

Spatio-temporal saliency for action similarity. G.J. Burghouts, S.P. van den Broek, R.J.M. ten Hove. IEEE Conference on Computer Vision and Pattern Recognition (Workshop), 2013.

Correlations between 48 human actions improve their detection. G.J. Burghouts, K. Schutte. International Conference on Pattern Recognition (ICPR), 2012.

Recognition of long-term behaviors by parsing sequences of short-term actions with a stochastic regular grammar. G. Sanroma, G.J. Burghouts, K. Schutte. Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR), 2012.

Automated textual descriptions for a wide range of video events with 48 human actions. P. Hanckmann, K. Schutte, G.J. Burghouts. European Conference on Computer Vision (ECCV), 372-380, 2012.

Automatic Audio-Visual Fusion for Aggression Detection Using Meta-information. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. IEEE Advanced Video and Signal-Based Surveillance (AVSS), 2012.

Learning the fusion of audio and video aggression assessment by meta-information from human annotations. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. International Conference on Information Fusion, 1527-1533, 2012.

Reasoning about threats: From observables to situation assessment. G.J. Burghouts, J.-W. Marck. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 2011.

Material-specific adaptation of color invariant features. G.J. Burghouts, J.M. Geusebroek. Pattern Recognition Letters 30 (3), 306-313, 2009.

Performance evaluation of local colour invariants. G.J. Burghouts, J.M. Geusebroek. Computer Vision and Image Understanding 113 (1), 48-62, 2009.

The distribution family of similarity distances. G.J. Burghouts, A.W.M. Smeulders, J.M. Geusebroek. Advances in neural information processing systems (NeurIPS), 201-208, 2007.

Quasi-periodic spatiotemporal filtering. G.J. Burghouts, J.M. Geusebroek. IEEE Transactions on Image Processing 15 (6), 1572-1582, 2006.

Color Textons for Texture Recognition. G.J. Burghouts, J.M. Geusebroek. BMVC, 1099-1108, 2006.

The Amsterdam library of object images. J.M. Geusebroek, G.J. Burghouts, A.W.M. Smeulders. International Journal of Computer Vision 61 (1), 103-112, 2005.