Publications

List of all publications is on my Google Scholar profile.

Recent publications

Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning. Eric Brouwer, Matias Valdenegro-Toro, Marco Zullich, Jan Erik van Woerden and Gertjan Burghouts. International Conference on Computer Vision Theory and Applications (VISAPP) 2025.

Self-Supervised Partial Cycle-Consistency for Multi-View Matching. Fedor Taggenbrock, Gertjan Burghouts and Ronald Poppe. International Conference on Computer Vision Theory and Applications (VISAPP) 2025.

Information Gathering in POMDPs using Active Inference. Erwin Walraven, Joris Sijs, Gertjan Burghouts. Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS) 2024. Paper.

Incremental Learning of Affordances using Markov Logic Networks. George Potter, Gertjan Burghouts, Joris Sijs. IEEE Robotic Computing (IEEE IRC) 2024. Paper.

Do better language models have crisper vision? Jona Ruthardt, Gertjan J. Burghouts, Serge Belongie, Yuki M. Asano. Submitted, 2024. Paper.

Guided SAM: Label-Efficient Part Segmentation. Sabina van Rooij, Gertjan Burghouts. International Conference on Pattern Recognition (ICPR) 2024.

Anticipating Future Object Compositions without Forgetting. Youssef Zahran, Gertjan Burghouts, Yke Bauke Eisma. International Conference on Pattern Recognition (ICPR) 2024. Paper. Code.

Towards Probabilistic Inductive Logic Programming with Neurosymbolic Inference and Relaxation. Fieke Hillerstrom, Gertjan Burghouts. Theory and Practice of Logic Programming (TPLP) 2024. Paper.

Scaling 3D Reasoning with LMMs to Large Robot Mission Environments Using Datagraphs. Wouter Meijer, Anne Kemmeren, Gertjan Burghouts, Michael van Bekkum, Jelle van Mil. Robotics: Science and Systems. Workshop on Semantics for Robotics: From Environment Understanding and Reasoning to Safe Interaction 2024. Paper.

Language-Based Augmentation to Mitigate Shortcut Learning in Object-Goal Navigation. Dennis Hoftijzer, Gertjan Burghouts, Luuk Spreeuwers. International Journal of Semantic Computing 2024. Paper.

Which objects help me to act effectively? Reasoning about physically-grounded affordances. Anne Kemmeren, Gertjan Burghouts, Michael van Bekkum, Wouter Meijer, Jelle van Mil. Robotics: Science and Systems. Semantic Reasoning and Goal Understanding in Robotics 2024. Paper.

Visual Prompt Tuning and Ensemble Undersampling for One-Shot Vehicle Classification. Jan Erik van Woerden, Gertjan J. Burghouts, Sabina B. van Rooij, Frank A. Ruis, Judith Dijk, Hugo J. Kuijf. SPIE 2024. Paper.

Zero-shot neuro-symbolic parsing of body keypoints. Dalia Aljawaheri, Gertjan J. Burghouts, Judith Dijk, Hugo J. Kuijf. SPIE 2024. Paper.

Lightweight Uncertainty Quantification with Simplex Semantic Segmentation for Terrain Traversability. Judith Dijk, Gertjan Burghouts, Kapil D. Katyal, Bryanna Y. Yeh, Craig T. Knuth, Ella Fokkinga, Tejaswi Kasarla, Pascal Mettes. ICRA Off-road Autonomy workshop 2024. Paper.

Affordance Perception by a Knowledge-Guided Vision-Language Model with Efficient Error Correction. Gertjan Burghouts, Marianne Schaaphok, Michael van Bekkum, Wouter Meijer, Fieke Hillerström, Jelle van Mil. International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024. Paper.

Open-World Visual Reasoning by a Neuro-Symbolic Program of Zero-Shot Symbols. Gertjan Burghouts, Fieke Hillerström, Erwin Walraven, Michael van Bekkum, Frank Ruis, Joris Sijs, Jelle van Mil, Judith Dijk. International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024. Oral. Paper.

Graph Neural Networks for Learning Equivariant Representations of Neural Networks. Miltiadis Kofinas, Boris Knyazev, Yan Zhang, Yunlu Chen, Gertjan Burghouts, Efstratios Gavves, Cees G. M. Snoek, David W. Zhang. International Conference on Learning Representations (ICLR) 2024. Oral (top 1.2%). Paper.

Synthesizing Classifiers from Prior Knowledge. Gertjan Burghouts, Klamer Schutte, Maarten Kruithof, Wyke Huizinga, Frank Ruis, Hugo Kuijf. International Conference on Computer Vision Theory and Applications (VISAPP) 2024. Paper.

Language-Based Augmentation to Address Shortcut Learning in Object-Goal Navigation. Dennis Hoftijzer, Gertjan Burghouts, Luuk Spreeuwers. IEEE Robotic Computation 2023. Paper. Demo. Code.

Diffusing More Objects for Semi-Supervised Domain Adaptation with Less Labeling. Leander Heuvel, Gertjan Burghouts, David Zhang, Gwenn Englebienne, Sabina van Rooij. NeurIPS workshop on Diffusion Models 2023. Paper.

Data Augmentations in Deep Weight Spaces. Aviv Shamsian, David Zhang, Aviv Navon, Yan Zhang, Miltiadis Kofinas, Idan Achituve, Riccardo Valperga, Gertjan Burghouts, Efstratios Gavves, Cees Snoek, Ethan Fetaya, Gal Chechik, Haggai Maron. NeurIPS workshop NeurReps 2023. Paper.

Efficient Transfer by Robust Label Selection and Learning with Pseudo-Labels. Wyke Huizinga, Maarten Kruithof, Gertjan Burghouts, Klamer Schutte. IEEE ICIP 2023. Paper.

Aerial Image Segmentation with Minimal Annotation Effort Using Clustering of Pretrained Embeddings. Sabina B. van Rooij, Maarten C. Kruithof, Wyke Huizingaa, Gertjan J. Burghouts, Klamer Schutte. SPIE 2023. Paper.

Neural Networks Are Graphs! Graph Neural Networks for Equivariant Processing of Neural Networks. David W Zhang, Miltiadis Kofinas, Yan Zhang, Yunlu Chen, Gertjan J. Burghouts, Cees G. M. Snoek. ICML TAG workshop 2023. Paper.

Improved Zero-Shot Object Localization using Contextualized Prompts and Objects in Context. Gertjan J. Burghouts, Wouter Meijer, Fieke Hillerström, Jelle van Mil, Michael van Bekkum, Marianne Schaaphok, Frank Ruis. ICRA Pretraining for Robotics 2023. Paper.

Unlocking Slot Attention by Changing Optimal Transport Costs. Yan Zhang, David W Zhang, Simon Lacoste-Julien, Gertjan J. Burghouts, Cees G. M. Snoek. ICML 2023. Paper

Also appeared at: NeurIPS workshop on Neuro Causal and Symbolic AI (nCSI), and, NeurIPS workshop on Attention, 2023 (Oral). Paper.

Self-guided Diffusion Models. Vincent Tao Hu, David W. Zhang, Yuki M. Asano, Gertjan J. Burghouts, Cees G. M. Snoek. CVPR 2023. Paper.

Also appeared at: NeurIPS workshop on Self-Supervised Learning: Theory and Practice, and, NeurIPS workshop on Score-Based Methods, 2022.

Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets. David W Zhang, Gertjan J. Burghouts, Cees G. M. Snoek. Learning on Graphs conference (LoG), 2022. Paper.

Anomaly Detection in an Open World by a Neuro-symbolic Program on Zero-shot Symbols. Gertjan J. Burghouts, Fieke Hillerström, Erwin Walraven, Michael van Bekkum, Frank Ruis, Joris Sijs. IROS workshop on Probabilistic Robotics in the Age of Deep Learning, 2022. Paper (Oral) (Best paper award).

Maximum Class Separation as Inductive Bias in One Matrix. Tejaswi Kasarla, Gertjan J. Burghouts, Max van Spengler, Elise van der Pol, Rita Cucchiara, Pascal Mettes. NeurIPS, 2022. Paper (Oral, top 0.1%). Code.

Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation. Y. Zhang, D.W. Zhang, S. Lacoste-Julien, G.J. Burghouts, C.G.M. Snoek. ICLR, 2022. Paper, code, video.

Coarse-to-Fine Visual Question Answering by Iterative, Conditional Refinement. G.J. Burghouts, W. Pereboom. International Conference on Image Analysis and Processing, 2021. Paper.

Cluster Centers Provide Good First Labels for Object Detection. G.J. Burghouts, M. Kruithof, W. Pereboom, K. Schutte. International Conference on Image Analysis and Processing, 2021. Paper.

Independent Prototype Propagation for Zero-Shot Compositionality. F. Ruis, G.J. Burghouts, D. Bucur. NeurIPS, 2021. Paper.

Equidistant Hyperspherical Prototypes Improve Uncertainty Quantification. G.J. Burghouts, P. Mettes. NeurIPS, 2021, Workshop on Deployable Decision Making in Embodied Systems (DDM). Paper.

Recurrently Predicting Hypergraphs. D.W. Zhang, G.J. Burghouts, C.G.M. Snoek. Paper, 2021.

Set Prediction without Imposing Structure as Conditional Density Estimation. D.W. Zhang, G.J. Burghouts, C.G.M. Snoek. International Conference on Learning Representations (ICLR), 2021. Paper.

ZERO - Detect objects without training examples by knowing their parts. G.J. Burghouts, F. Hillerström. AAAI Combining Machine Learning and Knowledge Engineering (MAKE), 2021. Paper.

Spot What Matters: Learning Context Using Graph Convolutional Networks for Weakly-Supervised Action Detection. M. Tsiaousis, G.J. Burghouts, F. Hillerstrom, P. van der Putten. International Workshop on Deep Learning for Human-Centric Activity Understanding (DL-HAU), 2021. Paper.

Task-specific Novel Object Characterization. G.J. Burghouts. International Workshop on Cognitive Robotics (ICWR), 2021. Paper.

Robotic Self-Assessment of Competence. G.J. Burghouts, A. Huizing, M.A. Neerincx. ACM/IEEE Human-Robot Interaction (HRI), 2020. Paper.

Patents

System and method of video content filtering. G.J. Burghouts, V. Westerwoudt, K. Schutte. US Patent 10,929,688. Sequence Finder (Long-term Activity Recognition in Videos).

Detection of human actions from video data. G.J. Burghouts. US Patent 9,613,276. Spatio-Temporal Saliency for Recognition of Human Actions in Videos.

Image pattern recognition system and method. G.J. Burghouts. US Patent 9,959,485. Soft-assignment Random Forest.

Video access system and method based on action type detection. P. Hanckmann, K. Schutte, L. De Penning, G.J. Burghouts. US Patent 9,554,081. Automatic Generation of Textual Action Descriptions.

Selected publications

Recognizing stress using semantics and modulation of speech and gestures. I Lefter, GJ Burghouts, LJM Rothkrantz. IEEE Transactions on Affective Computing 7 (2), 162-175, 2016.

Instantaneous threat detection based on a semantic representation of activities, zones and trajectories. G.J. Burghouts, K. Schutte, R.J.M. ten Hove, S.P. van den Broek, J. Baan, et al. Signal, Image and Video Processing 8 (1), 191-200, 2014.

Complex threat detection: Learning vs. rules, using a hierarchy of features. G.J. Burghouts, P. van Slingerland, R.J.M. ten Hove, R.J.M. den Hollander, K. Schutte. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2014.

A unified approach to the recognition of complex actions from sequences of zone-crossings. G. Sanromà, L. Patino, G.J. Burghouts, K. Schutte, J. Ferryman. Image and Vision Computing 32 (5), 363-378, 2014.

An audio-visual dataset of human–human interactions in stressful situations. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. Journal on Multimodal User Interfaces 8 (1), 29-41, 2014.

Selection of negative samples and two-stage combination of multiple features for action detection in thousands of videos. G.J. Burghouts, K. Schutte, H. Bouma, R.J.M. den Hollander. Machine Vision and Applications 25 (1), 85-98, 2014.

A comparative study on automatic audio–visual fusion for aggression detection using meta-information. I. Lefter, L.J.M. Rothkrantz, G.J. Burghouts. Pattern Recognition Letters 34 (15), 1953-1963, 2013.

Spatio-temporal layout of human actions for improved bag-of-words action detection. G.J. Burghouts, K. Schutte. Pattern Recognition Letters 34 (15), 1861-1869, 2013.

Improved action recognition by combining multiple 2D views in the bag-of-words model. G.J. Burghouts, P. Eendebak, H. Bouma, R.J.M. ten Hove. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2013.

Activity recognition and localization on a truck parking lot. M. Andersson, L. Patino, G.J. Burghouts, A. Flizikowski, M. Evans, D. Gustafsson, H. Petersson, K. Schutte, J. Ferryman. IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2013.

Soft-assignment random-forest with an application to discriminative representation of human actions in videos. G.J. Burghouts. International Journal of Pattern Recognition and Artificial Intelligence, 2013.

Spatio-temporal saliency for action similarity. G.J. Burghouts, S.P. van den Broek, R.J.M. ten Hove. IEEE Conference on Computer Vision and Pattern Recognition (Workshop), 2013.

Correlations between 48 human actions improve their detection. G.J. Burghouts, K. Schutte. International Conference on Pattern Recognition (ICPR), 2012.

Recognition of long-term behaviors by parsing sequences of short-term actions with a stochastic regular grammar. G. Sanroma, G.J. Burghouts, K. Schutte. Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR), 2012.

Automated textual descriptions for a wide range of video events with 48 human actions. P. Hanckmann, K. Schutte, G.J. Burghouts. European Conference on Computer Vision (ECCV), 372-380, 2012.

Automatic Audio-Visual Fusion for Aggression Detection Using Meta-information. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. IEEE Advanced Video and Signal-Based Surveillance (AVSS), 2012.

Learning the fusion of audio and video aggression assessment by meta-information from human annotations. I. Lefter, G.J. Burghouts, L.J.M. Rothkrantz. International Conference on Information Fusion, 1527-1533, 2012.

Reasoning about threats: From observables to situation assessment. G.J. Burghouts, J.-W. Marck. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 2011.

Material-specific adaptation of color invariant features. G.J. Burghouts, J.M. Geusebroek. Pattern Recognition Letters 30 (3), 306-313, 2009.

Performance evaluation of local colour invariants. G.J. Burghouts, J.M. Geusebroek. Computer Vision and Image Understanding 113 (1), 48-62, 2009.

The distribution family of similarity distances. G.J. Burghouts, A.W.M. Smeulders, J.M. Geusebroek. Advances in neural information processing systems (NeurIPS), 201-208, 2007.

Quasi-periodic spatiotemporal filtering. G.J. Burghouts, J.M. Geusebroek. IEEE Transactions on Image Processing 15 (6), 1572-1582, 2006.

Color Textons for Texture Recognition. G.J. Burghouts, J.M. Geusebroek. BMVC, 1099-1108, 2006.

The Amsterdam library of object images. J.M. Geusebroek, G.J. Burghouts, A.W.M. Smeulders. International Journal of Computer Vision 61 (1), 103-112, 2005.